JP6962982B2 - Information processing system, information processing device, information processing program, and information processing method - Google Patents

Description

The present invention relates to an information processing system, an information processing device, an information processing program, and an information processing method for measuring user's health information.

Conventionally, there is a technique of measuring a user's sleep and analyzing the user's sleep based on the measurement result (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2013-168026

When analyzing the health of the user as in the above analysis of sleep, it is preferable that the user continuously performs the measurement and the confirmation of the analysis result.

Therefore, an object of the present invention is an information processing system, an information processing device, an information processing program, and an information processing program that can motivate the user to continuously measure and / or confirm the analysis result of information on health. It is to provide an information processing method.

In order to solve the above problems, the present invention has adopted the following configurations (1) to (28).

(1)
An example of the present invention is an information processing system that executes a game application. The information processing system includes an acquisition means, an information calculation means, and a game execution means. The acquisition means acquires user information for calculating information regarding the user's sleep. The information calculation means calculates health information regarding the user's sleep and / or fatigue based on the acquired user information. The game execution means controls the progress of the game in the application of the game based on the health information.

(2)
The game execution means may control the progress of the game story in the game application based on health information.

(3)
The game execution means may grow the parameters of the objects appearing in the game application according to the health information.

(4)
The game execution means may automatically control the progress of the game according to the calculation of health information satisfying a predetermined condition.

(5)
The information calculation means may determine that the user has awakened or woke up.
The information processing system starts accepting instruction input for starting execution of a predetermined awakening game in response to the determination that the user has awakened or got out of bed, and when the instruction input is received, the user's operation input The awakening game processing means for executing the awakening game processing based on the above may be further provided.

(6)
When the awakening game is executed, the information calculation means may accept an instruction input to start the execution of the awakening game on condition that the user is within a predetermined period from the time when it is determined that the user has awakened or got out of bed. good.

(7)
The game execution means may execute game processing related to game progress based on the result of the awakening game.

(8)
The information calculation means may calculate information on the user's fatigue as health information based on the user's input performed in the awakening game process and the state related to the user's sleep.

(9)
The acquisition means may acquire user information during a plurality of sleep periods of the user. The information calculation means may calculate health information for each of a plurality of user sleep periods based on the user information acquired during the sleep period. The game execution means may control the game progress based on the comparison result between the new health information regarding the latest sleep period and the information based on the health information regarding the past sleep period prior to the sleep period.

(10)
The game execution means may control the progress of the game based on the difference between the numerical value based on the new health information and the numerical value based on the past health information.

(11)
The game execution means may determine whether or not the new health information is improved by a predetermined standard or more as compared with the past health information, and control the game progress based on the determination result.

(12)
The information processing system may have access to a storage unit that stores health information about a plurality of users. The game execution means may control the progress of the game based on the comparison result between the health information calculated by the information calculation means and the health information about another user stored in the storage unit.

(13)
Another example of the present invention is an information processing system that executes an application. The information processing system includes acquisition means, information calculation means, and display control means. The acquisition means acquires user information for calculating information regarding the user's sleep. The information calculation means calculates a plurality of types of health information regarding the user's sleep and / or fatigue based on the acquired user information. In the application, the display control means generates an image of an object whose content changes according to each of a plurality of health information and displays it on a predetermined display device.

(14)
The information calculation means may determine that the user has awakened or woke up. The display control means may automatically display an image on the display device when it is determined that the user has awakened or woke up.

(15)
The display control means changes the display mode of the first type regarding a predetermined object appearing in the application according to the first health information among the plurality of health information, and the display mode of the second type regarding the object. May be changed according to the second health information of the plurality of health information.

(16)
The acquisition means may acquire user information during a plurality of sleep periods of the user. The information calculation means may calculate health information for each of a plurality of user sleep periods based on the user information acquired during the sleep period. The display control means may generate an image based on a comparison result between new health information regarding the latest sleep period and information based on health information regarding a past sleep period prior to the sleep period.

(17)
The display control means may generate an image based on the difference between the numerical value based on the new health information and the numerical value based on the past health information.

(18)
The display control means may determine whether or not the new health information is improved by a predetermined standard or more as compared with the past health information, and generate an image based on the determination result.

(19)
The information processing system may have access to a storage unit that stores each health information about a plurality of users. The display control means compares each health information calculated by the information calculation means with each health information about other users stored in the storage unit for each type of health information, and generates an image based on the comparison result. You may.

(20)
The application may be a game application. The information calculation means may calculate health information regarding the user's sleep and / or fatigue based on the user information. The display control means may present a part of the health information to the user as a game element, and may present the same or different health information as the part of the health information to the user as an index showing the health. ..

(21)
The information calculation means may evaluate the user's sleep and / or fatigue and calculate health information representing the evaluation result. The information processing system may further include a presentation means for generating advice information and / or recommendation information for improving the evaluation based on the evaluation result and presenting it to the user.

(22)
The information calculation means is as follows. ~ 15. Of these, at least some may be calculated as health information.
1. 1. Time from falling asleep to falling asleep 2. Time from awakening to getting out of bed 3. 4. Percentage of deep sleep during the period from falling asleep to a predetermined time. 5. Percentage of light sleep during the period from the time of awakening to a predetermined time before. REM sleep cycle 6. Ratio of REM sleep time to non-REM sleep time 7. Sleep time 8. Difference between ideal sleep onset timing and actual sleep onset timing 9. Difference between ideal awakening timing and actual awakening timing 10. Number of awakenings 11. Timing of awakening halfway 12. Time for awakening 13. Number of turns over 14. Snoring size 15. Sleeping environment

(23)
The information processing system may include a sensor, a terminal device including a display device, and a server capable of communicating with the terminal device via a network. The terminal device may acquire user information from the sensor and display an image of the application on the display device. The server may store health information.

(24)
The information processing system may further include a notification means for notifying the user to awaken.

(25)
The acquisition means may acquire user information from a sensor that detects at least one of the user's pulse, respiration, and body movement.

(26)
The information processing system may further include a sensor that detects the biometric information of the user without contacting the user. The acquisition means may acquire biometric information as user information from the sensor.

(27)
The sensor may send radio waves or sound waves toward the detection target, receive reflected waves, and output biometric information based on the received results.

(28)
The sensor may be a Doppler sensor.

Another example of the present invention may be an information processing device (for example, a mobile terminal) or a server included in the information processing system according to the above (1) to (28). Further, another example of the present invention may be an information processing program in which the computer of the information processing apparatus or server functions as some of the means in the above (1) to (28). Further, another example of the present invention may be an information processing method executed in the information processing system, information processing apparatus, or server.

According to the present invention, it is possible to motivate the user to continuously measure and / or confirm the analysis result of health information.

Block diagram showing an example of the configuration of the information processing system in this embodiment The figure which shows an example of the detailed configuration of the terminal system 2. The figure which shows an example of the appearance of the terminal system 2. The figure which shows an example of the operation flow of the terminal system in a sleep period A functional block diagram showing an example of a functional configuration for calculating health information in the processing unit 11 of the mobile terminal 5. The figure which shows an example of the flow of the game processing in this embodiment The figure which shows an example of the game image (called the game image at the time of awakening) displayed on the mobile terminal at the time of awakening of a user. A diagram showing an example of a game image (called a simple display image) displayed when performing a simple display of health information. The figure which shows an example of a standby image The figure which shows an example of the detailed display image The figure which shows another example of the detailed display image The figure which shows an example of the game image at the time of getting out of bed displayed on the mobile terminal at the time of getting out of bed of a user. The figure which shows an example of the game image at the time of entering the bed which is displayed on the mobile terminal when the user enters the bed Diagram showing an example of a replay game image A flowchart showing an example of the flow of measurement processing executed in the mobile terminal 5. A flowchart showing an example of the flow of awakening processing executed in the mobile terminal 5. A flowchart showing an example of the flow of daytime processing executed on the mobile terminal 5. A flowchart showing an example of the flow of processing at the time of entering the bed executed in the mobile terminal 5. Flowchart showing an example of the flow of processing executed on the server The figure which shows an example of the data structure of the user data stored in the server in this embodiment. The figure which shows an example of the game image displayed in the modified example of the said embodiment. The figure which shows an example of the image displayed in the modification of the said embodiment.

[1. Information processing system configuration]
Hereinafter, the information processing system, the information processing device, the information processing program, and the information processing method according to the present embodiment will be described with reference to the drawings. First, the overall configuration of the information processing system according to the present embodiment will be described. FIG. 1 is a block diagram showing an example of the configuration of the information processing system according to the present embodiment. As shown in FIG. 1, the information processing system 1 includes a terminal system 2 and a server 3. The terminal system 2 and the server 3 can communicate with each other via a network 4 such as the Internet or a mobile communication network. Although only one terminal system 2 is shown in FIG. 1, in the present embodiment, the information processing system 1 includes a plurality of terminal systems provided for each user. The information processing system in the present embodiment is for enabling the user to manage his / her own health as if it were a game.

The terminal system 2 manages the health of the user. Although the details will be described later, the terminal system 2 calculates information on sleep and fatigue as health information on the user's health and / or body during the user's sleep. In the present embodiment, the terminal system 2 has a mobile terminal 5 and a base device 6, and the mobile terminal 5 calculates health information based on the information detected by the base device 6 by the sensor (FIG. 1). reference). In addition, the terminal system 2 presents the calculation result and information (for example, advice) based on the calculation result to the user.

In the present embodiment, the terminal system 2 executes a game application in order to incorporate an element of gamification into the health management of the user. That is, the terminal system 2 executes a game process using the above health information as a game input by executing the game application (see FIG. 1). Further, the terminal system 2 uploads the above-mentioned health information and game result information to the server 3 (see FIG. 1).

The server 3 stores (can be said to be accumulated) the information uploaded from the terminal system 2. In the present embodiment, the server 3 acquires and stores information about each user (for example, health information and game result information) from a plurality of terminal systems. Further, the server 3 provides a network service to the user based on the stored information. The server 3 transmits, for example, information for performing a network service (for example, service information) to the terminal system 2 according to the state of sleep or fatigue of the user (see FIG. 1). The service information is, for example, information regarding a privilege given to a user (a privilege in a network service or a privilege in the game application). Further, the service information may be information on advice to the user, information on recommendations (recommendations) to the user, data on the content to be provided to the user, and the like. In addition, the server 3 may transmit health information about other users to the terminal system 2 as needed (for example, in response to a request from the terminal system 2).

As described above, in the present embodiment, the terminal system 2 calculates the user's health information (specifically, sleep / fatigue information), and executes a game in which the health information is input to the game. The server 3 also provides the user (in other words, the terminal system 2) with a network service based on health information and / game results.

Next, an example of the configuration of the terminal system 2 will be described. FIG. 2 is a diagram showing an example of a detailed configuration of the terminal system 2. FIG. 3 is a diagram showing an example of the appearance of the terminal system 2. As shown in FIGS. 1 to 3, the terminal system 2 includes a mobile terminal 5 and a base device 6. The mobile terminal 5 is carried by the user. The base device 6 is installed at the user's home, for example.

In the present embodiment, the mobile terminal 5 is a portable information processing device, and the base device 6 is a cradle to which the mobile terminal 5 can be connected. As shown in FIG. 3, the mobile terminal 5 can be detachably connected to the base device 6. Further, the base device 6 has a function of charging the mobile terminal 5, and when the mobile terminal 5 and the base device 6 are connected, the mobile terminal 5 can be charged by the base device 6. In another embodiment, the mobile terminal 5 and the base device 6 may be detachably connected via a cable.

Further, the communication method between the mobile terminal 5 and the base device 6 is arbitrary, and may be performed by wired communication via a cable, or may be performed by wireless communication such as radio wave communication or infrared communication. Further, the communication between the mobile terminal 5 and the base device 6 may be performed by a communication method directly performed between the two, or may be performed by a communication method via a network such as LAN or the Internet.

First, the configuration of the mobile terminal 5 in the present embodiment will be described. The mobile terminal 5 is a portable information processing device, and in the present embodiment, it is a multifunctional device such as a mobile phone, a smartphone, or a tablet terminal. That is, the mobile terminal 5 is a few of various functions (for example, input function, output (display) function, information processing function, network communication function, call function, camera function, etc.) possessed by a general multifunctional device. have. The network communication function is a communication function via the Internet and / or a communication function via a mobile communication network. The mobile terminal 5 may be realized by installing a predetermined function on a ready-made multifunctional device. In the present embodiment, in addition to being used as the multifunctional device, the mobile terminal 5 is used for calculating the health information and executing the game processing. Further, the mobile terminal 5 may be an information processing device (so-called wearable terminal) that can be worn by the user, such as a wristwatch-type or glasses-type terminal.

As shown in FIG. 2, the mobile terminal 5 includes a communication unit 10. The communication unit 10 connects to the network 4 and communicates with the server 3. In the present embodiment, the communication unit 10 is a communication module having a function of connecting to a mobile communication network (in other words, a mobile phone communication network) and performing communication. For example, the communication unit 10 communicates by a communication method compliant with a 3G communication standard or a 4G (including LTE (Long Term Evolution)) communication standard. The method for the mobile terminal 5 to communicate with the server 3 is arbitrary, and for example, a method for communicating via a wireless LAN by a communication module certified by Wi-Fi may be used. Further, the mobile terminal 5 may have both a function of communicating with the server 3 via the mobile communication network and a function of communicating with the server 3 via the wireless LAN.

The mobile terminal 5 includes a processing unit 11. The processing unit 11 executes various types of information processing executed in the mobile terminal 5. The processing unit 11 is connected to each unit 10, 12 to 19 of the mobile terminal 5. The processing unit 11 has a CPU (Central Processing Unit) and a memory. In the mobile terminal 5, the CPU uses the memory to execute the information processing program stored in the mobile terminal 5, thereby executing the various information processing described above. In the present embodiment, as the information processing, the processing unit 11 performs a process of calculating the above-mentioned health information, a game process, a process of presenting information received from the server 3 (for example, the above-mentioned service information) to the user, and the like. Run. Further, when the mobile terminal 5 operates as a multifunctional device, the processing unit 11 executes information processing for realizing each function.

The mobile terminal 5 is provided with an input / output interface, and functions as an information processing device (in other words, an input / output terminal) for a user to input and browse information. Specifically, the mobile terminal 5 includes an operation input unit 12, a display 17, and a speaker 18. The operation input unit 12 is an arbitrary input device that accepts operation input by the user. In the present embodiment, the operation input unit 12 includes a touch panel provided on the display 17 and buttons. In another embodiment, the mobile terminal 5 may include a sensor (accelerometer or gyro sensor) for detecting an operation for moving the mobile terminal 5 as an operation input unit 12.

The display 17, which is an example of the output device, displays various images (for example, game images) generated in the mobile terminal 5 in response to the input to the operation input unit 12, and is based on the data received from the server 3. Display various images (for example, images related to network services). The speaker 18, which is an example of the output device, outputs various sounds (for example, game sounds) generated by the mobile terminal 5 in response to the input to the operation input unit 12, and is based on the data received from the server 3. It outputs various sounds (for example, voice and music related to network services).

The mobile terminal 5 includes a sensor that detects information for calculating the health information. In the present embodiment, the mobile terminal 5 includes a position detection unit 13 and an environment sensor 14.

The position detection unit 13 detects the position of the mobile terminal 5. In the present embodiment, the position detection unit 13 detects the position using GNSS (Global Navigation Satellite System). The position detection unit 13 is, for example, a GPS (Global Positioning System) sensor (for example, a GPS module). The position detection method in the position detection unit 13 is arbitrary, and the position detection unit 13 may detect the position using, for example, a beacon. Further, for example, the position detection unit 13 may calculate information indicating the altitude of the user (for example, information indicating the floor of the building) by calculating the change in altitude based on the detection result of the barometric pressure sensor. ..

The environment sensor 14 detects the environment around the mobile terminal 5. In this embodiment, the environment sensor 14 includes a temperature sensor and a humidity sensor. In another embodiment, the environment sensor 14 may include a barometric pressure sensor, an illuminance sensor, a noise sensor, an odor sensor, and the like. That is, the environment sensor 14 may detect at least one of temperature, humidity, illuminance, atmospheric pressure, sound, and odor. Further, in another embodiment, the microphone 15 may be used as an environment sensor for detecting ambient noise.

Further, the mobile terminal 5 includes a microphone 15. The microphone 15 detects the sound around the mobile terminal 5. The microphone 15 may be used to calculate health information. For example, the mobile terminal 5 may detect the snoring sound of the user by the microphone 15 and calculate information on sleep based on the detection result. The microphone 15 may be used to receive voice input to the mobile terminal 5.

The mobile terminal 5 includes a camera 16. The camera 16 is provided, for example, on the same side (that is, inside) as the surface on which the display 17 is provided in the mobile terminal 5 (see FIG. 3). That is, the camera 16 is provided at a position where the user who operates the mobile terminal 5 can take an image. The mobile terminal 5 may determine the facial expression of the user based on the image captured by the camera 16 and calculate the degree of fatigue based on the facial expression of the user.

The mobile terminal 5 includes a connector 19 for electrically connecting to the base device 6. In the present embodiment, when the mobile terminal 5 is attached to the base device 6 (see FIG. 3), the connector 19 comes into contact with the connector 21 of the base device 6. As a result, communication between the mobile terminal 5 and the base device 6 becomes possible.

The mobile terminal 5 includes a battery (not shown), and each part of the mobile terminal 5 operates by the electric power supplied from the battery. Although details will be described later, in the present embodiment, the battery of the mobile terminal 5 can be charged by the base device 6.

Next, the configuration of the base device 6 in this embodiment will be described. In this embodiment, the base device 6 is placed, for example, in the user's bedroom and is used to detect biometric information about the user's sleep while the user is sleeping. Here, the biological information is information detected from the user's body. In this embodiment, respiration, pulse, and body movement are detected as biological information. In other embodiments, the information detected as biometric information is arbitrary, and any one or two of respiration, pulse, and body movement may be detected, and these three pieces of information may be detected. Other information that is different may be detected. Further, the base device 6 is used to present contents (for example, contents for urging the user to fall asleep) and information (for example, information on evaluation results regarding sleep) to the user while sleeping.

The base device 6 includes a support portion that detachably supports the mobile terminal 5. Specifically, as shown in FIG. 3, the housing (specifically, the support portion) of the base device 6 is provided with a recess corresponding to a part of the shape of the mobile terminal 5. By inserting the mobile terminal 5 into this recess, the mobile terminal 5 is attached to the base device 6. The mechanism for the base device 6 to support the mobile terminal 5 is arbitrary.

As shown in FIG. 2, the base device 6 includes a connector 21. When the mobile terminal 5 is inserted into the recess, the connector 19 of the mobile terminal 5 and the connector 21 of the base device 6 are connected. As a result, communication between the mobile terminal 5 and the base device 6 becomes possible, and the mobile terminal 5 can be charged by the base device 6.

The base device 6 includes a Doppler sensor 24, which is an example of a sensor that detects biological information. The Doppler sensor 24 emits microwaves and receives reflected waves of the emitted microwaves to detect a moving object based on the difference between the frequency of the emitted microwaves and the frequency of the received microwaves. In the present embodiment, the Doppler sensor 24 (more specifically, the emitting unit 24a) irradiates radio waves toward the front of the base device 6 (see FIG. 3). In the present embodiment, the detection target of the Doppler sensor 24 is the user, and the Doppler sensor 24 detects the body movement of the user. Details will be described later, but by performing analysis such as frequency analysis on the detected biological information (in other words, the output waveform of the Doppler sensor 24), biological information such as respiration and pulse is further calculated in addition to body movement. can do.

The base device 6 includes a power acquisition unit 23 that acquires power from an external power source. In the present embodiment, the base device 6 is connected (may be detachable) to the AC adapter and the power plug via a power cord (not shown). By connecting the power plug to the outlet of the external power supply, power is supplied to the power acquisition unit 23 of the base device 6. The base device 6 operates by the electric power from the external power source acquired by the electric power acquisition unit 23. Further, the electric power acquisition unit 23 charges the mobile terminal 5 by sending the supplied electric power to the mobile terminal 5 via the connector 21. In another embodiment, the base device 6 may have a battery, and the electric power charged in the battery may be sent to the mobile terminal 5. Further, in the present embodiment, charging is performed in a mode in which power is supplied via the connector, but in other embodiments, power may be supplied by non-contact charging.

The base device 6 includes a projector 25 that projects an image on a wall surface (including a ceiling) or a screen. The projector 25 may be any display device that displays an image on a surface (which may be uneven) away from the base device 6 by projecting the image on the surface. In the present embodiment, as shown in FIG. 3, the projector 25 is based so that the light projecting unit (specifically, the lens) 25a faces upward, that is, the image is projected upward. It is provided in the device 6. That is, in the present embodiment, the projector 25 projects an image on the ceiling. In the present embodiment, the projector 25 displays, for example, an image that encourages the user to fall asleep or awaken (for example, content for falling asleep, which will be described later), or displays an image that shows a sleep evaluation result when the user awakens in the morning. You may do it.

In the present embodiment, the base device 6 corrects the image projected on the ceiling by using a so-called projection mapping technique, if necessary. That is, the base device 6 corrects the image so that an image corresponding to the unevenness and / or color of the projection surface (that is, the ceiling) of the projector 25 is displayed. The image correction method may be a conventionally used method. Further, the base device 6 includes a camera 27 for correcting an image. As shown in FIG. 3, the camera 27 is provided on the base device 6 in an orientation that includes the place where the image is projected by the projector 25 in the imaging range. That is, the camera 27 is provided so as to face the same direction as the projector 25 (that is, upward).

Further, the base device 6 includes a speaker 26. The speaker 26 is used, for example, to output a sound that urges the user to fall asleep or awaken (for example, content for falling asleep, which will be described later).

The base device 6 includes a control unit 22 that controls each unit 23 to 27 of the base device 6. The control unit 22 is connected to each unit 21, 23 to 27 of the base device 6. The control unit 22 executes various control processes executed in the base device 6. The control unit 22 has a CPU and a memory. In the base device 6, the CPU uses the memory to execute the information processing program stored in the base device 6, thereby executing the various control processes. For example, the control unit 22 controls the charging operation of the mobile terminal 5 by controlling the power acquisition unit 23. Further, the control unit 22 causes the projector 25 and / or the speaker 26 to reproduce the contents and information presented to the user in the base device. Further, the control unit 22 transmits the information detected by the Doppler sensor 24 to the mobile terminal 5.

The base device 6 may have another configuration in addition to or in place of the configuration shown in FIG. For example, the base device 6 may include an environment sensor, a display, an omnidirectional speaker, a light source (eg, lighting), and / or an odor generator and the like. When the base device 6 is provided with the environment sensor, the mobile terminal 5 may not be provided with the environment sensor. Further, the mobile terminal 5 and the base device 6 may be provided with the same type of environment sensor (that is, an environment sensor that detects the same information), or may be provided with different types of environment sensors.

Next, the configuration of the server 3 will be described. The server 3 includes one or more information processing devices (that is, server devices) having a CPU and a memory. In the server 3, various information processing is executed by the CPU using the memory to execute the information processing program stored in the server 3. For example, the server 3 executes a process of storing information received from the mobile terminal 5 in a predetermined storage unit, a process of providing a network service corresponding to the information to the mobile terminal 5, and the like.

In the present specification, the term "server" refers to one information processing device (that is, a server device), and when the server is composed of a plurality of server devices, the server device group (that is, the server system). It means to refer to the whole. Further, in the present embodiment, the server 3 will be described as an integrated configuration, but the server 3 may be configured to include a plurality of server devices divided according to functions and / or roles. For example, the server 3 may be configured to include a data server that stores health information acquired from the mobile terminal 5 and a service server that provides network services based on the health information. Further, when the server 3 provides a service that provides a product or the like (“product or the like” means a service in addition to the product; the same applies hereinafter) as part of the network service, the product or the like is provided. It may be configured to include a shop server that provides and charges for the above.

[2. Information processing system operation overview]
Next, the outline of the operation in the information processing system 1 will be described. In the present embodiment, the terminal system 2 calculates the above-mentioned health information during a period during which the user is sleeping (referred to as a sleep period). First, the operation of the terminal system 2 during the sleep period will be described below.

(2-1: Operation of the terminal system during the sleep period)
FIG. 4 is a diagram showing an example of the operation flow of the terminal system during the sleep period. In the present embodiment, the base device 6 is arranged in the bedroom of the user, and more specifically, around the user (for example, at the bedside). The user attaches the mobile terminal 5 to the base device 6 when entering the floor. The terminal system 2 determines that the user has entered the floor (that is, detects the entry) when the mobile terminal 5 is attached to the base device 6 (step S1). In addition, the terminal system 2 starts measurement for calculating the health information of the user in response to the detection of entering the bed. Details will be described later, but in the present embodiment, information on the user's sleep is calculated as health information based on the detection result of the Doppler sensor 24 of the base device 6. Further, in addition to the Doppler sensor 24, the information detected by the environment sensor 14 is also acquired as the measurement result.

In this embodiment, the base device 6 has a function of charging the mobile terminal 5. It is conceivable that the user attaches the mobile terminal 5 to the base device 6 in order to charge the mobile terminal 5 when entering the floor. That is, according to the present embodiment, since the user can be motivated to attach the mobile terminal 5 to the base device 6, the possibility that the user forgets to attach the mobile terminal 5 to the base device 6 is reduced. Can be done.

When the user falls asleep after falling asleep (in other words, when entering a sleeping state), the terminal system 2 detects that the user has fallen asleep based on the measurement result (step S2). The terminal system 2 continues the measurement even after the user's sleep onset is detected, and determines the user's state during sleep based on the measurement result. Further, the operation of the mobile terminal 5 and / or the base device 6 may be controlled according to the state of the user.

When the user awakens from sleep, the terminal system 2 detects that the user has awakened based on the measurement result (step S3). When the terminal system 2 detects the awakening of the user, the terminal system 2 calculates health information based on the measurement result during sleep. Further, the terminal system 2 evaluates the calculated health information and presents the evaluation result to the user. Although the details will be described later, in the present embodiment, the evaluation result of the health information is presented as a game element (for example, as the number of remaining player objects) in the game application.

The user confirms the above evaluation result at the time of awakening, and then leaves the bed. The user removes the mobile terminal 5 from the base device 6 when getting out of bed. The terminal system 2 determines that the user has left the bed (that is, detects getting out of bed) because the mobile terminal 5 is removed from the base device 6 (step S4). The user's getting out of bed may be detected based on the above measurement result instead of (or in addition) being detected based on the detached state of the mobile terminal 5 and the base device 6. For example, the terminal system 2 may determine that the user has left the bed in response to the fact that the user no longer exists within the detection range of the Doppler sensor.

Further, when the health information is calculated after the user is awakened, the terminal system 2 ends the measurement for calculating the health information. In another embodiment, the measurement may be terminated depending on the detection that the user has left the bed.

As described above, in the present embodiment, when measuring health information, the user only needs to attach the mobile terminal 5 to the base device 6 when entering the bed and remove the mobile terminal 5 from the base device 6 when leaving the bed. As described above, in the present embodiment, the user can measure the health information by using the terminal system 2 with less effort.

(2-2: Calculation method of health information)
Hereinafter, a method of calculating health information in this embodiment will be described. In the present embodiment, the terminal system 2 calculates information on sleep and information on fatigue as health information. More specifically, the terminal system 2 calculates a sleep index and a fatigue index based on the detection result of the Doppler sensor 24. The sleep index is an index related to the user's sleep, and is, for example, an index representing a state related to sleep or the result of sleep. More specifically, the sleep index is, for example, a numerical value indicating sleep time, sleep latency, mid-wake time, sleep efficiency, and the like. The fatigue index is an index related to the user's sleep, and is, for example, an index showing the degree of fatigue of the user or the state of fatigue (for example, the type of fatigue). In the present embodiment, the fatigue index is calculated in consideration of the sleep index, and is calculated as a numerical value indicating the degree of fatigue of the user. Hereinafter, the method of calculating the health information in the present embodiment will be described in detail with reference to FIG.

FIG. 5 is a functional block diagram showing an example of a functional configuration for calculating health information in the processing unit 11 of the mobile terminal 5. As shown in FIG. 5, the processing unit 11 includes a waveform analysis unit 41, a sleep calculation unit 42, an autonomic nerve calculation unit 43, and a fatigue calculation unit 44. In this embodiment, the configuration for calculating health information (each part 41 to 44 shown in FIG. 5) is provided in the mobile terminal 5, but in other embodiments, a part of the configuration is provided. Alternatively, all of them may be provided in the base device 6.

The waveform analysis unit 41 calculates respiration, pulse, and body movement as further biometric information based on the biometric information (that is, the output waveform) detected by the Doppler sensor 24. Here, conventionally, it has been known that by separating the output waveform of the Doppler sensor 24 according to the frequency, waveforms representing respiration, pulse, and body movement can be obtained. The waveform analysis unit 41 separates the output waveform into a frequency band corresponding to breathing, a frequency band corresponding to pulse, and a frequency band corresponding to body movement by frequency analysis or the like, and outputs each separated waveform data. do. As shown in FIG. 5, the output of the waveform analysis unit 41 is input to the sleep calculation unit 42 and the autonomic nerve calculation unit 43, respectively.

The sleep calculation unit 42 calculates various sleep indexes based on biological information (in this embodiment, respiration, pulse, and body movement). Here, conventionally, a method of calculating a sleep index based on respiration, pulse, and body movement has been known. In the present embodiment, the sleep calculation unit 42 calculates a sleep index indicating the following information.
・ Time from bed onset to sleep onset latency (ie sleep latency / sleep latency)
・ Time from awakening to getting out of bed ・ Awakening time ・ Number of awakenings ・ Timing of awakening ・ Sleep efficiency ・ Total sleep time ・ Sleep activity amount ・ Sleep stage ・ REM sleep time ・ Non-REM sleep time ・ REM sleep cycle,
・ Ratio of REM sleep time to non-REM sleep time ・ Sleep quality ・ Percentage of time during which sleep is deep during the period from falling asleep to a predetermined time ・ Sleep during the period from awakening to a predetermined time Percentage of time in a shallow state-Difference between ideal sleep-onset timing and actual sleep-onset timing-Difference between ideal awakening timing and actual awakening timing In addition, the above "ideal sleep-onset timing" and "ideal awakening timing" Is calculated, for example, based on past sleep indicators for the user.

In other embodiments, only some of the above sleep indicators may be calculated, or different types of sleep indicators may be calculated. For example, the number of turns may be calculated as a sleep index. The number of times of turning over can be calculated (also referred to as guessing) based on the body movement detected by the Doppler sensor 24.

Further, the sleep index may be calculated based on the output of a sensor other than the Doppler sensor 24. For example, an index indicating the magnitude of snoring and / or an index indicating the sleeping environment may be calculated as a sleep index. The magnitude of snoring can be calculated based on, for example, the sound detected by the microphone 15. Further, as an index indicating the sleeping environment, for example, temperature, humidity, illuminance, atmospheric pressure and the like may be calculated based on the output of the environment sensor 14. Further, the sleep index may be calculated based on the detection result of the camera 16. For example, it is possible to calculate biological information such as pulse and / or body movement based on the user's image captured by the camera 16. Therefore, the sleep calculation unit 42 uses the biometric information obtained from the image captured by the camera 16 in addition to (or instead of) these biometric information obtained from the detection result of the Doppler sensor 24 to obtain the sleep index (and fatigue index). May be calculated.

The autonomic nerve calculation unit 43 calculates an index (referred to as an autonomic nerve index) indicating the degree of action of the autonomic nerve (specifically, the sympathetic nerve and the parasympathetic nerve) based on the biological information. Specifically, the waveform of the pulse (specifically, the RR interval) included in the biological information is frequency-analyzed by the maximum entropy method and the Fourier transform, and the high-frequency component of the waveform (about 0.15 to 0.40 [. Hz]) HF and low frequency component (about 0.04 to 0.15 [Hz]) LF are calculated. Here, the high-frequency component HF is known to indicate the degree of action of the parasympathetic nerve, and the low-frequency component LF is known to indicate the degree of action of the sympathetic nerve. Further, it is known that the degree of fatigue can be evaluated by the ratio of the degree of action of the parasympathetic nerve to the degree of action of the sympathetic nerve (see, for example, Japanese Patent Application Laid-Open No. 2010-201113). Therefore, the autonomic nerve calculation unit 43 calculates the ratio (LF / HF) of the high frequency component HF and the low frequency component LF as the autonomic nerve index. As shown in FIG. 5, the output of the autonomic nerve calculation unit 43 is used as an input in the fatigue calculation unit 44.

The fatigue calculation unit 44 calculates the degree of fatigue based on the sleep index and the autonomic nerve index. In the present embodiment, as a fatigue index, a fatigue degree indicating the degree of fatigue (level) as a numerical value from 0 to 100 is calculated. The method of calculating the fatigue index is arbitrary, but for example, the following method can be considered.

The first method is a method of calculating the degree of fatigue from the sleep index. Here, the sleep index is considered to have a correlation with the degree of fatigue. For example, the following can be mentioned as an example in which the degree of fatigue is presumed to be high.
・ Sleep latency is long.
・ Awakening time is long.
・ The number of awakenings is high.
・ Sleep efficiency is poor.
・ The total sleep time is short.
-The balance between REM sleep time and non-REM sleep time is poor (for example, the ratio of REM sleep time to non-REM sleep time is out of the normal range).
Therefore, the fatigue calculation unit 44 calculates the degree of fatigue so that the degree of fatigue is high if the sleep index corresponds to the above example, and the degree of fatigue is low if the sleep index does not correspond to the above example. For example, the fatigue calculation unit 44 may determine whether or not each of the above items is applicable, calculate points according to the corresponding number, and calculate the fatigue degree according to the total points. At this time, the fatigue calculation unit 44 may calculate points by weighting each item. In addition, a reference value (for example, "6 hours" for the total sleep time) is set for each item, and the points are calculated so that the points become larger as the calculated sleep index value is farther from the reference value. May be good.

As described above, in the present embodiment, the sleep index related to the user's sleep is calculated based on the biological information, and the fatigue level is calculated based on the sleep index. As described above, since it is considered that there is a correlation between the sleep index and the degree of fatigue, the accuracy of the degree of fatigue can be improved by calculating the degree of fatigue based on the sleep index.

The second method is a method of calculating the degree of fatigue based on the autonomic nerve index. As described above, it is known that the balance of the degree of action between the sympathetic nerve and the parasympathetic nerve, that is, the degree of fatigue can be evaluated using the above-mentioned autonomic nerve index. Therefore, the fatigue calculation unit 44 calculates, for example, the degree of fatigue so that the degree of fatigue increases as the value of the autonomic nerve index deviates from the reference value.

In the present embodiment, the fatigue calculation unit 44 calculates the degree of fatigue using the first and second methods described above. Specifically, the fatigue calculation unit 44 calculates the degree of fatigue by each of the above two methods, and calculates the final degree of fatigue based on each calculated degree of fatigue. The fatigue calculation unit 44 may, for example, use the average value of the two fatigue levels as the final fatigue level, or weight one of the two fatigue levels to calculate the final fatigue level. good.

Further, in another embodiment, the degree of fatigue may be calculated by using the following method in addition to the above two methods. That is, a method of calculating the degree of fatigue based on the sleep time in a predetermined period (for example, one week) may be used. Here, conventionally, in a fatigue risk management system (FRMS (Fatigue Risk Management System)), there is a method of calculating the degree of fatigue based on sleep time and working time. In the above method, for example, by simply keeping the working hours constant, the degree of fatigue can be calculated based on the sleep time (only).

The method of calculating the fatigue index is arbitrary, and the content of the fatigue index is also arbitrary. In other embodiments, as a fatigue index, a value indicating the degree of fatigue may be calculated for each type of fatigue. For example, in other embodiments, the fatigue index may be three types of values: a value indicating the degree of acute fatigue, a value indicating the degree of cumulative fatigue, and a value indicating the degree of mental fatigue.

In the present embodiment, the fatigue calculation unit 44 calculates the degree of energy based on the degree of fatigue calculated as described above. The degree of energy is a numerical value calculated for the purpose of presenting the user's health condition (in this embodiment, the sleep condition and the degree of fatigue) in an easy-to-understand manner for the user, and the larger the numerical value, the better the condition (in other words, the degree of fatigue). For example, the degree of fatigue is small). The method of calculating the degree of energy is arbitrary. For example, the degree of energy may be calculated by subtracting the degree of fatigue from 100.

In the present embodiment, the above-mentioned energy level is presented to the user as the evaluation result of the health information. In another embodiment, the above-mentioned fatigue degree may be presented to the user as an evaluation result, and the good sleep degree (numerical value indicating the degree of good sleep) calculated from the above sleep index may be presented to the user. May be presented. These energy levels, fatigue levels, and good sleep levels can be referred to as health information or evaluation results of health information. That is, the health information may be a second type of health information indicating an evaluation result for the first type of health information (for example, a sleep index).

As described above, in the present embodiment, the terminal system 2 calculates the sleep index, the fatigue index (that is, the degree of fatigue), and the degree of energy as health information. A part or all of these health information is transmitted from the terminal system 2 to the server 3 and stored in the server 3 for each user. Further, the mobile terminal 5 stores the calculated health information in its own storage unit.

(2-3: Game processing)
Next, the game processing executed by the terminal system 2 (specifically, the mobile terminal 5) will be described. As described above, in the present embodiment, the user can measure the health information by a simple operation. However, if the user does not confirm the evaluation result of the measured health information (may be advice information or recommendation information based on the evaluation result), the meaning of measuring the health information becomes small, and the user It does not lead to improvement of health. For example, for a user who has little interest in health, simply presenting the evaluation result does not seem to be very interesting, so that the interest in the evaluation result or the like may gradually diminish. As a result, the user may not confirm the evaluation result or the like, or may neglect the measurement itself.

Therefore, in the present embodiment, the terminal system 2 executes a game process in order to give the user motivation for actions such as measurement of health information and confirmation of evaluation results and the like. That is, the terminal system 2 executes the game processing based on the evaluation result, and presents the game result according to the evaluation result to the user. Further, in the present embodiment, the game progresses according to the evaluation result, or the game progresses according to the user's behavior regarding the measurement (for example, awakening, getting out of bed, getting into bed, etc.). As described above, in the present embodiment, the terminal system 2 enables the user to measure the health information as if playing a game. As a result, the user can be motivated to continuously perform the above actions, and the health improvement effect is improved by the user continuously performing the above actions. Hereinafter, an example of the game processing in the present embodiment will be described with reference to FIGS. 6 to 14.

FIG. 6 is a diagram showing an example of the flow of game processing in the present embodiment. In the present embodiment, as described above, the measurement for calculating the health information of the user is performed during the sleep of the user, and the game process is mainly executed during the awakening of the user. FIG. 6 shows the flow of game processing executed from when the user awakens to when he / she falls asleep.

(Processing when the user awakens)
When the mobile terminal 5 detects the awakening of the user, the mobile terminal 5 displays the evaluation result of the health information and the advice based on the evaluation result (step S11). As described above, since the evaluation result of the health information is calculated according to the awakening of the user, the mobile terminal 5 displays the information indicating the calculated evaluation result on the display 17. Further, the mobile terminal 5 displays information indicating advice generated based on the evaluation result on the display 17.

FIG. 7 is a diagram showing an example of a game image (referred to as an awakening game image) displayed on the mobile terminal when the user is awake. In the awakening game image shown in FIG. 7, the player object 51, the evaluation result information 52, and the advice information 53 are displayed.

The player object 51 is a game character that operates in response to an input by a user (also referred to as a player) (in the present embodiment, health information is input). As shown in FIG. 7, when the user is awakened, an image showing how the player object 51 is awakened is displayed on the display 17.

The evaluation result information 52 shows the evaluation result of the health information calculated based on the biological information measured during the sleep period. As described above, in the present embodiment, the energy level (in other words, the numerical value representing the energy level) is calculated as the evaluation result. Here, in the present embodiment, the evaluation result is presented to the user as a game element. That is, as shown in FIG. 7, a numerical value indicating the degree of energy (“80” in FIG. 7) is displayed as the number of remaining machines of the player object 51. The evaluation result may be displayed as an arbitrary game element. For example, in other embodiments, as the number and type of items, money, player object parameters (for example, strength, etc.), etc. in the game. The evaluation result may be presented.

The advice information 53 indicates advice to the user regarding the evaluation result of the health information. The advice information 53 is generated based on the health information. The method of generating the advice information 53 is arbitrary, but for example, the mobile terminal 5 stores in advance a table in which the conditions related to the health information and the content of the advice to be presented are associated with each other, and uses the table to provide advice. Identify the content. That is, when the health information satisfies any of the conditions included in the table, the mobile terminal 5 generates and displays the advice information indicating the content of the advice associated with the satisfied conditions.

As described above, the awakening game image is displayed according to the user's awakening. As described above, in the present embodiment, the determination that the user has awakened is performed using the sleep index calculated based on the detection result of the Doppler sensor 24. When the mobile terminal 5 has an alarm clock function, the determination that the user has awakened may be made by stopping the alarm clock by the user. That is, the mobile terminal 5 may notify the user to awaken by sound and / or light at the set alarm time. At this time, the mobile terminal 5 may determine that the user has awakened in response to the operation of stopping the notification. The alarm time may be set manually by the user or may be set based on the sleep index. Further, in another embodiment, the mobile terminal 5 may display the awakening game image at the timing of the alarm time instead of the timing when the user awakens.

The awakening game image is displayed for a predetermined time. After that, the mobile terminal 5 simply displays the calculated health information (step S12). That is, the mobile terminal 5 displays a part of the health information calculated based on the biological information measured during the sleep period. The switching from the awakening game image in step S11 to the image in step S12 (that is, the simple display image described later) is automatically switched by the mobile terminal 5 when the predetermined conditions are satisfied as described above. It may be performed at the user's instruction, or it may be performed according to the user's instruction. For example, the mobile terminal 5 may display a simple display image according to a predetermined operation performed by the user while displaying the game image at the time of awakening.

FIG. 8 is a diagram showing an example of a game image (referred to as a simple display image) displayed when performing simple display of health information. In the simple display image shown in FIG. 8, the simple information 54 is displayed. Further, in the simple display image as well, the player object 51 and the advice information 53 are displayed as in the awakening game image (see FIG. 7).

The simple information 54 indicates a part of the calculated health information. In the present embodiment, the sleep time, which is an example of the sleep index, is displayed by the simple information 54. The content indicated by the simple information 54 is arbitrary. However, since the simple information 54 is presented immediately after the user wakes up, in the present embodiment, information that is easy for the user to understand is displayed as the simple information 54. That is, since a specific index related to sleep called sleep time is shown, the measurement result of sleep is presented in a form that is easy for the user to understand. In another embodiment, the mobile terminal 5 may display the above-mentioned degree of good sleep and / or an index indicating sleep quality as simple information 54 instead of the sleep time (or both the sleep time). good.

As described above, in the present embodiment, in response to the detection of the user's awakening, a part of the calculated health information is presented to the user as a game element (step S11), and the part is Different health information (which may be the same information in other embodiments) is presented to the user as an indicator of health (in this embodiment, as a sleep indicator) (step S12). According to this, it is possible to attract the interest of the user by giving the presentation of the health information a game, and it is possible to present the health information (that is, the sleep index) in a form that is easy for the user to understand. Further, in the present embodiment, information indicating the evaluation result of the health information is presented to the user as a game element, and at least a part of the health that is the basis of the evaluation result (that is, used for calculating the evaluation result). Is presented to the user as an indicator of health. Therefore, the evaluation result can be presented in a form that attracts the user's interest, and more detailed information that is the basis of the evaluation result can be presented in a form that is easy for the user to understand. The presentation of the evaluation result as a game element and the presentation of the health information as a health index may be presented at the same time, or may be presented at different timings (as in the present embodiment).

In the present embodiment, the advice information 53 included in the simple display image is the same as the advice information 53 included in the awakening game image, but in other embodiments, it is included in these two types of images. The advice information may be different from each other.

The simple display is displayed only for a predetermined time. After that, the mobile terminal 5 displays the standby image (in other words, the menu image) (step S13). That is, the mobile terminal 5 displays the standby image including the menu image on the display 17. The switching from the simple display image in step S12 to the standby image in step S13 may be automatically performed by the mobile terminal 5 according to the satisfaction of the predetermined conditions as described above, or may be performed by the user. It may be done by instruction. Further, in another embodiment, the standby image may be displayed from the awakening game image (without displaying the simple display image). Further, the mobile terminal 5 may switch the awakening game image, the simple display image, and the standby image according to the user's instruction.

FIG. 9 is a diagram showing an example of a standby image. In the standby image shown in FIG. 9, the menu image 55 is displayed. Further, in the standby image, the player object 51 is displayed as in the awakening game image (FIG. 7) and the simple display image (FIG. 8).

The menu image 55 represents an instruction that can be given by the user while the standby image is displayed. In the present embodiment, the menu image 55 includes a detail display button 56 and a mini game button 57. The detail display button 56 is an image representing a button for giving an instruction to display the details of the calculated health information. The mini-game button 57 is an image representing a button for giving an instruction to start a mini-game (also referred to as an alarm clock game). By inputting to these buttons (for example, touch input), the user can cause the mobile terminal 5 to display the detailed health information and execute the mini game.

When the input to the detailed display button 56 is performed in the state where the standby image is displayed (step S13), the mobile terminal 5 displays the detailed health information (step S14). That is, the mobile terminal 5 displays a detailed display image showing more detailed information than the simple display of the health information on the display 17. In the present embodiment, for example, an image described below is displayed as a detailed display image.

FIG. 10 is a diagram showing an example of a detailed display image. The detailed display image shown in FIG. 10 represents detailed information about sleep last night. That is, the detailed display image shown in FIG. 10 represents the details of the health information based on the biometric information measured during the previous sleep period (typically, the period from yesterday evening to this morning). Specifically, in FIG. 10, a graph 58 is displayed in which the horizontal axis represents the time and the vertical axis represents the depth of sleep. The graph 58 allows the user to know in detail the change in sleep depth during the previous sleep period.

Further, in the detailed display image, in addition to the graph 58, explanations are given to characteristic parts in the graph 58. For example, as shown in FIG. 10, an image showing an explanation such as "I am awake" is attached to a portion showing halfway awakening in the graph 58. In this way, the mobile terminal 5 may detect a feature portion from the sleep period (also referred to as a measurement period) based on the sleep index, and add an explanatory image to the detected feature portion. The characteristic portion may be, for example, a portion of awakening in the middle, or a location where a light sleep period continues for a predetermined time or longer. Further, the mobile terminal 5 stores a table in which the feature portion and the description are associated with each other, and displays an explanatory image showing the explanation associated with the detected feature portion in association with the feature portion on the graph 58.

In another embodiment, the explanatory image may represent an explanation in consideration of the environment sensor information detected by the environment sensor 14. The environment sensor 14 detects, for example, temperature, humidity, and / or ambient sound as environment sensor information. For example, when the featured portion is detected, the mobile terminal 5 may acquire the environment sensor information detected at the time point (or period) corresponding to the featured portion and generate an explanation based on the environment sensor information. .. For example, the mobile terminal 5 acquires the temperature and generates and displays an explanation such as "I am awake at about 2 o'clock. It may be because the temperature in the room was low." May be good. Also, for example, the mobile terminal 5 may acquire the surrounding sound and generate and display an explanation such as "I am awake at about 2 o'clock. It may be caused by a loud noise." good.

FIG. 11 is a diagram showing another example of the detailed display image. The detailed display image shown in FIG. 11 is an example of an image showing detailed information regarding sleep in the last week. In FIG. 11, a bar graph 61 showing the change in the degree of good sleep of the user in the last week is displayed. The horizontal axis of the graph 61 represents the date, and the vertical axis represents the degree of good sleep. The degree of good sleep is an index indicating the degree of good sleep, and is calculated based on the sleep index. The degree of good sleep is, for example, a numerical value from 0 to 100, and is calculated so that the higher the quality of sleep (in other words, the better the evaluation of the quality of sleep), the larger the value. The graph 61 allows the user to know in detail the change in the degree of good sleep during one week.

Further, the detailed display image shown in FIG. 11 includes a graph 62 based on the good sleep degree of another user in addition to the graph 61 of the good sleep degree of the user himself / herself. Graph 62 represents the average sleepiness of a plurality of other users. From the graphs 61 and 62, the user can know the change in the degree of sleep of himself / herself, the degree of sleep of other users (average), and the difference between the degree of sleep of himself / herself and the degree of sleep of other users. Can be known.

The degree of good sleep of other users is stored in the server 3. In addition, the server 3 calculates and stores the average value of the stored good sleep of other users (for example, the average value for each day). The mobile terminal 5 receives the average value of the degree of good sleep in a desired period (the last week in the example shown in FIG. 11) from the server 3 at an arbitrary timing, and creates a graph 62 based on the received information. indicate. The user for which the average value is calculated may be all the users registered in the network service, or may be a user who satisfies a predetermined selection criterion. The selection criteria may be, for example, criteria regarding personal information such as region (for example, country), age, gender, occupation, and the like.

In the present embodiment, detailed display images as shown in FIGS. 10 and 11 are displayed. The mobile terminal 5 may display an image designated by the user from among a plurality of types of detailed display images. Further, the detailed display image may have any content including information that is not displayed in the simple display (step S12) described above. For example, the detailed display image may display the average value of the degree of good sleep during a predetermined period (for example, one week or January) of the user, in addition to the detailed display images shown in FIGS. 10 and 11. Further, for example, the detailed display image may represent a comparison between the current user's degree of good sleep and the user's past degree of good sleep. For example, instead of the graph 62 shown in FIG. 11, a graph showing the past good sleep degree of the user (for example, the good sleep degree of the user one month ago) may be displayed.

Further, the detailed display image may represent information other than the degree of good sleep, and may, for example, represent a sleep index other than the degree of good sleep, a fatigue index, and / or a degree of energy. Further, the mobile terminal 5 may generate and display a detailed display image of the information specified by the user among the health information.

In the state where the detailed display image is displayed, the mobile terminal 5 switches the display to the standby image in response to the predetermined end instruction given by the user (step S13). The predetermined end instruction is given, for example, by inputting to the menu button 59 (FIGS. 10 and 11) displayed in the detailed display image.

Further, when the input to the mini game button 57 is performed in the state where the standby image is displayed (step S13), the mobile terminal 5 starts the mini game (step S15). The mini-game is a game different from a game in which health information (specifically, energy level) is input, and allows the user to perform simple game operations, calculations, and the like. The content of the mini-game is arbitrary, and the mini-game may be, for example, a puzzle game, a quiz game, or a game in which the user performs calculations. By letting the user play such a mini game, the effect of awakening the user can be expected.

Further, in the present embodiment, the mobile terminal 5 corrects the energy level (specifically, the energy level calculated based on the biological information measured during the sleep period) based on the result of the mini game. For example, if the result of the mini game is bad, the mobile terminal 5 determines that the awakening is bad and decreases the energy level, and if the result of the mini game is good, it determines that the awakening is good and increases the energy level. You may do so. As described above, in the present embodiment, the energy level is calculated based on the result of the mini game. In addition, the result of the mini game is reflected in the game processing. The mobile terminal 5 transmits information indicating the corrected energy level to the server 3. The server 3 stores the received information indicating the corrected energy level.

Further, in another embodiment, the mobile terminal 5 may use the result of the mini-game as an input for the game processing instead of (or both) correcting the energy level based on the result of the mini-game. good. For example, the mobile terminal 5 may give an item to the user (in other words, a player object) according to the result of the mini game, and execute the game process based on the above-mentioned energy level and the given item. good. Also by this, the result of the mini game can be reflected in the game processing as in the present embodiment.

Further, the mobile terminal 5 may ask a question to the user instead of executing the mini game or at the same time as executing the mini game (in other words, during the mini game). That is, the mobile terminal 5 asks the user a question about the state of sleep and / or fatigue, and causes the user to input an answer. For example, the mobile terminal 5 asks questions such as whether the user is feeling tired, is awake, or is drowsy, and is asked to answer based on the user's subjectivity. At this time, the above answer may be used as a mini-game result. Thereby, the terminal system 2 can acquire the user's subjective evaluation regarding sleep and / or fatigue, and can calculate the health information by reflecting the subjective evaluation.

As described above, in the present embodiment, the user can be awakened by playing the mini-game when the user is awake, and the health information is calculated based on the result of the mini-game (more specifically, By making corrections), it is possible to calculate health information that reflects the state of the user after waking up.

In another embodiment, the mobile terminal 5 may determine whether or not to prompt the user to execute the mini game according to the health information based on the biometric information measured during the sleep period. For example, the mobile terminal 5 determines whether the user's awakening is good or bad based on the above health information. Specifically, the mobile terminal 5 determines that the awakening is poor when the user awakens from the non-REM sleep state, and determines that the awakening is good when the user awakens from the REM sleep state. May be good. Then, when it is determined that the user's awakening is poor, the mobile terminal 5 may prompt the user to execute the mini game. In the above case, for example, in the above standby image, the mobile terminal 5 may display a message such as "It seems that you are not awake today. Let's wake up by playing a mini game." On the other hand, when it is determined that the user's awakening is good, the mobile terminal 5 may not prompt the user to execute the mini game.

When the mini-game ends, or when the user gives an instruction to end the mini-game, the mobile terminal 5 switches the display to the standby image (step S13).

(Processing after the user leaves the bed)
As shown in FIG. 6, when the mobile terminal 5 detects that the user has left the bed, the mobile terminal 5 ends the display of the standby image and displays the game image when the user leaves the bed (step S16). FIG. 12 is a diagram showing an example of a game image at the time of getting out of bed displayed on the mobile terminal when the user gets out of bed. In the game image at the time of getting out of bed shown in FIG. 12, the player object 51 and the information at the time of getting out of bed 64 are displayed. As shown in FIG. 12, when the user leaves the bed, an image showing how the player object 51 departs for an adventure is displayed on the display 17.

Further, as shown in FIG. 12, the information 64 at the time of getting out of bed indicates the evaluation result (specifically, the degree of energy) at the present time (that is, at the time of getting out of bed). Here, the energy level calculated when the user is awake may be corrected by the result of the above-mentioned mini game. In this case, the information 64 at the time of getting out of bed indicates the number of remaining aircraft corresponding to the corrected energy level. The information 64 at the time of getting out of bed can notify the user of the corrected energy level. If the energy level calculated when the user is awake is not corrected, the information 64 at the time of getting out of bed indicates the same number of remaining aircraft as the energy level. The game image at the time of getting out of bed may include advice information regarding the current evaluation result.

The game image at the time of getting out of bed is displayed for a predetermined time. After that, the mobile terminal 5 displays the standby image (step S17). That is, the mobile terminal 5 displays the same standby image as in step S13 on the display 17. The switching from the game image at the time of getting out of bed in step S16 to the standby image in step S17 may be automatically performed by the mobile terminal 5 in response to the above-mentioned predetermined conditions being satisfied. It may be done according to the instruction of the user.

The standby image in step S17 includes a menu image 55 similar to the standby image in step S13. Further, the standby image in step S17 includes an image showing the state of the player object 51 during the adventure. For example, an image showing how the player object 51 is fighting an enemy or how the player object 51 is advancing through the dungeon is displayed.

When the standby image is displayed in step S17, as in the case of step S13, the mobile terminal 5 accepts the detailed display of health information and the input for executing the mini game. That is, when the input to the detailed display button 56 is performed, the mobile terminal 5 displays the detailed health information (step S18). The process of step S18 is the same as the process of step S14. Further, when the input to the mini game button 57 is performed, the mobile terminal 5 starts the mini game (step S19). The process of step S19 is the same as the process of step S15.

As described above, in the present embodiment, the standby image is displayed even after the user leaves the bed, and the user can perform detailed display or play a mini game. Therefore, the user can perform the detailed display and the mini game even when the mobile terminal 5 is removed from the base device 6.

Here, as described above, the mini-game is played for one purpose of determining the awakening state of the user. Therefore, if the mini-game is executed after the user is sufficiently awake and the result of the mini-game is reflected in the energy level, the state of the user's awakening may not be correctly reflected in the energy level.

Therefore, in the present embodiment, the mobile terminal 5 enables the mini-game to be executed from the time when the user leaves the bed (or awakens) until a predetermined time elapses. That is, the mobile terminal 5 prevents the mini-game button 57 from being displayed in the standby image after a predetermined time has elapsed from the user getting out of bed (or awakening), and prevents the user from executing the mini-game. According to this, it is possible to reduce the possibility that the mini-game is executed after the user is sufficiently awake and the result of the mini-game is reflected in the energy level. In another embodiment, the mobile terminal 5 reflects the result of the mini-game in the energy level from the time when the user leaves the bed (or awakens) until the predetermined time elapses, and after the elapse of the predetermined time, the result of the mini game is reflected in the energy level. , The result of the mini game may not be reflected in the energy level (however, the result of the mini game may be reflected in the game processing). At this time, the mini-game may be executable even after the predetermined time has elapsed. This also makes it possible to obtain the same effect as described above.

Further, in the above embodiment, the terminal system 2 detects that the user has left the bed in response to the mobile terminal 5 being removed from the base device. Here, the method of detecting that the user has left the bed is arbitrary, and is not limited to the above method. For example, in another embodiment, the terminal system 2 may detect that the user has left the bed in response to the user moving out of the detection range of the Doppler sensor of the base device 6. At this time, it is assumed that the mobile terminal 5 and the base device 6 can wirelessly communicate with each other, and the base device 6 wirelessly notifies the mobile terminal 5 that the user has detected that he / she has left the bed. According to the above, the mobile terminal 5 can execute the processes of steps S11 to S15 in a state where the mobile terminal 5 is removed from the base device 6. In this case, after the user's getting out of bed is detected, the mobile terminal 5 may not execute the mini-game or may not reflect the result of the mini-game in the energy level.

Further, in another embodiment, the mobile terminal 5 may detect that the user has gone out and execute the process of step S16 in response to the user going out. The user's outing can be detected based on the detection result by the position detection unit 13. For example, the position of the user's home is registered in advance in the mobile terminal 5, and the mobile terminal 5 is used when the position of the mobile terminal 5 detected by the position detection unit 13 is separated from the home position by a predetermined distance or more. May be determined to have gone out.

(Processing during the day)
After the user leaves the bed, the mobile terminal 5 calculates various information for correcting the health information (specifically, the degree of energy) at an appropriate timing (step S20). In the present embodiment, various calculated information is transmitted to the server 3, and the server 3 corrects the energy level. Although it is shown in FIG. 6 that the process of step S20 is executed after the process of step S17, the timing of executing the process of step S20 may be before step S17. ..

The information calculated in the process of step S20 is calculated based on the information acquired during the user's awakening period. In the following, the information calculated in the process of step S20 will be referred to as awakening information. In the present embodiment, the mobile terminal 5 calculates activity information, environmental information, and emotional information as awakening information.

The activity information is calculated based on the position information detected by the position detection unit 13. Specifically, the mobile terminal 5 calculates activity information indicating the distance, time, and / or movement method (for example, walking, train, automobile, etc.) traveled by the user based on the above-mentioned position information. Further, the mobile terminal 5 specifies the place visited by the user based on the above-mentioned location information, and calculates the activity information from the specified information. For example, when it is specified that the user has gone to the workplace, activity information indicating that the user has done the work is calculated. Further, for example, when it is specified that the user has gone to a massage shop, activity information indicating that the user has received a massage is calculated.

The environmental information is calculated based on the environment sensor information detected by the environment sensor 14. Specifically, the mobile terminal 5 acquires temperature (that is, air temperature) information as environment sensor information, and calculates environmental information indicating the user's environment from the acquired information. For example, the mobile terminal 5 acquires temperature information during a period in which the user is performing a predetermined activity, and calculates environmental information indicating the average temperature during the period. The period can be specified based on the location information and / or the activity information. For example, as environmental information, it is possible to calculate information indicating the average temperature during the user's travel period and information indicating the average temperature during the user's activity (for example, at work).

The emotional information is calculated based on the image captured by the camera 16 and / or the voice detected by the microphone 15. Specifically, the mobile terminal 5 captures the user's face with the camera 16, discriminates the user's facial expression from the image of the captured face, and calculates emotion information indicating the user's emotion from the facial expression. The specific content of the emotional information is arbitrary. For example, the emotional information may indicate one of four types of emotions, emotions, and emotions, or may indicate the degree (also referred to as weight) of each of the four types of emotions. , It may simply indicate whether it is a positive emotion or a negative emotion.

Further, the mobile terminal 5 acquires the user's voice by the microphone 15 and calculates emotion information indicating the user's emotion from the acquired user's voice. The method for discriminating emotions based on the user's voice may be any method, and a conventional emotion discriminating method may be used. For example, the mobile terminal 5 calculates a feature amount (for example, intensity, tempo, intonation, etc.) for each predetermined unit interval for the acquired audio signal, and based on the calculated feature amount, expresses emotions. Calculate the indicated index. Further, the mobile terminal 5 stores a table showing a change pattern of each feature amount for each type of emotion (for example, anger, joy, and sadness). This change pattern may be created experimentally (that is, based on the result of actually detecting voices from a plurality of subjects and calculating the feature amount). For each emotion type, the mobile terminal 5 compares the change pattern shown by the table with the calculated change in the feature amount, and identifies the user's emotion based on the comparison result. As a result, emotional information indicating the specified emotion is generated.

The awakening information calculated as described above is transmitted to the server 3 by the mobile terminal 5. The timing at which the awakening information is transmitted is arbitrary, and when a plurality of types of awakening information are calculated, the mobile terminal 5 may transmit the awakening information at different timings. Further, the condition for calculating the awakening information is arbitrary, and in some cases (if the condition is not satisfied), the awakening information may not be calculated.

The server 3 corrects the energy level based on the received awakening information. The energy level to be corrected in the present embodiment is the energy level calculated at the time of awakening of the user or the energy level corrected based on the result of the mini game. The server 3 uses the awakening information to correct the energy level, for example, as follows.

For example, if the received activity information indicates that the user has traveled on foot for a long time, the user's fatigue is considered to increase. Therefore, in this case, the server 3 corrects so as to reduce the energy level. Also, for example, if the received activity information indicates that the user has gone to a massage, the user's fatigue is considered to be reduced. Therefore, in this case, the server 3 corrects so as to increase the energy level. The degree of increasing or decreasing the energy level may be changed according to the movement distance (or movement time), the movement method, and / or the activity content indicated by the activity information.

Also, if the received environmental information indicates that it is not comfortable for the user (for example, if the temperature on the move is too hot), the user's fatigue is considered to increase. Therefore, in this case, the server 3 corrects so as to reduce the energy level.

In addition, when the received emotional information shows positive emotions (for example, joy or enjoyment), the user's fatigue is considered to be reduced. Therefore, in this case, the server 3 corrects so as to increase the energy level. In addition, when the received emotional information shows negative emotions (for example, anger or sadness), the user's fatigue is considered to increase. Therefore, in this case, the server 3 corrects so as to reduce the energy level.

As described above, the server 3 corrects the energy level based on the awakening information (in the present embodiment, the activity information, the environmental information, and the emotional information) acquired during the awakening of the user. This makes it possible to calculate the degree of energy by reflecting the user's behavior, situation, and state during awakening. In the present embodiment, the energy level corrected as described above is notified to the user as the energy level for one day. That is, the server 3 transmits the corrected energy level to the mobile terminal 5 at a predetermined timing. The predetermined timing is arbitrary, but in the present embodiment, it is the timing according to the user entering the floor (details will be described later). Further, in the present embodiment, since the game processing is executed based on the corrected energy level, the awakening information is reflected in the game processing.

In another embodiment, the energy level correction process based on the awakening information may be executed by the mobile terminal 5. At this time, the mobile terminal 5 may transmit information indicating the corrected energy level (and the above-mentioned awakening information) to the server 3, and the server 3 may store the received information in the storage unit.

After the user leaves the bed, the mobile terminal 5 is in a standby state (for example, a state in which the display 17 of the mobile terminal 5 is turned off), or an image by another application different from the game application is displayed on the display 17. It may be displayed. In these states, the game image is not displayed on the display 17. However, in these states, the mobile terminal 5 displays the standby image in step S17 in response to a predetermined instruction input for displaying the game image. At this time, the mobile terminal 5 receives the energy level at that time (if the energy level is corrected, the corrected energy level) from the server 3, and determines the number of remaining units corresponding to the received energy level. It may be displayed. In this way, the mobile terminal 5 may display the corrected energy level information according to the user's instruction after the user leaves the bed. According to this, it is possible to present the current degree of energy to the user.

(Processing when the user enters the floor)
As shown in FIG. 6, when the mobile terminal 5 detects that the user has entered the floor, the mobile terminal 5 displays a game image at the time of entering the floor (step S21). FIG. 13 is a diagram showing an example of a game image at the time of bedtime displayed on the mobile terminal when the user enters the bed. In the game image at the time of entering the bed shown in FIG. 13, the player object 51 and the information 64 at the time of getting out of the bed are displayed. As shown in FIG. 13, when the user leaves the bed, an image showing how the player object 51 has returned from the adventure is displayed on the display 17.

The game image at the time of entering the floor is displayed for a predetermined time. After that, the mobile terminal 5 displays a game image (referred to as a replay game image) representing the replay of the adventure of the day (step S22). The switching from the game image at the time of entering the floor in step S21 to the replay game image in step S22 may be automatically performed by the mobile terminal 5 when the predetermined conditions are satisfied as described above. , May be done according to the user's instructions.

In step S22, the mobile terminal 5 first requests the server 3 to transmit the game result information indicating the game result. In response to this request, the server 3 transmits the game result information to the mobile terminal 5. This game result information includes the above-mentioned energy level (that is, corrected energy level) information. Further, although the details will be described later, in the present embodiment, a privilege may be given to the user depending on the game result. Therefore, the game result information includes information regarding the privilege given to the user.

When the game result information is received from the server 3, the mobile terminal 5 generates a replay game image based on the game result information and displays it on the display 17. FIG. 14 is a diagram showing an example of a replay game image. As shown in FIG. 14, in the replay game image, the replay of the adventure by the player object 51 performed during the daytime (in other words, during the awakening of the user) is displayed. For example, as shown in FIG. 14, a state in which the player object 51 fights against the enemy character 65 is displayed. The image displayed as the replay game image (in the present embodiment, the moving image) may be the same as or different from the image showing the state during the adventure displayed as the standby image in step S17. You may.

Further, as shown in FIG. 14, in the replay game image, the game result information 66 indicating the game result is displayed. In the present embodiment, the game result information 66 indicates the amount of damage given to the enemy character 65 as the game result. The amount of damage is calculated based on the degree of energy indicated by the game result information. The game result is calculated so that the higher the energy level, the better the result. In other words, the better the user's health information indicates the better condition, the better the game result will be obtained.

Further, in the present embodiment, the damage amount is calculated by the same calculation method as the number of remaining machines in the awakening game image. In other words, the amount of damage is the same as the number of remaining aircraft as a numerical value indicating the degree of energy, although the way of expressing it as a game element is different from the number of remaining aircraft. For example, if the energy level at the time of awakening of the user is 80, the number of remaining aircraft is 80, and if the energy level at the time of entering the bed is 80, the amount of damage is also 80. In this way, by presenting a value indicating the same index as health information (specifically, energy level) at the time of awakening and at the time of entering the bed, it is possible for the user to present the change in the health information during the awakening period in an easy-to-understand manner. Can be done. For example, if the number of remaining aircraft at the time of awakening is 80 and the amount of damage at the time of entering the bed is 70, the user recognizes that the energy level has decreased (that is, the fatigue has increased) during the awakening period. Can be done.

In another embodiment, the game result information may include information indicating a correction value of the energy level based on the awakening information. At this time, the mobile terminal 5 may display a game element representing a correction value of the energy level. For example, the mobile terminal 5 may display the amount of damage corresponding to the degree of energy at the time of awakening and the amount of damage corresponding to the above-mentioned correction value as game result information 66, respectively.

Further, in other embodiments, the degree of energy based on the information acquired during the sleep period (for example, biological information obtained by the Doppler sensor 24) and the energy level based on the information acquired during the awakening period (for example, information during awakening). The degree may be calculated separately. At this time, the mobile terminal 5 may display these two types of energy levels as separate game elements.

Further, the mobile terminal 5 may display a replay game image showing how the player object 51 performs an operation according to the awakening information (in other words, according to the correction value corresponding to the awakening information). For example, when activity information indicating that the user has moved a long distance on foot is acquired, an image showing how the player object 51 moves a long distance may be displayed, and the number of remaining machines may be displayed. An indication that the decrease may be made. Further, for example, when environmental information indicating that the user was in a hot environment is acquired, an image showing how the player object 51 moves in a hot place may be displayed, and the number of remaining machines has decreased. A display indicating that may be made. Further, for example, when emotional information indicating positive emotions is acquired, the facial expression of the player object 51 during the adventure may become a smile, and a display indicating that the number of remaining aircraft has increased may be displayed. ..

Further, in another embodiment, the mobile terminal 5 is a replay indicating that the player object 51 is given an item corresponding to the awakening information (in other words, according to the correction value corresponding to the awakening information). The game image may be displayed.

In the present embodiment, the mobile terminal 5 advances the story of the game according to the game result. Specifically, in the game of the present embodiment, a plurality of stages are prepared, and the player object 51 defeats an enemy character appearing in the current stage (in other words, inflicts a predetermined amount of damage). , Proceed to the next stage. Therefore, when the cumulative value of the damage amount due to the result of one or more games exceeds a predetermined amount, the mobile terminal 5 displays a replay game image showing how the player object 51 defeats the enemy character 65, and further. , Notifies that the player object 51 advances to the next stage.

Further, in the present embodiment, a privilege may be given to the user depending on the game result. When the privilege is granted, as shown in FIG. 14, game result information 66 including information indicating that the privilege has been granted is displayed. In the present embodiment, as the above-mentioned privilege, coins that can be used in the game (for example, items can be purchased) are given. Although not shown in FIG. 6, in the game of the present embodiment, it is assumed that the item can be acquired by using the coin. Further, the privilege is not limited to the one related to the game (for example, the above coin or item), but may be the privilege related to the network service provided by the server 3. For example, the privilege may be points available in the network service or content provided in the network service.

Based on various information received from the mobile terminal 5 (health information and awakening information in this embodiment), the server 3 determines the necessity of granting the privilege and, if the privilege is granted, the content of the privilege. decide. For example, the server 3 determines the necessity of granting the privilege and the content of the privilege according to the degree of energy calculated based on the above-mentioned various information. The server transmits the game result information including the privilege information regarding the privilege to be given to the mobile terminal 5. The privilege information may be information indicating the privilege to be granted (for example, information indicating the game item to be granted or information indicating the number of points to be granted), or information on the privilege itself (for example, the above). It may be content data), or it may be information indicating a notification to the effect that the use of benefits (for example, content) on the mobile terminal 5 is permitted. As described above, the specific method for imparting the content as a privilege is arbitrary, and the content data may be transmitted from the server 3 to the mobile terminal 5, or the content data may be transmitted to the mobile terminal 5. It may be a method that is stored in advance and the use of the content is permitted (in other words, unlocked) in response to the above notification from the server 3.

When the game result information including the above privilege information is received, the mobile terminal 5 executes a process of granting the privilege based on the privilege information. For example, the mobile terminal 5 can change parameters in game processing (specifically, parameters indicating items and coins possessed by the player object 51) according to the given items and coins, or the user can change the parameters in the network service. The data of the number of points possessed is updated, and the data of the contents is stored in a predetermined storage unit.

Further, although not shown in FIG. 14, the replay game image may include the above-mentioned advice information. For example, the server 3 determines the content of the advice based on various information received from the mobile terminal 5 (health information and awakening information in the present embodiment), and generates the advice information. The server 3 transmits the game result information including the generated advice information to the mobile terminal 5. The mobile terminal 5 displays a replay game image including the advice information received from the server 3. The advice information may be generated by the mobile terminal 5.

The replay game image may be automatically stopped by the mobile terminal 5 when a predetermined condition (for example, being displayed for a predetermined predetermined time) is satisfied, or may be instructed by the user. The display may be stopped according to the above. Further, for example, the replay game image may be stopped from being displayed when the user falls asleep.

In the above embodiment, the terminal system 2 detects that the user has entered the floor in response to the mobile terminal 5 being attached to the base device. Here, the method of detecting that the user has entered the floor is arbitrary, and is not limited to the above method. For example, in another embodiment, the terminal system 2 may detect that the user has entered the floor in response to the user entering the detection range of the Doppler sensor 24 of the base device 6.

In the above case, in order to start the detection by the Doppler sensor 24 before the user enters the floor, the Doppler sensor 24 may automatically start the detection when a predetermined condition is satisfied. good. For example, when the mobile terminal 5 and the base device 6 are capable of wireless communication, the instruction to start the detection by the Doppler sensor 24 is based on the condition that the mobile terminal 5 is within the predetermined range of the base device 6. The device 6 may be used. It should be noted that the determination of whether or not the mobile terminal 5 is within the predetermined range of the base device 6 is within the communication range of the mobile terminal 5 when the mobile terminal 5 and the base device 6 perform short-range wireless communication. This may be done by determining whether or not the base device 6 has been inserted. Further, for example, the above determination may be performed by determining whether or not the mobile terminal 5 is located at the user's home based on the position detected by the position detection unit 13. Further, in another embodiment, the mobile terminal 5 gives an instruction to the base device 6 to start detection by the Doppler sensor 24 in response to the user giving a predetermined input instruction to the mobile terminal 5. You may.

Further, in another embodiment, the terminal system 2 may set the estimated time of entering the bed and start the detection by the Doppler sensor 24 when the estimated time of entering the bed is reached. The estimated time of entering the bed may be specified by the user, or may be calculated based on the past time of entering the bed and / or the time of falling asleep with respect to the user. For example, the terminal system 2 may store the sleep onset time in January recently and set a time before a predetermined time (for example, one hour before) the average time of sleep onset in January recently as the expected time to go to bed. good.

Further, in another embodiment, the mobile terminal 5 may detect that the user has returned home and execute the process of step S21 in response to the user returning home. The method of detecting the return of the user is arbitrary, but for example, it can be detected based on the detection result by the position detection unit 13. Specifically, the position of the user's home is registered in advance in the mobile terminal 5, and in the mobile terminal 5, the position of the mobile terminal 5 detected by the position detection unit 13 is within a predetermined distance from the home position. In some cases, it may be determined that the user has returned home. Further, for example, the terminal system 2 may detect the return home by using the Doppler sensor 24 of the base device 6. That is, the terminal system 2 intermittently activates the Doppler sensor 24 (for example, once at a predetermined time) to determine the presence or absence of the user, and when it is determined that the user exists, the user returns home. You may judge that you have done so. Further, for example, the terminal system 2 has a detection means (for example, a camera or a motion sensor such as an infrared sensor) provided at a predetermined position in the user's home, and the user is based on the detection result by the detection means. You may detect the return home.

As described above, in the present embodiment, an image showing how the player object 51 has returned from the adventure is displayed in response to the user entering the floor, and further, the adventure replay and the game result of the day (this implementation). In the form, an image showing the amount of damage given to the enemy character) is displayed. As a result, when the user enters the bed, the energy level that reflects the user's state and / or behavior on that day can be presented to the user. In addition, since the energy level is displayed as a game element even when entering the bed as in the case of awakening, the user can check the health information (in the present embodiment, the energy level) as if playing a game, and every day. The user can be motivated to perform continuous confirmation.

Further, in the present embodiment, the user's health information is input to the game and the game process is executed. That is, when the user measures the health information, the game is input, and if the user does not measure the health information, the game does not proceed. According to this, the user can be made to measure the health information as if it were a game, and the user can be motivated to continuously perform the daily measurement.

In the series of processes of steps S11 to S22, the game image is displayed on the display 17 at appropriate timings (steps S11 to S13, S16, S17, S21, S22). Here, at the above timing, the display of the display 17 may be turned off while the mobile terminal 5 is in the standby state, or an image by another application different from the game application may be displayed on the display 17. be. In this case, the mobile terminal 5 may notify the user by sound, display, and / or vibration instead of immediately displaying the game image. Further, the mobile terminal 5 may display the game image on the display 17 in response to the user who received the notification inputting a predetermined display instruction.

In the above embodiment, the advice information is presented to the user at an appropriate timing (when the user is awakened, etc.). Here, in another embodiment, the terminal system 2 may present information different from the advice information to the user in order to improve the content of the calculated health information (for example, the evaluation result). .. That is, the terminal system 2 may present the recommendation information to the user together with the advice information or instead of the advice information, or may output the content. The recommendation information is information that introduces products and the like recommended to the user in order to improve the content of the calculated health information. The content is music and / or video recommended to the user to improve the content of the calculated health information.

In addition, the terminal system 2 displays (or instead) an image displayed before the user leaves the bed and / or an image displayed after the user enters the bed on the display 17 of the mobile terminal 5. It may be projected and displayed by the projector 25 of the base device 6. According to this, the user can confirm the evaluation result and the like without having to pick up the mobile terminal 5 at the time of awakening. The images displayed before the user leaves the bed are, for example, the above-mentioned awakening game image, simple display image, and / or standby image. The image displayed after the user enters the floor is, for example, the above-mentioned game image at the time of entering the floor and / or the replay game image.

As described above, the mobile terminal 5 starts the measurement for calculating the health information of the user in response to the detection of entering the bed (step S23). In FIG. 6, the measurement start timing (step S23) is shown after the display of the replay game image (step S22), but the measurement is started at an arbitrary timing according to entering the floor. good.

When the measurement is started, the terminal system 2 calculates the sleep index based on the measurement result as described above. Then, the terminal system 2 executes information processing according to the sleep state represented by the sleep index (step S24). As this information processing, for example, the following processing is executed.
-A process that plays the content for falling asleep (specifically, music and / or video that promotes falling asleep) before the user falls asleep and ends the playback when the user falls asleep.-Currently when the user awakens halfway. Processing to display the time-Process to start playback of awakening content (specifically, music and / or video that promotes awakening) at a timing shortly before the user awakens-Mobile terminal 5 according to the user falling asleep Processing to change the state of (for example, turn off the power, put it in the standby state, put it in the manner mode, etc.)-Change the state of the mobile terminal 5 according to the awakening of the user (for example, turn on the power, turn on the power, etc.) Processing (such as canceling the manner mode) When presenting an image to the user in each of the above processes, the display 17 of the mobile terminal 5 may be used, or the projector 25 of the base device 6 may be used. However, both may be used.

[3. Specific examples of processing in information processing systems]
Next, a specific example of the processing executed in the information processing system will be described.
First, a specific example of the processing executed in the terminal system 2 will be described with reference to FIGS. 15 to 18. The mobile terminal 5 executes measurement processing, awakening processing, daytime processing, and bedtime processing. In the present embodiment, each of these processes is executed by the processing unit 11 executing the game program stored in the mobile terminal 5. In another embodiment, a part of each of these processes (for example, measurement process) may be realized by another program different from the game program. In addition, some and all of the above-mentioned processes may be executed by another information processing device (for example, the base device 6 and / or the server 3), and the mobile terminal 5 and the other information processing device may be used. May be carried out in collaboration with each other.

The measurement process is a process for calculating health information by measuring biological information mainly during the sleep period of the user. The awakening process is a process for presenting a game image or the like including an evaluation result (specifically, energy level) of health information to the user when the user awakens. The daytime processing mainly involves the above-mentioned awakening information (specifically, activity information, environmental information, and the period from when the user leaves the bed to when the user enters the bed) during the daytime activity period (in other words, the period from when the user leaves the bed to when the user enters the bed). , Emotional information). The process at the time of entering the bed is mainly a process for presenting a game image or the like including an evaluation result of daily health information to the user when the user enters the bed. As described above, each of the above processes is generally executed in different periods, but two or more processes of each process may be executed in parallel in a certain period. Hereinafter, each of the above processes will be described in detail.

(3-1: Measurement processing)
FIG. 15 is a flowchart showing an example of the flow of measurement processing executed in the mobile terminal 5. In the present embodiment, the series of processes shown in FIG. 15 is started when it is detected that the user has entered the floor, that is, when the mobile terminal 5 is attached to the base device 6. In another embodiment, the series of processes may be started in response to the start of communication between the mobile terminal 5 and the base device 6, or the user may start the communication with the mobile terminal 5 or the base device 6. On the other hand, it may be started in response to performing a predetermined start operation.

In the present application, the processing of each step in the flowchart shown in the drawings is merely an example, and if the same result can be obtained, the processing order of each step may be changed, or the processing of each step may be used. In addition (or instead) another process may be performed. Further, in the present specification, the processing of each step of the above flowchart will be described as being executed by the CPU of each device (specifically, the mobile terminal 5, the base device 6, and the server 3). A processor other than the CPU or a dedicated circuit may execute the processing of some steps.

In the measurement process, first, in step S31, the mobile terminal 5 executes the start-time process. The start-time process is a process executed in response to the start of a series of processes shown in FIG. 15 (in the present embodiment, in response to the attachment of the mobile terminal 5 to the base device 6). In the present embodiment, the detection start process and the reproduction start process are executed as the start process (details will be described later).

In the detection start process, the mobile terminal 5 starts detection by a sensor (that is, Doppler sensor 24) that detects biological information for calculating health information. That is, the processing unit 11 of the mobile terminal 5 instructs the base device 6 to start the detection operation. In response to this instruction, the control unit 22 of the base device 6 causes the Doppler sensor 24 to start the detection operation.

Further, in the above-mentioned reproduction start processing, the mobile terminal 5 starts the reproduction of the content for falling asleep. That is, the processing unit 11 reads out the content for falling asleep stored in advance, and reproduces the content for falling asleep using the display 17 and / or the speaker. The content reproduced in the terminal system 2 (that is, the content for falling asleep and the content for awakening) may be stored in the base device 6, may be stored in the mobile terminal 5, or may be stored in the external device (that is, the content for awakening). For example, it may be acquired from the server 3) via the mobile terminal 5.

Further, when the start processing of step S31 is executed (in other words, according to the fact that the mobile terminal 5 is attached to the base device 6), the base device 6 executes the charging start process. In the charging start process, the base device 6 starts charging the mobile terminal 5. Specifically, the control unit 22 gives an instruction to the power acquisition unit 23 to start charging. In response to this instruction, the power acquisition unit 23 supplies the power supplied from the external power source to the mobile terminal 5 via the connector 21. It is assumed that the base device 6 is in a state of being connected to an external power source (that is, a state in which the power plug is connected to an outlet). The base device 6 may check the remaining battery level of the mobile terminal 5 and start the charging operation on condition that the remaining battery level is equal to or less than a predetermined amount. The charging operation ends when the battery of the mobile terminal 5 is charged to the capacity.

In the other embodiment, the process executed as the start process is arbitrary, and any one or two of the above three processes (that is, detection start process, reproduction start process, and charge start process). The process may be executed, another process different from the above three processes may be executed, or the start-time process may not be executed.

After the process of step S31, the processes of steps S32 to S38 described below are repeatedly executed during the sleep period. In the present embodiment, the processing loops of steps S32 to S38 are executed once at a predetermined time.

In step S32, the mobile terminal 5 acquires the detection result (that is, biometric information) of the Doppler sensor 24. The Doppler sensor 24, which has started the detection operation by the detection start process in step S31, outputs the detection result (specifically, the output waveform) to the control unit 22. The control unit 22 transmits the detection result to the mobile terminal 5. As a result, the detection result of the Doppler sensor 24 is acquired by the mobile terminal 5. The control unit 22 may transmit the information of the detection result of the Doppler sensor 24 to the mobile terminal 5 as it is, or process the detection result by some processing (for example, a process of removing noise included in the signal of the detection result). The process of calculating the sleep index, etc.) may be performed and transmitted to the mobile terminal 5.

In step S33, the mobile terminal 5 calculates sleep information (for example, various sleep indexes). That is, the processing unit 11 calculates various sleep indexes based on the detection result (for example, biological information) acquired in step S32. The sleep index is calculated by the method described in "(2-2: Health information calculation method)" described above. In step S33, the processing unit 11 may calculate the information (that is, the sleep index) used for determining the sleep state of the user in steps S34 and S35 described later. In step S33, the processing unit 11 does not calculate the sleep index (for example, total sleep time), fatigue information (in other words, fatigue degree), and energy level, which can be calculated only at the end of the sleep period. You may.

In step S34, the mobile terminal 5 executes information processing according to the sleeping state of the user (step S24 shown in FIG. 6). That is, the processing unit 11 determines whether or not the sleep state of the user has reached a predetermined state, as in step S24. Then, when it is determined that the predetermined state is reached, the operation, operation mode, and / or setting of the mobile terminal 5 (and the base device 6) are controlled.

In step S35, the mobile terminal 5 determines whether or not the user has awakened. That is, the processing unit 11 determines whether or not the user has awakened based on the biometric information acquired in step S32 and / or the sleep index calculated in step S33. When it is determined that the user has awakened, a series of processes of steps S36 to S38 are executed. On the other hand, if it is determined that the user is not awake, the series of processes in steps S36 to S38 is skipped and the process in step S32 is executed again. That is, the series of processes of steps S32 to S35 are repeatedly executed until it is determined that the user has awakened.

In step S36, the mobile terminal 5 calculates health information based on the information (specifically, biological information) acquired during the sleep period. The health information is calculated by the method described in "(2-2: Method of calculating health information)" described above. In the present embodiment, in step S36, the processing unit 11 first calculates the autonomic nerve index based on the biometric information acquired in step S32. In addition, the processing unit 11 calculates a sleep index (for example, total sleep time, etc.) that cannot be calculated during the sleep period, based on the biological information acquired in step S32. Further, the processing unit 11 calculates the degree of fatigue and the degree of energy based on various sleep indexes and autonomic nerve indexes. From the above, health information including a sleep index and a fatigue index is calculated.

In step S37, the mobile terminal 5 transmits the health information calculated in step S36 to the server 3. That is, the processing unit 11 transmits the calculated health information to the server 3 by the communication unit 10. As a result, health information for one sleep period is transmitted to the server 3 and stored in the server 3. As described above, in the present embodiment, the mobile terminal 5 automatically transmits the information to be transmitted to the server 3. That is, the information is uploaded to the server 3 without the user giving an instruction.

After the step S37, the mobile terminal 5 ends the measurement process. At this time, the processing unit 11 of the mobile terminal 5 instructs the base device 6 to stop the detection operation. In response to this instruction, the control unit 22 of the base device 6 causes the Doppler sensor 24 to stop the detection operation.

In the present embodiment, when the mobile terminal 5 is removed from the base device 6 for some reason during the sleep period (for example, when the user hits the mobile terminal 5 when turning over), the base The device 6 cannot transmit the detection result of the Doppler sensor 24 to the mobile terminal 5. In this case, the base device 6 stores the detection result data that could not be transmitted to the mobile terminal 5 in its own storage unit (for example, a memory or the like). Then, in response to the fact that the mobile terminal 5 is attached to the base device 6, the base device 6 transmits the detection result data stored in the storage unit to the mobile terminal 5. The mobile terminal 5 that has received the above data calculates a sleep index based on the detection result (step S33). The mobile terminal 5 does not have to execute the control process (step S34) based on the sleep index calculated at this time. This is because the sleep index calculated at this time is based on the past detection results.

Further, when it is determined that the user is awake based on the calculated sleep index (when the determination result in step S35 is affirmative), the mobile terminal 5 executes the processes of steps S36 to S38. .. In this way, even if the mobile terminal 5 is removed from the base device 6 during the user's sleep, the next time the mobile terminal 5 is attached to the base device 6, health information is calculated and sent to the server 3. Will be sent. Therefore, for example, when the user awakens and notices that the mobile terminal 5 has been detached from the base device 6, the user may attach the mobile terminal 5 to the base device 6. As a result, the terminal system 2 can calculate the health information and send it to the server 3.

In another embodiment, when the mobile terminal 5 and the base device 6 are capable of wireless communication, even if the mobile terminal 5 is detached from the base device 6, the processes of steps S32 to S35 are performed. It can be executed continuously.

(3-2: Processing during awakening)
FIG. 16 is a flowchart showing an example of the flow of awakening processing executed in the mobile terminal 5. In the present embodiment, the series of processes shown in FIG. 16 is started in response to the detection that the user has awakened (Yes in step S35).

In the awakening process, first, in step S40, the mobile terminal 5 displays the above-mentioned awakening game image (step S11 shown in FIG. 6). Before step S40, the processing unit 11 calculates the evaluation result (specifically, the degree of energy) of the health information in the process of step S36 in the measurement process (FIG. 15). The processing unit 11 generates an awakening game image based on the calculated health information and displays it on the display 17. When a predetermined time has elapsed from the display of the awakening game image, the process of step S41 is executed.

In step S41, the mobile terminal 5 displays the above-mentioned simple display image (step S12 shown in FIG. 6). That is, the processing unit 11 generates a simple display image based on the health information calculated in the process of step S36, and displays it on the display 17. When a predetermined time has elapsed from the display of the simple display image, the process of step S42 is executed.

In step S42, the mobile terminal 5 displays the above-mentioned standby image (step S13 shown in FIG. 6). That is, the processing unit 11 displays the standby image prepared in advance on the display 17.

In step S43, the mobile terminal 5 determines whether or not to display the details. That is, the processing unit 11 determines whether or not an instruction input for performing detailed display (for example, input to the detailed display button 56) has been performed while the standby image is being displayed. If the determination result in step S43 is affirmative, the process in step S44 is executed. On the other hand, if the determination result in step S43 is negative, the process in step S45 is executed.

In step S44, the mobile terminal 5 executes the detailed display process (step S14 shown in FIG. 6). In the detailed display process, the processing unit 11 creates various detailed display images (FIGS. 10 and 11) based on the health information calculated in the process of step S36, and displays them on the display 17. Further, depending on the content of the detailed display image, the processing unit 11 may read the past health information stored in the mobile terminal 5 and create the detailed display image based on the health information. Further, the processing unit 11 may receive the health information of another user from the server 3 and create a detailed display image based on the health information. The process of step S44 ends in response to the input of a predetermined end instruction (for example, input to the menu button 59) by the user, and then the process of step S42 is executed again.

On the other hand, in step S45, the mobile terminal 5 determines whether or not to execute the mini game. That is, the processing unit 11 determines whether or not an instruction input (for example, an input to the mini game button 57) to execute the mini game has been performed while the standby image is being displayed. If the determination result in step S45 is affirmative, the processes of steps S46 and S47 are executed. On the other hand, if the determination result in step S45 is negative, the process of step S48, which will be described later, is executed.

In step S46, the mobile terminal 5 executes a mini game (step S15 shown in FIG. 6). That is, the processing unit 11 accepts the game input by the user, executes the mini game processing in response to the game input, and displays the game image showing the result of the mini game on the display 17. When the mini-game ends, or when the user gives an instruction to end the mini-game, the process of step S46 ends, and then the process of step S47 is executed.

In step S47, the mobile terminal 5 corrects the energy level based on the mini-game result, and transmits the corrected energy level to the server 3. That is, the processing unit 11 corrects the energy level calculated in step 36 based on the result of the mini game in step S46. Further, the processing unit 11 transmits the corrected energy level information to the server 3 by the communication unit 10. After step S47, the process of step S42 is executed again.

On the other hand, in step S48, the mobile terminal 5 determines whether or not the user has left the bed. That is, the processing unit 11 determines whether or not the mobile terminal 5 has been removed from the base device 6. If the determination result in step S48 is affirmative, the process of step S49 is executed. On the other hand, if the determination result in step S48 is negative, the process in step S43 is executed again. That is, in this case, the standby image is continuously displayed.

In step S49, the mobile terminal 5 displays the above-mentioned game image when getting out of bed. That is, the processing unit 11 generates a game image at the time of getting out of bed based on the health information (specifically, the degree of energy) calculated in the process of step S36 or step S47, and displays it on the display 17. When a predetermined time has elapsed from the display of the game image at the time of getting out of bed, the mobile terminal 5 ends the series of awakening processes shown in FIG.

(3-3: Daytime processing)
FIG. 17 is a flowchart showing an example of the flow of daytime processing executed in the mobile terminal 5. In the present embodiment, the series of processes shown in FIG. 17 is started in response to the completion of the awakening process (FIG. 16) (in other words, it is executed following the awakening process).

In step S50, whether or not the mobile terminal 5 calculates the awakening information for correcting the health information (specifically, the energy level) (in other words, has the timing to calculate the awakening information come? Whether or not) is determined. That is, the processing unit 11 performs a determination process of whether or not the condition for calculating any of the various awakening information is satisfied. The specific content of this determination process is arbitrary, but in the present embodiment, the determination process is performed by the following method.

Regarding the activity information, the processing unit 11 determines whether or not the condition for calculating the activity information is satisfied. This calculation condition is arbitrary, but in the present embodiment, the movement of the user is completed (the first condition), and the user stays at the place where the activity information is calculated (the second condition). ) Is used. When either the first condition or the second condition is satisfied, it is determined that the condition for calculating the activity information is satisfied.

Whether or not the first condition is satisfied depends on, for example, whether or not the detection position indicated by the position information has moved from a certain place and then stopped at another place for a predetermined time or more (for example, 10 minutes or more). Can be determined.

Further, whether or not the above second condition is satisfied is determined as follows. That is, the processing unit 11 first determines whether or not the movement is started after the detection position stays at the pre-registered place for a predetermined time or more (for example, 15 minutes or more). When it is determined that the movement has not started for a predetermined time or more, the processing unit 11 determines that the second condition is not satisfied. The "pre-registered place" may be a place related to the user, such as the user's home or work, or a facility such as a sports gym, a restaurant, or a movie theater. If it is determined that the user has stayed at this location, activity information is calculated.

Regarding the environmental information, the processing unit 11 determines whether or not the condition for calculating the environmental information is satisfied. In the present embodiment, the environmental information is calculated at the timing when the above activity information is calculated. Therefore, the processing unit 11 makes the above determination based on whether or not the activity information has been calculated.

Regarding the emotional information, the processing unit 11 determines whether or not the condition for calculating the emotional information is satisfied. In the present embodiment, for example, the following conditions are set as conditions for calculating emotional information.
-The period during which the user's voice or image is detected (for example, a period longer than a predetermined length) has expired.-The user has terminated the call with the mobile terminal 5.-The preset predetermined event period has expired. For the user's voice / image, the user's voice / image data is registered in the mobile terminal 5 in advance, and the voice / image detected by the microphone 15 is compared with the registered voice / image. Can be specified by. Further, the predetermined event period can be specified based on, for example, information registered as a schedule in the mobile terminal 5 (for example, a meeting or the like).

In step S50, the processing unit 11 uses information for calculating awakening information (specifically, position information, environment sensor information, image image information captured by the camera 16, and sound detection information from the microphone 15). Is acquired, and the above determination process is performed based on the acquired information. If the determination result in step S50 is affirmative, the process in step S51 is executed. On the other hand, if the determination result in step S50 is negative, the process in step S51 is skipped and the process in step S52 is executed.

In step S51, the mobile terminal 5 performs calculation processing on information that satisfies the calculation condition among various awakening information. Then, the mobile terminal 5 transmits the calculated information to the server 3. Specifically, when the condition regarding the activity information is satisfied in step S50, the processing unit 11 calculates the activity information based on the position information. Further, when the condition relating to the environmental information is satisfied in step S50, the processing unit 11 calculates the environmental information based on the environmental sensor information. Further, when the condition relating to the emotion information is satisfied in step S50, the processing unit 11 calculates the emotion information based on the image captured by the camera 16 and / or the voice detected by the microphone 15. Then, the processing unit 11 transmits the calculated information to the server 3 by the communication unit 10. After step S51, the process of step S52 is executed.

In step S52, the mobile terminal 5 determines whether or not to display the standby image. That is, the processing unit 11 displays whether or not the display timing of the standby image (that is, the timing when a predetermined time has elapsed from the start of displaying the game image at the time of getting out of bed in step S49 described above) and the game image are displayed. It is determined whether or not there is a predetermined instruction input of. Then, when it is determined that the display timing has arrived, or when it is determined that the instruction input has been made, the processing unit 11 determines that the standby image is to be displayed, and executes the process of step S53. On the other hand, when it is determined that the display timing has not arrived and it is determined that the instruction input is not performed, the processing unit 11 determines that the standby image is not displayed and executes the process of step S56 described later.

In step S53, the mobile terminal 5 determines whether or not a predetermined time has elapsed since the user got out of bed. That is, the processing unit 11 determines whether or not a predetermined time has elapsed since the determination result in step S48 described above became affirmative. If the determination result in step S53 is affirmative, the process in step S54 is executed. On the other hand, if the determination result in step S53 is negative, the process in step S55 is executed.

In step S54, the mobile terminal 5 displays a standby image on which the mini game cannot be executed (step S17 shown in FIG. 6). That is, the processing unit 11 displays the standby image that does not include the mini-game button 57 on the display 17. When this standby image is displayed, the user cannot execute the mini game. After step S54, the process of step S56 is executed.

In step S55, the mobile terminal 5 displays a standby image capable of executing the mini game (step S17 shown in FIG. 6). That is, the processing unit 11 displays the standby image (FIG. 9) including the mini-game button 57 on the display 17. When this standby image is displayed, the user can execute the mini game. After step S55, the process of step S56 is executed.

In step S56, the mobile terminal 5 determines whether or not to display the details. The determination process in step S56 is the same as the determination process in step S43. If the standby image is not displayed during the process of step S56, it is determined that the detailed display is not performed. If the determination result in step S56 is affirmative, the process in step S57 is executed. On the other hand, if the determination result in step S56 is negative, the process in step S58 is executed.

In step S57, the mobile terminal 5 executes the detailed display process (step S18 shown in FIG. 6). The detailed display process in step S57 is the same as the detailed display process in step S44. The process of step S57 ends in response to the input of a predetermined end instruction (specifically, the input to the menu button 59) by the user, and then the process of step S53 is executed again.

In step S58, the mobile terminal 5 determines whether or not to execute the mini game. The determination process in step S58 is the same as the determination process in step S45. If the standby image is not displayed during the process of step S58, it is determined that the mini game is not performed. If the determination result in step S58 is affirmative, the process in step S59 is executed. On the other hand, if the determination result in step S58 is negative, the process in step S61 is executed.

In step S59, the mobile terminal 5 executes a mini game (step S19 shown in FIG. 6). The mini-game process in step S59 is the same as the mini-game process in step S46.

In the following step S60, the mobile terminal 5 corrects the energy level based on the mini-game result, and transmits the corrected energy level to the server 3. The process in step S60 is the same as the process in step S47. After step S60, the process of step S61 is executed.

In step S61, the mobile terminal 5 determines whether or not the user has entered the floor. That is, the processing unit 11 determines whether or not the mobile terminal 5 is attached to the base device 6. If the determination result in step S61 is negative, the process in step S50 is executed again. Then, the series of processes of steps S50 to S61 are repeatedly executed until it is determined that the user has entered the floor. On the other hand, if the determination result in step S61 is affirmative, the processing unit 11 ends the daytime processing shown in FIG.

(3-4: Treatment at the time of entering the floor)
FIG. 18 is a flowchart showing an example of a flow of processing at the time of entering the bed executed in the mobile terminal 5. In the present embodiment, the series of processes shown in FIG. 18 is started in response to the detection that the user has entered the floor (Yes in step S61).

In the process at the time of entering the floor, first, in step S71, the mobile terminal 5 requests the server 3 to transmit the game result information indicating the game result (specifically, the game result based on the energy level of today's day). do. In response to this, the server 3 transmits the game result information regarding the user to the mobile terminal 5. The processing unit 11 receives the game result information transmitted from the server 3 via the communication unit 10 and stores it in the storage unit of the mobile terminal 5.

In the following step S72, the mobile terminal 5 displays the above-mentioned game image at the time of entering the floor (step S21 shown in FIG. 6). That is, the processing unit 11 displays the game image at the time of entering the floor prepared in advance on the display 17. When a predetermined time has elapsed from the display of the game image at the time of entering the floor, the process of step S73 is executed.

In step S73, the mobile terminal 5 displays the above-mentioned replay game image (step S22 shown in FIG. 6). That is, the processing unit 11 generates a game image at the time of entering the floor based on the game result information received from the server 3 via the communication unit 10, and displays it on the display 17 (see FIG. 14). As a result, the game result based on the daily energy level is presented to the user, and in some cases, the user is given a privilege. When a predetermined time has elapsed from the end of the moving image reproduction of the replay game image in step S73, the mobile terminal 5 ends the bed-setting process shown in FIG.

(3-5: Processing on the server)
Next, a specific example of the process executed on the server 3 will be described with reference to FIG. As described above, the mobile terminal 5 transmits health information and the like to the server 3. The server 3 evaluates the health of the user (that is, corrects the energy level) based on the received information, and provides a network service according to the evaluation result. Hereinafter, the details of the processing executed on the server 3 will be described.

FIG. 19 is a flowchart showing an example of the flow of processing executed on the server. The flowchart shown in FIG. 19 is continuously executed regardless of the state of the mobile terminal 5 (for example, regardless of whether the user is in the awakening period or the sleeping period).

First, in step S81, the server 3 determines whether or not the information has been received from the mobile terminal 5. As described above, the mobile terminal 5 transmits various information to the server 3 at an appropriate timing. Here, the information received by the server 3 from the mobile terminal 5 includes, for example, the health information transmitted in step S37, the health information transmitted in step S47 or S60 (specifically, the corrected energy level) and the like. , Awakening information (here, activity information, environmental information, and emotional information) calculated in step S51. When the various information is received by the server 3, the determination result in step S81 becomes affirmative. On the other hand, if the various information is not received by the server 3, the determination result in step S81 is negative. If the determination result in step S81 is affirmative, the process in step S82 is executed. On the other hand, if the determination result in step S81 is negative, the process in step S82 is skipped and the process in step S83, which will be described later, is executed.

In step S82, the server 3 stores (also referred to as storage) the information received from the mobile terminal 5 for each user. That is, the processing unit (specifically, the CPU) of the server 3 updates the user data indicating various information about the user so as to include the received information. Here, the user data stored in the server 3 will be described.

FIG. 20 is a diagram showing an example of a data structure of user data stored in the server in the present embodiment. FIG. 20 shows user data stored in the server 3 for one user. Although not shown, the server 3 stores data similar to the user data shown in FIG. 20 in a predetermined storage unit for each user in the network service.

As shown in FIG. 20, the user data includes user identification data, user status data, game data, and privilege data. In the server 3, these five types of data sets are accumulated for each user. The user data may include other data in addition to these four types of data, and may not include some data among these four types of data. In other embodiments, the user data may include, for example, preference data indicating user preferences. Further, as the user data, in addition to the user state data, information used for calculating the information represented by the user state data (for example, the above-mentioned position information, environment sensor information, etc.) may be stored.

The user identification data is data indicating identification information (for example, ID, password, etc.) for identifying a user. In the present embodiment, the identification information is set in a predetermined registration process executed when the network service for the user is started, and the user identification data indicating the set identification information is stored in the server 3. Further, in the present embodiment, when the mobile terminal 5 transmits information to the server 3, the mobile terminal 5 includes the above-mentioned identification information in the information and transmits the information to the server 3. The server 3 identifies the source user based on the identification information included in the received information.

The user state data is data indicating various states of the user. In the present embodiment, the user status data includes the data indicating the health information, the data indicating the activity information, the data indicating the environmental information, and the data indicating the emotional information. Each of these four data includes a plurality of pieces of information acquired so far. That is, in the present embodiment, the above four data indicate, for example, information acquired from the latest data in the past within a predetermined storage period (for example, one year). Therefore, when the information is received in step S81, in step S82, the server 3 includes the data corresponding to the received information among the above four data so as to include the received information. To update. It is assumed that the server 3 has the same retention period for the four data, but the length of the retention period for the four data is arbitrary and may be different.

The game data is data indicating information related to game processing in which health information is input, and includes data indicating game results and the like. Further, the game data may include data indicating the above-mentioned information about the mini-game (for example, information on the result of the mini-game).

The privilege data is data indicating the privilege given to the user. The privilege data is, for example, data showing a history of benefits given to the user so far.

Returning to the description of FIG. 19, in step S83, the server 3 determines whether or not to correct the energy level. That is, the processing unit of the server 3 determines whether or not the information received in the last executed step S81 is the awakening information. If the determination result in step S83 is affirmative, the process in step S84 is executed. On the other hand, if the determination result in step S83 is negative, the process in step S84 is skipped and the process in step S85, which will be described later, is executed.

In step S84, the server 3 corrects the energy level based on the information received in step S81. That is, the processing unit of the server 3 corrects the energy level based on the received information by the method described in the above-mentioned "(processing in the daytime)". The process of step S85 is executed after step S84.

In step S85, the server 3 determines whether or not the mobile terminal 5 has requested to transmit the game result information. If the determination result in step S85 is affirmative, the process in step S86 is executed. On the other hand, if the determination result in step S85 is negative, the processes in steps S86 and S87 are skipped, and the process in step S81 is executed again.

In step S86, the server 3 grants the user a privilege as needed based on the information received in step S81. That is, the processing unit of the server 3 determines whether or not to give the privilege, and if the privilege is given, the content of the privilege, based on the current energy level. The current energy level is the energy level finally calculated on the 1st of today. Specifically, the current energy level is the energy level corrected by the last executed step S84 process when the process of step S84 is executed today, and the process of step S84 is executed today. If not, it is the energy level indicated by the last information received in the process of step S81.

In the following step S87, the server 3 transmits the above-mentioned game result information to the mobile terminal 5 that has transmitted the request in step S85. That is, the processing unit of the server 3 generates game result information including the information indicating the current energy level and the information indicating the privilege given in step S87, and transmits the game result information to the mobile terminal 5. After step S87, the process of step S81 is executed again.

As described above, in the present embodiment, the process of correcting the energy level (step S84) is executed in response to the reception of various awakening information for correcting the energy level, and the game result information is displayed. In response to the request from the mobile terminal 5 to transmit, the process of granting the privilege (step S86) was executed. Here, the timing at which the process of step S84 is executed and the timing at which the process of step S85 is executed are arbitrary. For example, in another embodiment, the process of step S84 may be executed in response to the request. In addition, the process of step S85 may be executed according to the reception of the awakening information.

The server 3 repeatedly executes the series of processes of steps S81 to S87 described above. The server 3 executes a series of processes of steps S81 to S87 for each mobile terminal owned by a plurality of users who receive network services.

In the above, the main information processing executed in the mobile terminal 5 and the server 3 has been described with reference to FIGS. 15 to 19. Here, the mobile terminal 5 and the server 3 are not limited to the processes shown in FIGS. 15 to 19, and may execute other information processing. For example, the server 3 may manage a website for providing the above-mentioned network service. By accessing this website using the mobile terminal 5, the user can view the evaluation result by the server 3 and purchase a product or the like related to the recommendation information presented by the server 3. At this time, the mobile terminal 5 accepts inputs for making various requests to the website and executes processing according to the received inputs. This request includes, for example, a request to log in to a website, a request to browse a web page in the website (including, for example, a page showing an evaluation result and a page for purchasing a product, etc.), and a product, etc. Is a request to purchase. Further, the server 3 executes the process according to the request from the mobile terminal 5. For example, when the above request is a request for login to a website, the server 3 transmits information of a login image (specifically, a web page) to the mobile terminal 5. Further, for example, when the above request is a request for acquiring a web page, the server 3 transmits the information of the web page to the mobile terminal 5.

[4. Action effect of this embodiment]
(Effects related to the fact that application processing is executed in conjunction with the sleep state)
In the above embodiment, the information processing system 1 that executes the application (specifically, the game application) acquires the user information for calculating the information regarding the sleep of the user (step S32). Further, the information processing system 1 determines the sleep-related state of the user based on the acquired user information (steps S33, S35, S48, S61).

Here, the "state related to the user's sleep" may be the user's sleep state such as awakening (including halfway awakening) and falling asleep, or the user's state before and after sleeping such as entering and leaving the bed. You may. Therefore, the above-mentioned "user information" may be information that can calculate the sleep state of the user, or may be information that can calculate the state of the user before and after sleep. That is, the user information may be information detected by the Doppler sensor 24 (specifically, biological information), or information indicating a detached state between the mobile terminal 5 and the base device 6. Further, the "state related to the user's sleep" may be a state related to the user's actions (for example, awakening, falling asleep, entering the bed, getting out of bed, etc.) as described above, or a state relating to the evaluation related to sleep (for example, the above-mentioned state). It may be a state in which the energy level of is satisfied with a predetermined condition, more specifically, a state in which the energy level is calculated so that the cumulative value of damage to the enemy character exceeds the predetermined amount).

In addition, the information processing system 1 executes predetermined information processing in the application in conjunction with a state related to the user's sleep. Here, "execution of information processing in conjunction with the state related to the user's sleep" means to execute information processing in response to the state related to the user's sleep becoming a predetermined state, or related to the user's sleep. It means that information processing is executed according to the state satisfying a predetermined condition. In the above embodiment, "execution of information processing in conjunction with the state related to the user's sleep" means that the state related to the user's sleep has become a predetermined state (or the state related to the user's sleep is predetermined). It is realized by automatically executing information processing or by executing information processing in real time according to the condition of (Satisfying the above conditions).

Further, in the case of "execution of information processing in conjunction with the state related to the user's sleep", the state may be related to the content of the information processing, or the result of the state and the result of the information processing may be related. There may be. For example, as an example of the former, in the above embodiment, information processing is executed in which the player object is made to perform an operation according to a state related to the sleep of the user. That is, in the above embodiment, a process of displaying an image showing how the player object 51 performs an operation corresponding to the user's awakening, getting out of bed, and getting into bed is executed (steps S11, S16, S21 shown in FIG. 6). ). Further, as an example of the latter, in the above embodiment, information processing is executed so that a good game result can be obtained according to the good evaluation result obtained for the state related to the sleep of the user. That is, in the above embodiment, the process of advancing the story of the game is executed according to the evaluation result (specifically, the game result) for the state related to the user sleep (step S22 shown in FIG. 6).

According to the above, since the information processing system 1 executes information processing in conjunction with the state related to the sleep of the user, the user does not have to perform an operation for performing the information processing. According to this, the operation of the user in the information processing system 1 can be simplified. Therefore, the convenience of the user can be improved.

In the above embodiment, the information processing system 1 automatically starts executing the above-mentioned predetermined information processing when it is determined that the user's state has reached a predetermined state. Further, the information processing system 1 sequentially acquires user information in real time in a predetermined period (step S32), and sequentially determines the state related to the user's sleep based on the acquired user information (steps S33 and S36). Execution of predetermined information processing is started according to the determination that the user's state has reached the predetermined state (steps S40, S49, S72). According to the above, predetermined information processing is executed in real time according to the state of the user becoming a predetermined state. In the above embodiment, the predetermined period is a period from when the user enters the bed to when the user leaves the bed, but it may be any period. For example, in other embodiments, the predetermined period may be the period from when the user goes to bed or falls asleep to when the user awakens, or may be a period instructed by the user.

Here, "automatically" in the present specification means "without user operation (or instruction)". That is, "automatically executing information processing" means that the user does not need to perform an operation or instruction for executing (more specifically, starting execution) the information processing. Note that "automatically" does not mean that no operation (or instruction) is requested from the user. For example, the information processing system 1 notifies the user that the execution of the predetermined information processing is started, and gives a user instruction not to execute the predetermined information processing within a predetermined time from the notification. If not, the above-mentioned predetermined information processing may be executed. Alternatively, the information processing system 1 may request the user to input predetermined information used in the information processing at the start or during the execution of the predetermined information processing.

Further, in the present specification, "in real time" is not limited to a meaning having strictly immediacy. For example, the information processing system 1 may acquire the user information after a lapse of several seconds to a dozen seconds after the user information is detected by a sensor or the like. Further, the information processing system 1 may execute the predetermined information processing after a lapse of several seconds to a dozen seconds after the user's state becomes a predetermined state.

In the above embodiment, the information processing system 1 calculates health information regarding the user's sleep and / or fatigue based on the user information (steps S33 and S36), and uses the health information as input to the application to obtain the above-mentioned predetermined information. The process is executed (steps S40, S72, S73). According to this, information processing based on health information can be executed without the user performing an instruction operation.

Further, the information processing system 1 determines parameters related to the object (player character) appearing in the application based on the health information and executes the predetermined information processing (step S40,). According to this, since the parameters of the object are changed based on the health information, the health state of the user is reflected in the state of the object. As a result, the user can be interested in the health information, and the user can be motivated to confirm the health information. In the above embodiment, the application is a game application, but in other embodiments, the application is not limited to the game and may be any application. Further, in the above embodiment, the parameter indicates the number of remaining player objects and the amount of damage to the enemy character, but the content indicated by the parameter is arbitrary.

Further, the information processing system 1 executes a predetermined game process in the game application (in the above embodiment, a process of calculating the amount of damage to the enemy character) as the predetermined information processing based on the health information. According to this, since the user can perform actions such as measurement and confirmation of health information as if playing a game, it is possible to give the user a motivation to continuously perform these actions.

Further, the information processing system 1 generates advice information and / or recommendation information for improving the content (in the above embodiment, the degree of energy) indicated by the health information based on the health information and presents it to the user. (FIG. 7, FIG. 8, step S40). According to this, useful information can be presented to the user. Further, in the above embodiment, the presentation of the advice information and / or the recommendation information is performed in the game application (that is, during the game). According to this, by presenting such information during the game, the user can be motivated to continuously confirm the information.

In the above embodiment, the information processing system 1 executes the following processing as the predetermined information processing.
・ Processing to advance the story of the game ・ Game processing using game parameters (specifically, the number of remaining aircraft and the amount of damage to enemy characters) based on the user's health information ・ Granting benefits (items, etc.) in the game Processing According to the above, the game processing is executed as the above-mentioned predetermined processing by the game input reflecting the health information. Therefore, the user can perform actions such as measuring and confirming health information as if playing a game, and can motivate the user to continuously perform these actions.

In the above embodiment, the information processing system 1 determines that the user has awakened (in other embodiments, the user may have left the bed), and has determined that the user has awakened. In response to the above, the reception of the instruction input for starting the execution of the predetermined awakening game (that is, the mini game) is started (see FIG. 9), and when the instruction input is received, the awakening time is based on the user's operation input. The game process is executed (steps S15, S19, S46, S59). According to this, the information processing system 1 can make the user play the awakening game, and can expect the effect of awakening the user by playing the awakening game.

Further, when the awakening game is executed, the information processing system 1 reflects the result of the awakening game in the health information (step S47). According to this, the information processing system 1 can calculate the health information by reflecting the state of the user after awakening.

Further, the information processing system 1 is at the time of awakening, provided that it is within a predetermined period from the time when it is determined that the user has awakened (in other embodiments, the user may have left the bed). The result of the game is reflected in the health information (steps S53 and S55). According to this, it is possible to reduce the possibility that the health information is calculated without correctly reflecting the state after the user is awakened.

In another embodiment, the information processing system 1 accepts an instruction input to start executing the awakening game on condition that the user is within a predetermined period from the time when it is determined that the user has awakened or got out of bed. It may be. According to this, the awakening game can be started within a predetermined period after awakening or getting out of bed. That is, if the user wants to play the awakening game, he / she will wake up even if he / she is sleepy and start the awakening game. Therefore, according to the above, the user can be motivated to wake up. In addition, the effect of awakening the user can be expected by playing the game at the time of awakening. The predetermined period may be, for example, a period from the above time point until a predetermined time elapses, or a period from the above time point until the user is in a predetermined state. Specifically, the predetermined period may be a period from the time when the user is determined to be awake to the time when the user is determined to have left the bed. In addition, the predetermined period may be a period from the time when it is determined that the user has awakened or got out of bed to the time when it is detected that the user has left home.

Further, the information processing system 1 executes a game process (for example, a game process related to the progress of the game) based on the health information and the result of the awakening game (step S73). According to this, it is possible to improve the fun of the game by inputting a plurality of games, and by extension, it is possible to give the user a stronger motivation to continuously perform actions such as measurement and confirmation of health information.

In addition, the information processing system 1 calculates information on the user's fatigue (in the above embodiment, the degree of energy) based on the user's input performed in the awakening game process and the state related to the user's sleep (in the above embodiment). Step S47). According to this, information on fatigue can be calculated by reflecting the state of the user after awakening. The "user input performed in the awakening game process" may be the input of the game operation in the awakening game as in the above embodiment, or the user's response to the questionnaire during the awakening game. It may be an input.

In the above embodiment, the information processing system 1 includes a mobile terminal 5 including a sensor (specifically, a Doppler sensor 24) and a display device (specifically, a display 17), and the mobile terminal 5 via a network. A server 3 capable of communicating is provided. Here, the mobile terminal 5 acquires sensor information from the sensor and displays an image showing the result of the predetermined information processing on the display device. In addition, the server 3 accumulates data based on the state related to the user's sleep (FIG. 20). According to this, the user can confirm the result of predetermined information processing by using the mobile terminal 5, and can store the above data in the server 3.

(Effects related to the progress of game processing based on sleep status)
In the above embodiment, the information processing system 1 that executes the application of the game acquires the user information for calculating the information regarding the sleep of the user (step S32). In addition, the information processing system 1 calculates health information regarding sleep and / or fatigue of the user based on the acquired user information (steps S36, S47, S84). The information processing system 1 controls the game progress in the game application based on the health information (steps S40, S42, S49, S54, S55, S72, S73). According to the above, the game progresses when the user measures the health information. As a result, the player can be made to measure the health information as if it were a game, and the user can be motivated to continuously measure and confirm the health information.

Note that "controlling the progress of the game based on the health information" means that the player object is made to perform an action according to the health information (for example, the player object looks at the eyes according to the awakening of the user) as in the above embodiment. It may be that the player object departs for an adventure when the user wakes up and gets out of bed), or the progress of the game story in the game application (for example, the player object advances to the next stage) is used as health information. It may be controlled based on. Further, "controlling the progress of the game based on the health information" may mean growing the parameters of the objects appearing in the application of the game according to the health information. For example, the mobile terminal 5 may increase a certain parameter of the player object when the energy level calculated in step S36 is equal to or higher than a predetermined value (that is, when the energy level is higher than the predetermined reference value). good. As a result, the player object gradually grows by continuing to have a good result.

The information processing system 1 automatically controls the progress of the game according to the calculation of health information satisfying a predetermined condition. For example, in the above embodiment, the player object wakes up in response to the calculation of health information indicating that the user has awakened. Further, for example, in the above embodiment, the player object advances to the next stage according to the calculation of the energy level such that the amount of damage to the enemy character exceeds a predetermined amount. According to this, since the game progresses without causing the user to operate the game, it is possible to facilitate the progress of the game (in other words, the measurement of health information) for the user.

[5. Modification example]
(Modified example of evaluation of health information)
In the above embodiment, the evaluation result of the health information was calculated based on the health information calculated today (in other words, the health information calculated after the last sleep period). Here, in another embodiment, the evaluation result of the health information may be calculated based on the past health information of the user in addition to the health information calculated today.

For example, the mobile terminal 5 may calculate the evaluation result based on the energy level newly calculated in step S36 (that is, the energy level calculated today) and the past energy level. Specifically, in the mobile terminal 5, the energy level calculated today is improved by a predetermined standard or more (for example, 5 points or more) from the past energy level (for example, the average value of the energy level of last month). It may be determined whether or not it is present, and the determination result may be used as the evaluation result. The evaluation result is based on the difference between the numerical value based on new health information (for example, today's energy level) and the numerical value based on past health information (for example, the average value of last month's energy level). May be good.

From the above, the information processing system 1 acquires user information (specifically) during a plurality of user sleep periods (in other words, daily sleep periods), and obtains user information (specifically) for each of the plurality of user sleep periods. Each health information is calculated based on the user information. In addition, the information processing system 1 evaluates based on the comparison result between the health information regarding the latest sleep period (that is, the sleep period this morning) and the information based on the health information regarding the sleep period before the sleep period. .. According to this, the evaluation can be performed based on the past health information of the user, and for example, the evaluation can be performed based on whether or not the health information of the user is improved. In addition, by having the user confirm whether or not the health information is improved, the user can be strongly motivated to improve the health.

Further, in another embodiment, the evaluation result of the health information may be calculated based on the health information about the user of the mobile terminal 5 and the health information about the other user. For example, the mobile terminal 5 acquires the average value of the energy levels of other users from the server 3, and the acquired average value and the energy level calculated in step S36 (that is, the energy level of the user of the mobile terminal 5). The evaluation result may be calculated based on. The target user for calculating the evaluation result is arbitrary. For example, the target user may be the entire user registered in the network service, or may be a user who satisfies a predetermined selection criterion. The selection criteria may be, for example, criteria regarding personal information such as region (for example, country), age, gender, occupation, and the like.

As described above, the information processing system 1 can access the storage unit (storage unit in the server 3) that stores health information related to a plurality of users. The information processing system 1 may perform evaluation based on the comparison result of the health information about the user calculated in the terminal system 2 of the user and the health information about another user stored in the storage unit. .. According to this, the evaluation can be performed based on the health information of other users. For example, the evaluation can be performed based on whether or not the user of the mobile terminal 5 has a better evaluation than the other users. can. In addition, by having the user confirm the comparison result with other users, the motivation to improve the health can be strongly given to the user.

Further, even when the evaluation result reflecting the past health information and / or the evaluation result reflecting the health information about other users is calculated as described above, it is based on the evaluation result as in the above embodiment. Game processing may be executed. That is, in the mobile terminal 5, a game element representing the evaluation result may be presented to the user, or the game may be advanced according to the evaluation result.

The mobile terminal 5 has a first evaluation result that reflects past health information (and / or health information about other users) and a second evaluation result that does not reflect the health information (that is, calculated today). The health information about the user of the mobile terminal 5) may be calculated respectively. At this time, the mobile terminal 5 may present the game element representing the first evaluation result and the game element representing the second evaluation result to the user. According to this, it is possible to present two types of evaluation results to the user in an easy-to-understand manner.

FIG. 21 is a diagram showing an example of a game image displayed in a modified example of the above embodiment. FIG. 21 shows a modified example of the awakening game image shown in FIG. In the modified example shown in FIG. 21, in the mobile terminal 5, the energy level of the health information calculated today is improved by a predetermined standard or more than the information based on the past energy level (for example, the average value of the energy level of last month). Judge whether or not it is done. Then, when it is determined that the energy level is improved, the mobile terminal 5 adds the number of remaining machines as a bonus due to the improvement of the health information. In this case, as shown in FIG. 21, the mobile terminal 5 has the number of remaining units added as the bonus in addition to the number of remaining units (“80” in FIG. 21) corresponding to the energy level calculated today. (“5” in FIG. 21) is displayed. If it is determined that the energy level has not improved, the mobile terminal 5 does not add the number of remaining units due to the above bonus. In this case, the number of remaining bonus aircraft is not displayed. According to the above, it is possible to present the user's own energy level and the bonus due to the improvement in an easy-to-understand manner.

The game element representing the first evaluation result and the game element representing the second evaluation result may be the same type of game element as in the above-mentioned number of remaining machines, or different types of game elements. It may be. For example, the mobile terminal 5 may display the items given according to the first evaluation result in the game image, and display the number of remaining machines representing the second evaluation result in the game image. Further, the above two types of game elements may be displayed at the same time, or may be displayed at different timings.

(Modified example of display reflecting multiple health information)
In the modified example of the above embodiment, when displaying the game image, the mobile terminal 5 may display an image of an object that reflects a plurality of types of calculated health information (sleep index, fatigue index, etc.). good. For example, in the above embodiment, since a plurality of types of sleep indexes are calculated as health information, the mobile terminal 5 determines the color, shape, and / of the player object 51 according to each of some of the sleep indexes. Alternatively, the pattern or the like may be changed. Specifically, when sleep time, the number of awakenings during sleep, and the degree of good sleep are used as sleep indexes, the expression of the player object 51 in the game image during awakening changes according to the sleep time, and the hairstyle of the player object 51 is awakened halfway. It changes according to the number of times, and the clothes of the player object 51 may change according to the degree of good sleep. More specifically, in the mobile terminal 5, the facial expression of the player object 51 becomes brighter as the sleep time is an ideal value, and the sleepiness of the player object 51 becomes worse as the number of awakenings increases, and the degree of good sleep is high. The clothes may be lightly colored.

As described above, the information processing system 1 generates an image whose contents change according to each of a plurality of health information (for example, a plurality of types of sleep indexes) in the application, and generates a predetermined display device (here, a display). It may be displayed in 17). According to this, it is possible to present the measurement results of a plurality of health information in a method that is easy for the user to intuitively grasp.

Further, the information processing system 1 may automatically display the above image on the display device when it is determined that the user has awakened or got out of bed. For example, the mobile terminal 5 may display the player object 51 in the present modification in the awakening game image and / or the getting out of bed game image in the above embodiment. Here, since the user has just awakened at the time of awakening or getting out of bed, for example, even if each numerical value representing a plurality of health information is presented to the user, it may be difficult for the user to understand. On the other hand, according to this modification, by presenting the above image, the calculation result of the health information of this morning can be roughly grasped.

Further, the information processing system 1 changes the display mode of the first type of the predetermined object appearing in the application according to the first health information among the plurality of health information, and the second type of the object. The display mode of is changed according to the second health information among the plurality of health information. Note that "changing the display mode of an object" means, for example, changing the color, shape, size, and / or pattern of all or part of the object, and changing the number of the objects. It means to include. According to the above, since the display mode of a certain object is changed, the user can know the calculation result of his / her own health information by looking at the object.

The predetermined object does not have to be one object, and the information processing system 1 may change the display mode of a plurality of objects of the same type. FIG. 22 is a diagram showing an example of an image displayed in the modified example of the above embodiment. In the example shown in FIG. 22, the application for raising tropical fish is executed in the information processing system 1, and the image shown in FIG. 22 is displayed on the display 17. In the above example, the information processing system 1 changes the number of tropical fish corresponding to the health information according to each of the plurality of health information. For example, in the mobile terminal 5, the number of the first fish objects 71 is increased as the sleeping time is an ideal value, and the number of the second fish objects 72 is increased as the number of awakenings is increased, so that the degree of good sleep is improved. The higher the number, the larger the number of the second fish objects 73 may be. According to this, the user can recognize the good or bad of each sleep index by the number of each fish object, and can recognize the good or bad of health information (specifically, sleep) by the total number of fish objects. can.

Further, the information processing system 1 may change the display mode for different types of images (which may be an image of an object or a background image). For example, in the example shown in FIG. 22, the information processing system 1 changes the display mode of the fish object according to the first health information and responds to the second health information (different from the first health information). Therefore, the display mode such as the amount of aquatic plants, the size of aquatic plants, and / or the transparency of water may be changed.

(Modified example of communication with other users' terminals)
In another embodiment, the terminal system 2 refers to another user's mobile terminal (referred to as another user's terminal) according to a user's sleep-related state (eg, awakening, falling asleep, getting into bed, getting out of bed, etc.). You may want to give a notification. For example, the mobile terminal 5 may register another user terminal as a notification destination in advance, and notify the other user terminal that the user has awakened when the user awakens or leaves the bed. Alternatively, the mobile terminal 5 may notify another user terminal that the user has fallen asleep in response to the user falling asleep or going to bed. According to this, the sleep state of the user can be automatically notified to other users (for example, family and friends). The notification from the mobile terminal 5 to the other user terminal may be performed via the server 3 or may be performed without going through the server 3.

Further, in another embodiment, the terminal system 2 may transmit information indicating a state regarding the sleep of the user to the server 3. That is, the server 3 may receive and store information indicating the sleep state of each user in the network service from each terminal system. At this time, the server 3 may provide the terminal system 2 with information based on the sleep state of another user. The terminal system 2 may acquire information about another user registered as a friend in advance on the server 3 from the server 3 and present the acquired information to the user. As a result, the user of the terminal system 2 can know the current state (for example, sleeping or awake) of another user registered as a friend. Further, the server 3 may provide information based on the states of an unspecified number of other users to the terminal system 2. For example, the server 3 may transmit information indicating the percentage of users who are awake among the users in a specific area to the terminal system 2. According to this, the user can know what the state of the plurality of other users is.

Information indicating the sleep state of another user as described above may be presented in the game application. At this time, the state of the user may be represented by the state (or action) of the player object 51 of the above embodiment. For example, when the user is in a sleeping state, a game image showing the state in which the player object 51 is sleeping may be displayed on the mobile terminal of another user.

(Modification example related to application)
In the above embodiment, the case where the game application is executed in the terminal system 2 has been described as an example, but the type of the application executed in the terminal system 2 is not limited to the game and is arbitrary. When the game application is executed, the genre and contents of the game are arbitrary. The terminal system 2 may control the progress of the game based on the health information in the following games, for example.
-In a pet-raising game, a pet grows based on the user's health information (pet parameters change).
-In a game that manages a restaurant, the restaurant becomes larger (the store becomes larger or the menu increases) based on the user's health information. The actual recipe may be given to the user based on the health information.
・ In traveling games, mileage points will be accumulated according to health information, and you will be able to travel far.
-In the game of creating fields, ranches and gardens, animals and plants grow according to health information.

(Modification example of the function of each device included in the information processing system 1)
In the above embodiment, each process in the information processing system 1 is executed by the base device 6, the mobile terminal 5, and the server 3. Here, each process in the information processing system 1 may be executed by any of the above three configurations (base device 6, mobile terminal 5, and server 3).

The base device 6 transmits the information detected by the sensor to the mobile terminal 5, but in other embodiments, the information calculated from the detected information may be transmitted. For example, the base device 6 may calculate biological information of respiration and / or body movement and transmit it to the mobile terminal 5, may calculate a sleep index and transmit it to the mobile terminal 5, or may perform health information. (Including the evaluation result) may be calculated and transmitted to the mobile terminal 5.

Further, the mobile terminal 5 may transmit the information received from the base device 6 and / or the information detected by itself to the server 3 as it is, or transmit the information calculated from these information to the server 3. You may. In any case, the server 3 may calculate the health information based on the information received from the mobile terminal 5.

In addition, when a plurality of types of health information are calculated or a plurality of types of evaluations are performed as in the above embodiment, some health of the plurality of types of health information (including evaluation results) The information may be calculated by the mobile terminal 5, and the remaining health information may be calculated by the server 3.

Further, in another embodiment, the base device 6 may communicate with the server 3 without going through the mobile terminal 5. For example, the base device 6 may have a function of communicating with the server 3 via the network 4, similarly to the mobile terminal 5. At this time, the base device 6 may directly transmit the information detected by itself to the server 3, or may transmit the information to both the mobile terminal 5 and the server 3. Further, when the base device 6 can communicate with the server 3, the mobile terminal 5 may acquire information from the base device 6 via the server 3. That is, when the mobile terminal 5 acquires the information from the base device 6, the information transmitted from the base device 6 to the server 3 may be acquired from the server 3.

(Modified example of sensor)
In the above embodiment, the sensor for acquiring the biometric information of the user is a sensor that detects the biometric information of the user without contacting the user. That is, the sensor in this embodiment is a non-contact type (and non-wearable type) sensor (specifically, a Doppler sensor). The sensor is arranged around the user to be detected. As a result, the user does not have to worry about the detection operation by the sensor, so that the burden on the user due to the detection can be reduced. Further, when the sensor is a non-wearing type, there is no problem that the detection is not performed due to, for example, the user forgetting to wear the sensor.

The non-contact type (and non-wearable type) sensor is not limited to the Doppler sensor 24 described above. That is, in the above embodiment, the Doppler sensor 24 transmits a radio wave toward the detection target and receives the reflected wave, and analyzes the movement of the detection target based on the reception result (based on the Doppler phenomenon of the received wave). By), the biological information is output. In other embodiments, the non-contact type sensor is not limited to this, and for example, the non-contact type sensor transmits a radio wave (or a sound wave) toward a detection target, receives a reflected wave, and receives a result (received wave). Biometric information may be output based on. Specifically, the sensor may acquire an image of the detection target based on the received wave, analyze the movement of the detection target from the image information, and output biological information. Further, the non-contact type sensor may be a sensor that uses a predetermined detection wave such as an ultrasonic wave instead of the radio wave. Further, the non-contact type sensor may be an imaging means (camera) arranged around the user. That is, the camera may take a picture from a place away from the detection target, and the information processing system may analyze the movement of the detection target from the taken image and output the biological information.

The above embodiment can be used, for example, in an information processing system for executing a game application for the purpose of simplifying a user's operation.

1 Information processing system 2 Terminal system 3 Server 4 Network 10 Communication unit 11 Processing unit 12 Operation input unit 13 Position detection unit 14 Environment sensor 15 Microphone 16 Camera 17 Display 18 Speaker 19 Connector 21 Connector 22 Control unit 23 Power acquisition unit 24 Doppler sensor 25 Projector 26 Speaker 27 Camera 41 Waveform analysis unit 42 Sleep calculation unit 43 Autonomous nerve calculation unit 44 Fatigue calculation unit

Claims (18)

An information processing system that executes game applications
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
A detection means for detecting the user entering or returning home, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With means,
The display control means displays on the display device a game image showing how the game progresses based on the awakening information in the period before the user's entry or return to the home is detected.
The game image displayed on condition that the user has entered the bed or returned home is an information processing system including a replay game image of the game image displayed during the period. An information processing system that executes game applications
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection means for detecting the user entering or returning home,
A second detection means that detects the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With means,
The display control means is calculated based on the information related to the sleep on the condition that the awakening of the user is detected, and displays a first numerical value indicating the health of the user on the display device.
The game image displayed on condition that the user's entry or return home is detected is the same kind of numerical value as the first numerical value displayed on condition that the user's awakening is detected. An information processing system including a second numerical value calculated based on the awakening information. An information processing system that executes game applications
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection means for detecting the user entering or returning home,
A second detection means that detects the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With means,
The game image includes an image in which the player object reproduces the activity of the user indicated by the activity information.
The display control means displays a game image indicating that the player object starts a predetermined operation on the display device after the awakening of the user is detected.
The game image displayed on condition that the user has entered the floor or returned home is an information processing system including a moving image indicating that the player object ends the predetermined operation. The information processing system according to claim 1 or 2 , wherein the game image includes an image in which a player object reproduces the activity of the user indicated by the activity information. The information processing system according to any one of claims 1 to 4 , wherein the game image includes a numerical value indicating the evaluation result of the health of the user, which is calculated based on the awakening information. The game image is advice information calculated based on the awakening information, and is advice indicating advice to the user for improving the evaluation result regarding the health of the user calculated based on the awakening information. The information processing system according to any one of claims 1 to 5, which includes information. The information processing system according to claim 2 , wherein the second numerical value is calculated by correcting the first numerical value based on the awakening information. The display control means displays a game image showing the player object in the middle of performing the predetermined operation in the period from the detection of the user's awakening to the detection of the user's entering or returning home. The information processing system according to claim 3 , which is displayed on the display device. The awakening information further includes emotional information indicating the user's emotions.
The information processing system according to claim 3 or 8 , wherein the game image includes an image showing the player object reflecting the emotion of the user indicated by the emotion information. An information processing device that executes game applications.
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
A detection means for detecting the user entering or returning home, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With means,
The display control means displays on the display device a game image showing how the game progresses based on the awakening information in the period before the user's entry or return to the home is detected.
The game image displayed on condition that the user has entered the bed or returned home is an information processing device including a replay game image of the game image displayed during the period. An information processing device that executes game applications.
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection means for detecting the user entering or returning home,
A second detection means that detects the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With means,
The display control means is calculated based on the information related to the sleep on the condition that the awakening of the user is detected, and displays a first numerical value indicating the health of the user on the display device.
The game image displayed on condition that the user's entry or return home is detected is the same kind of numerical value as the first numerical value displayed on condition that the user's awakening is detected. An information processing device including a second numerical value calculated based on the awakening information. An information processing device that executes game applications.
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection means for detecting the user entering or returning home,
A second detection means that detects the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With means,
The game image includes an image in which the player object reproduces the activity of the user indicated by the activity information.
The display control means displays a game image indicating that the player object starts a predetermined operation on the display device after the awakening of the user is detected.
The game image displayed on condition that the user has entered the floor or returned home is an information processing device including a moving image indicating that the player object ends the predetermined operation. An information processing program that is executed on the computer of an information processing device that executes a game application.
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
A detection means for detecting the user entering or returning home, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. To make the computer function as a means
The display control means displays on the display device a game image showing how the game progresses based on the awakening information in the period before the user's entry or return to the home is detected.
The game image displayed on condition that the user has entered the bed or returned home is an information processing program including a replay game image of the game image displayed in the period. An information processing program that is executed on the computer of an information processing device that executes a game application.
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection means for detecting the user entering or returning home,
A second detection means that detects the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. To make the computer function as a means
The display control means is calculated based on the information related to the sleep on the condition that the awakening of the user is detected, and displays a first numerical value indicating the health of the user on the display device.
The game image displayed on condition that the user has entered the bed or returned home is the same kind of numerical value as the first numerical value displayed on condition that the user's awakening is detected. An information processing program including a second numerical value calculated based on the awakening information. An information processing program that is executed on the computer of an information processing device that executes a game application.
An acquisition means for acquiring user awakening information including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection means for detecting the user entering or returning home,
A second detection means that detects the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. To make the computer function as a means
The game image includes an image in which the player object reproduces the activity of the user indicated by the activity information.
The display control means displays a game image indicating that the player object starts a predetermined operation on the display device after the awakening of the user is detected.
The game image displayed on condition that the user has entered the floor or returned home is an information processing program including a moving image indicating that the player object ends the predetermined operation. An information processing method executed in an information processing system that executes a game application.
An acquisition step of acquiring user awakening information, including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
A detection step for detecting the user entering or returning home,
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With steps
In the display control step, a game image showing how the game progresses based on the awakening information is displayed on the display device in the period before the user enters the floor or returns home.
The game image displayed on condition that the user has entered the floor or returned home is an information processing method including a replay game image of the game image displayed in the period. An information processing method executed in an information processing system that executes a game application.
An acquisition step of acquiring user awakening information, including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection step of detecting the user entering or returning home,
A second detection step of detecting the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With steps
In the display control step, on condition that the awakening of the user is detected, a first numerical value calculated based on the information on the sleep and indicating the health of the user is displayed on the display device.
The game image displayed on condition that the user's entry or return home is detected is the same kind of numerical value as the first numerical value displayed on condition that the user's awakening is detected. An information processing method including a second numerical value calculated based on the awakening information. An information processing method executed in an information processing system that executes a game application.
An acquisition step of acquiring user awakening information, including at least one of activity information about the user during the awakening period and environmental information indicating the environment around the user during the awakening period.
The first detection step of detecting the user entering or returning home,
A second detection step of detecting the user's awakening based on the information about the user's sleep, and
Display control that displays a game image showing the progress of the game on the display device, which reflects the content of the acquired awakening information, on condition that the user has entered the floor or returned home. With steps
The game image includes an image in which the player object reproduces the activity of the user indicated by the activity information.
In the display control step, a game image indicating that the player object starts a predetermined operation after the awakening of the user is detected is displayed on the display device.
An information processing method, wherein the game image displayed on condition that the user has entered the floor or returned home includes a moving image indicating that the player object ends the predetermined operation.

Images