JP6217003B2 - Terminal device, sleep behavior recording method, and sleep behavior recording program - Google Patents

Description

The present invention is a terminal device for recording the behavior of the subject during sleep, sleep behavior recording method performed by the terminal device, and, about the sleep behavior recording program for executing this sleep behavior recording method.

A person may snore or sleep while sleeping.
These snoring and sleeping are uttered during sleep and unconsciously. For this reason, the person who sniffs and the like often does not remember after waking up.
However, people are interested in whether they were snoring during sleep or whether they were sleeping.
Therefore, a technique for detecting snoring and sleeping during sleep has been proposed.
For example, the light detected by the light receiving device includes a light receiving device that detects light around the subject, a sound receiving device that detects sound, and a determination device that determines whether the subject has snore. When the amount of light falls below a predetermined amount, the determination device determines that the subject has fallen asleep, and when the sound receiving device detects sound thereafter, the determination device is a snorer that can be emitted from the subject. A technique for determining a thing is proposed (for example, refer to Patent Document 1).

  In addition, a flat pressure sensor laid on the floor where the subject sleeps and a bed, and a terminal that receives and analyzes pressure information from the pressure sensor, the pressure information is analyzed. When the frequency which information shows belongs to the predetermined | prescribed frequency area | region, the technique which judges that an object person uttered snoring and sleeping is proposed (for example, refer patent document 2).

Japanese Patent Laid-Open No. 7-213546 JP 2010-99173 A

The present invention, an end terminal device you allow to know subsequently that the subject himself had been sleeping had issued a snoring or sleep talking during sleep, aims to provide a sleep behavior recording method and sleep behavior recording program And

In order to achieve this object, a terminal device according to the present invention is a terminal device provided with voice input means for inputting sound generated externally, and is emitted from a subject who is in a sleeping state and input by the voice input means. Storage means for storing the generated sound, first graph display means for displaying a first graph in which the presence or absence of the sound stored in the storage means is shown corresponding to the time when the sound is emitted from the subject, and the target Second graph display means for displaying a second graph in which the presence or absence of a person's body movement is shown corresponding to the time when the body movement is detected, and the sleep depth of the subject is shown corresponding to the time a third graph display means for displaying the third graph, it includes a display in a state of being lined up each graph by the said first graph display means second graph display means and the third graphical display means, a plurality The alarm mode can be set In the first alarm mode to store the sound input by the voice input means, in the second alarm mode is a configuration in which characterized in that it is configured not to store the sound input by the sound input means .

It is an external appearance perspective view which shows the structure of the terminal device in embodiment of this invention. It is a block diagram which shows the structure of the control system of a terminal device. It is a front view which shows the structure of an opening screen. It is a front view which shows the structure of a sound setting screen. It is a front view which shows the structure of a night sound screen. It is a front view which shows the structure of a refreshing sound screen. It is a front view which shows the structure of the alarm type setting screen. It is a front view which shows the structure of the alarm time setting screen. It is a front view which shows the structure of the sound mode start screen. It is a front view which shows the structure of the screen during sound mode execution. It is a front view which shows the structure of the display screen when waking up. It is a front view which shows the structure of a bedtime display screen. It is a front view which shows the structure of a date selection screen. It is a front view which shows the structure of a graph display screen. It is a front view which shows the structure of a sleep history display screen. It is a front view which shows the structure of a sleeping-word conversion character display screen. It is a flowchart which shows operation | movement of the terminal device in embodiment of this invention. It is a flowchart which shows the operation | movement procedure of a "good sound recording" process. It is a flowchart which shows the operation | movement procedure of a "smooth mode" process. It is a flowchart which shows the operation | movement procedure of a "view recording" process.

  Hereinafter, preferred embodiments of a terminal device, a sleep behavior recording method, and a sleep behavior recording program according to the present invention will be described with reference to the drawings.

[Terminal device]
First, an embodiment of a terminal device of the present invention will be described with reference to FIGS.
FIG. 1 is an external perspective view showing the configuration of the terminal device of this embodiment. FIG. 2 is a block diagram illustrating a configuration of a control system of the terminal device.

As shown in FIG. 1, the terminal device 10 is a portable terminal device that is miniaturized so that the user can carry it or carry it.
The terminal device 10 is a computer that operates under program control. For example, the terminal device 10 can be connected to a predetermined telecommunication line such as the Internet or a LAN by wire or wireless, and a server connected to the telecommunication line. It has functions such as accessing other information processing apparatuses to acquire predetermined information, download a predetermined program, and acquire and display predetermined images and videos.
Specific examples of the terminal device 10 having such a function include a smartphone, a tablet terminal, a mobile phone, and a PHS.

  Further, as shown in FIGS. 1 and 2, the terminal device 10 stores a communication unit 11 that is communicably connected to a predetermined telecommunication line, and a program and data for executing the functions of the terminal device 10 The display unit 13 includes a storage unit 12, a liquid crystal display, and the like, and displays a predetermined screen and has a function as a touch panel. The hardware key attached to the casing of the terminal device 10 and the display unit 13 have a screen. An input operation means 14 composed of displayed software keys, a microphone or the like, an audio input means 15 for inputting sound generated externally, a speaker or the like, and outputting predetermined sound to the outside. The sound output means 16 which is the sound output means of the present invention, the time measuring means 17 for measuring time, the acceleration sensor 18 for detecting the movement of the object, and the terminal And a control unit 20 for controlling each component of the terminal device 10 to perform various functions of the location 10.

The storage means 12 is a storage component having a predetermined storage capacity such as a ROM or a RAM and capable of storing data, or a storage medium such as a memory disk on which a plurality of storage components are mounted. Stores programs and data for executing functions.
The program stored in the storage unit 12 includes, for example, a voice recognition program that analyzes voice and converts it into character data, and a voice recognition program that generates voices such as snoring and sleep that the user of the terminal device 10 utters during sleep. There is a sleep behavior recording program or the like for converting the character data by executing and acquiring character data and displaying it on the display means 13.

  The speech recognition program has an acoustic model consisting of waveform samples of phonemes ("A", "I", "U", etc.) that are sounds of one character, and vocabulary ("Apple", "Send", "Beautiful", etc.) And a language model consisting of a large number of samples of vocabulary or phrases that contain relevance of multiple vocabularies (such as “I ate” next to “apple” followed by “eat”)) The analog voice signal input by the voice input means 15 is converted into a waveform, the converted waveform is divided into characters, and each of the divided waveforms is divided into waveforms. When a waveform sample is extracted and the number of segmented waveforms in the waveform of the speech signal is one, the phoneme indicated by the waveform sample extracted based on this one segmented waveform, or a vocabulary selectable by this phoneme is input to speech 1 If the number of segmented waveforms in the waveform of the speech signal is two or more, the phoneme indicated by the waveform sample extracted for each of these two or more segmented waveforms is specified. Vocabulary, a vocabulary that approximates a word composed of two or more phonemes joined together is selected from vocabulary samples, and the selected vocabulary or a phrase that is a sequence of a plurality of vocabularies is selected by the voice input means 15. It is a program that identifies a vocabulary or phrase indicated by the input voice.

As a specific example of this speech recognition program, for example, there is a large vocabulary continuous speech recognition engine which is software capable of executing continuous speech recognition of tens of thousands of vocabulary in almost real time.
The program stored in the storage unit 12 may be one that has already been stored in the storage unit 12 at the time of sale of the terminal device 10, that is, one that is standardly provided in the terminal device 10, or the user It may be a program such as application software downloaded via a predetermined telecommunication line and communication unit 11 by operating the input operation unit 14 after purchasing the terminal device 10.

When the sleep behavior recording program is activated, the control means 20 includes a display / setting control unit 20A, a data collection unit 20B, an audio output control unit 20C, and a recording display control unit 20D, as shown in FIG. It functions as the control means 20 having.
The display / setting control unit 20 </ b> A is a functional unit that controls screen display on the display unit 13, detection of an operation of the input operation unit 14, storage of a set piece of music in the storage unit 12, and the like. The data collection unit 20B is a functional unit that converts sounds such as snoring and sleep that are generated from the user during sleep, user body movement, user sleep depth, and the like into data and stores them in the storage unit 12. The audio output control unit 20 </ b> C is a functional unit that controls the output of sound and music in the audio output unit 16. The record display control unit 20 </ b> D is a functional unit that causes the display means 13 to display data such as the user's body movement, sound, and sleep depth.

The control unit 20 executes a boot program or the like when the terminal device 10 is turned on, starts the OS, and causes the display unit 13 to display a startup screen. On the startup screen, an icon indicating a program stored in the storage unit 12, in particular, an icon indicating a program executable by the user's selection is displayed as a software key.
The control means 20 will start a sleep behavior recording program, if the icon which shows a sleep behavior recording program among the icons displayed on the starting screen is selection-operated by the user. Then, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, and causes the display unit 13 to display the opening screen 501.

The opening screen 501 is a screen that is first displayed on the display means 13 when the sleep behavior recording program is activated (if there is another screen that is initially displayed, the screen that is displayed after that). As shown in FIG. 3, the title name of the sleep behavior recording program (“Sleep Forest” in FIG. 3) is displayed and operable software keys are displayed.
The software keys displayed on the opening screen 501 include, for example, a “good record” key 501a, a “slight nap” key 501b, a “preparation for good sleep” key 501c, a “fairy book” key 501d, and a “view record” key 501e. , “Other” key 501f and the like.

The “sound recording” key 501a is operated when the screen shifts to a screen for setting the content of “sound mode” which is a mode for recording snoring, sleeping, and body movement of the user during sleep. Key.
“Slightly nap” key 501b sets a short time such as 5 minutes or 10 minutes, and shifts to “slightly nap mode” in which an alarm is activated after the set time has elapsed from the current time. The key to be operated.
The “preparation for good sleep” key 501c is a key operated when shifting to a screen for lecture on preparation exercises before sleep.
The “fairy illustration book” key 501d is a key operated when shifting to a screen displaying a list of acquired fairies.
The “view recording” key 501e is a key operated when shifting to a screen for displaying data such as snoring, sleep, and body movement recorded in the past.
The “other” key 501f is a key operated when shifting to a screen for displaying information related to the sleep behavior recording program, a screen for performing various settings, or the like.

When the “sound recording” key 501a is selected by the user's operation from the software keys displayed on the opening screen 501, the control unit 20 operates as the operation detection unit 22 of the display / setting control unit 20A. It is detected that the “record sound” key 501a has been selected. Then, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, and causes the display unit 13 to display the sound setting screen 502.
The sound setting screen 502 is a screen for setting a sound to be output from the audio output means 16 when the user goes to bed, before waking up, at the time of waking up, etc. As shown in FIG. For example, a “good night sound” key 502a, a “fresh sound” key 502b, an “alarm” setting key 502c, an “appetizing item” key 502d, an “OK” key 502e, a “BACK” key 502f, and the like are displayed.

The “good night sound” key 502a is operated when the screen of the terminal device 10 shifts to a screen for setting a song name of “good night sound” that is a song to be output from the audio output means 16 when the user tries to start sleeping. Key.
The “Sawayaka Sound” key 502b is a key operated when shifting to a screen for setting a song name of “Sawayaka Sound” which is a song output from the audio output means 16 a predetermined time before the set “Alarm time”. is there.
The “alarm” setting key 502c is operated when shifting to a screen for setting the type of “alarm sound” that is a sound to be output from the audio output means 16 when the “alarm time” set as the time when the user gets up is reached. Key to be played.

The “snoring item” key 502d is a key operated when shifting to a screen for displaying a list of snoring items possessed by the user. The snoring item is an item used to increase the types of approaching fairies in a hypothetical scenario in which a fairy approaches a sleeping user.
The “OK” key 502 e is a key operated when finalizing the song name of the selected song.
The “BACK” key 502f is a key operated when displaying the opening screen 501 which is the previous screen on the display means 13.

When the “good night sound” key 502a is selected by the user's operation from the software keys displayed on the sound setting screen 502, the control unit 20 operates as the operation detection unit 22 of the display / setting control unit 20A. It is detected that the “good night sound” key 502a has been selected. Then, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, and causes the display unit 13 to display a good night sound setting screen 503.
The good night sound setting screen 503 is a screen for setting “good night sound” which is a song to be output from the audio output means 16 when the user tries to start sleeping, and can be operated as shown in FIG. As software keys, for example, an “original sound” key 503a, a “music sound” key 503b, a cancel key 503c, a setting key 503d, a reproduction volume 503e, a “BACK” key 503f, and the like are displayed.

The “original sound” key 503a is a key operated when shifting to a screen for setting the name of an original song (a song prepared in advance in the sleep behavior recording program) as a “night sound”.
The “music sound” key 503b is a key operated when shifting to a screen for setting the song name of the song stored in the storage unit 12 as “good night sound” by downloading or the like.
The cancel key 503c cancels (releases) both the song name of the song set as “original sound” and the song name of the song set as “music sound”, and “original sound” and “music sound” are displayed. These keys are operated when none is set.
The setting key 503d is a key operated when shifting to a screen for setting a time for outputting music from the audio output means 16.
The reproduction volume 503e is a slide-type software key that is operated when adjusting the volume of the music output from the audio output means 16.
The “BACK” key 503f is a key operated when displaying the sound setting screen 502, which is the previous screen, on the display means 13.

  When the “original sound” key 503a is selected by the user's operation from the software keys displayed on the good night sound setting screen 503, the control means 20 selects the names of songs that can be selected as “original sound”. Is displayed on the display means 13 (not shown). When one song name is selected by a user's operation from among a plurality of song names displayed in a list, the control unit 20 operates as the setting unit 23 of the display / setting control unit 20A and is selected. The song name is set by storing the song name in the storage means 12 as the song name of “original sound”. Thereafter, when the “BACK” key that is operated when returning to the previous screen is selected on this screen, the control unit 20 causes the display unit 13 to display a good night sound setting screen 503 shown in FIG. In the “original sound” key 503a of the good night sound setting screen 503, the name of the set music is displayed.

  Further, when the “music sound” key 503b is selected by the user's operation from the software keys displayed on the sleep sound setting screen 503, the control means 20 sets the names of songs that can be selected as “music sound”. The list is displayed on the screen of the display means 13 (not shown). When one song name is selected by a user's operation from among a plurality of song names displayed in a list, the control unit 20 operates as the setting unit 23 of the display / setting control unit 20A and is selected. The song name is set by storing the song name in the storage means 12 as the song name of “music sound”. Thereafter, when the “BACK” key that is operated when returning to the previous screen is selected on this screen, the control unit 20 causes the display unit 13 to display a good night sound setting screen 503 shown in FIG. In the “music sound” key 503b of the good night sound setting screen 503, the name of the set music is displayed.

Further, when the setting key 503d is selected by the user's operation from among the software keys displayed on the good night sound setting screen 503, the control means 20 displays a candidate time for outputting the music from the sound output means 16. The screen is displayed on the display means 13 (not shown). When one of the displayed output time candidates is selected by a user operation, the control unit 20 operates as the setting unit 23 of the display / setting control unit 20A and is selected. The time is set by storing the recorded time in the storage means 12 as the output time of the music. Thereafter, when the “BACK” key that is operated when returning to the previous screen is selected on this screen, the control unit 20 causes the display unit 13 to display a good night sound setting screen 503 shown in FIG.
When the “BACK” key 503f displayed on the good night sound setting screen 503 is selected by the user's operation, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, as shown in FIG. A sound setting screen 502 is displayed on the display means 13.

When the “refreshing sound” key 502b is selected by the user's operation from the software keys displayed on the sound setting screen 502, the control unit 20 operates as the operation detection unit 22 of the display / setting control unit 20A. It is detected that the “refreshing sound” key 502b is selected. The control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, and causes the display unit 13 to display a refreshing sound setting screen 504.
The refreshing sound setting screen 504 is a screen for setting “freshness sound” which is a song to be output from the audio output means 16 before reaching the set “alarm time”, and as shown in FIG. As possible software keys, for example, an “original sound” key 504a, a “music sound” key 504b, a cancel key 504c, a setting key 504d, a reproduction volume 504e, a “BACK” key 504f, and the like are displayed.

The “original sound” key 504a is a key operated when shifting to a screen for setting the song name of the original song (a song prepared in advance in the sleep behavior recording program) as “fresh sound”.
The “music sound” key 504b is a key operated when the screen is changed to a screen for setting the song name of the song stored in the storage unit 12 as “fresh sound” by downloading or the like.
The cancel key 504c cancels (cancels) both the song name of the song set as “original sound” and the song name of the song set as “music sound”, and “original sound” and “music sound” are displayed. These keys are operated when none is set.
The setting key 504d is a key operated when shifting to a screen for setting a time for outputting music from the audio output means 16.
The reproduction volume 504e is a slide type software key that is operated when adjusting the volume of the music output from the audio output means 16.
The “BACK” key 504f is a key operated when displaying the sound setting screen 502, which is the previous screen, on the display means 13.

  When the “original sound” key 504a is selected by the user's operation from the software keys displayed on the refreshing sound setting screen 504, the control means 20 selects the names of songs that can be selected as “original sound”. Is displayed on the display means 13 (not shown). When one song name is selected by a user's operation from among a plurality of song names displayed in a list, the control unit 20 operates as the setting unit 23 of the display / setting control unit 20A and is selected. The song name is set by storing the song name in the storage means 12 as the song name of “original sound”. Thereafter, when the “BACK” key operated when returning to the previous screen is selected on this screen, the control means 20 causes the display means 13 to display a refreshing sound setting screen 504 shown in FIG. In the “original sound” key 504a of the refreshing sound setting screen 504, the name of the set music is displayed.

  Further, when the “music sound” key 504b is selected by the user's operation from the software keys displayed on the refreshing sound setting screen 504, the control means 20 sets the names of songs that can be selected as “music sound”. The list is displayed on the screen of the display means 13 (not shown). When one song name is selected by a user's operation from among a plurality of song names displayed in a list, the control unit 20 operates as the setting unit 23 of the display / setting control unit 20A and is selected. The song name is set by storing the song name in the storage means 12 as the song name of “music sound”. Thereafter, when the “BACK” key operated when returning to the previous screen is selected on this screen, the control means 20 causes the display means 13 to display a refreshing sound setting screen 504 shown in FIG. On the “music sound” key 504b of the refreshing sound setting screen 504, the name of the set song is displayed.

Further, when the setting key 504d is selected by the user's operation from the software keys displayed on the refreshing sound setting screen 504, the control unit 20 displays a candidate time for outputting the music from the audio output unit 16. The screen is displayed on the display means 13 (not shown). When one of the displayed output time candidates is selected by a user operation, the control unit 20 operates as the setting unit 23 of the display / setting control unit 20A and is selected. The time is set by storing the recorded time in the storage means 12 as the output time of the music. Thereafter, when the “BACK” key operated when returning to the previous screen is selected on this screen, the control means 20 causes the display means 13 to display a refreshing sound setting screen 504 shown in FIG.
When the “BACK” key 504f displayed on the refreshing sound setting screen 504 is selected by a user operation, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, and is shown in FIG. A sound setting screen 502 is displayed on the display means 13.

When the “alarm” setting key 502c is selected by a user operation from the software keys displayed on the sound setting screen 502, the control unit 20 operates as the operation detection unit 22 of the display / setting control unit 20A. It is detected that the “alarm” setting key 502c is selected. Then, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, and causes the display unit 13 to display the alarm type setting screen 505.
The alarm type setting screen 505 is a screen for setting an “alarm sound” that is a song or sound to be output from the audio output means 16 when the set “alarm time” is reached, as shown in FIG. In addition, for example, “normal alarm” key 505a, “lover mode” key 505b, “army mode” key 505c, cancel key 505d, setting key 505e, “BACK” key 505f, and the like are displayed as operable software keys. .

The “ordinary alarm” key 505a is a key operated when shifting to a screen for specifically setting “alarm sound”.
The “lover mode” key 505b is a key operated when shifting to a screen for setting a female voice as an “alarm sound”.
The “army mode” key 505c is operated when a screen for setting a male voice such as a sergeant as a “wake-up sound” is displayed. When this army mode is set, when the “alarm time” is reached, the voice output means 16 outputs, for example, a voice of a sergeant-like voice such as “Kora, get up”. Unless the user utters “yes, sir” or the like, the sergeant's voice is repeatedly output.

The cancel key 505d cancels (cancels) the “alarm sound” set as the “ordinary alarm” key 505a, the setting of the “lover mode”, and the setting of the “army mode”. This key is operated when none of the “alarm”, “lover mode” and “army mode” are set.
The setting key 505e is a key operated when shifting to a screen for setting a time for outputting sound from the sound output means 16.
The “BACK” key 505f is a key operated when displaying the sound setting screen 502, which is the previous screen, on the display means 13.

  When the “ordinary alarm” key 505a is selected by the user's operation from the software keys displayed on the alarm type setting screen 505, the control means 20 selects a song that can be selected as “alarm sound”. A list of song names or sound names is displayed on the display means 13 (not shown). When one song name or the like is selected from among a plurality of song names or sound names displayed in a list, the control means 20 operates as the setting unit 23 of the display / setting control unit 20A. Then, by storing the selected song name or the like in the storage means 12 as the song name or the like of “alarm sound”, the song name or the like is set. After that, when the “BACK” key operated when returning to the previous screen is selected on this screen, the control means 20 causes the display means 13 to display the alarm type setting screen 505 shown in FIG. In the “normal alarm” key 505a of the alarm type setting screen 505, the name of the set song name or sound is displayed.

When the “OK” key 502e is selected by the user's operation from the software keys displayed on the sound setting screen 502, the control unit 20 operates as the operation detection unit 22 of the display / setting control unit 20A. It is detected that the “OK” key 502e is selected. Then, the control unit 20 shifts to the “smooth mode”, operates as the display control unit 21 of the display / setting control unit 20A, and causes the display unit 13 to display the alarm time setting screen 506.
The wake-up time setting screen 506 is a screen for setting the time when the user wakes up as “wake-up time”. As shown in FIG. 8, as an operable software key, for example, a specific “wake-up time” Alarm time setting dial 506a operated when setting the hour and minute individually, “OK” key 506b operated when finally determining the selected “alarm time”, the previous screen The “BACK” key 506c operated when the sound setting screen 502 is displayed on the display means 13 is displayed.

  When the “OK” key 506b is selected by the user's operation from the software keys displayed on the alarm time setting screen 506, the control means 20 operates as the operation detection unit 22 of the display / setting control unit 20A. It is detected that the “OK” key 506b is selected. The control unit 20 operates as the setting unit 23 of the display / setting control unit 20A, and stores the time selected by the wake-up time setting dial 506a in the storage unit 12 as the “wake-up time”, whereby the time is stored. Set as “alarm time”.

Further, when detecting that the “OK” key 506b is selected, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A and causes the display unit 13 to display the sound mode start screen 507.
As shown in FIG. 9, the sound mode start screen 507 displays a message that instructs the user to place the terminal device 10 on the bedside of the user, and the “good sound mode” is displayed as an operable software key. An “OK” key 507 a that is operated when the user accepts the start, a “BACK” key 507 b that is operated when the display unit 13 displays the alarm time setting screen 506 that is the previous screen, and the like are displayed. .

  When the “OK” key 507a is selected by the user's operation from the software keys displayed on the sound mode start screen 507, the control unit 20 operates as the operation detection unit 22 of the display / setting control unit 20A. It is detected that the “OK” key 507a is selected. Then, the control unit 20 operates as the display control unit 21 of the display / setting control unit 20A, and causes the display unit 13 to display the sound mode execution screen 508.

As shown in FIG. 10, the “good sound mode in progress” screen 508 is a screen that displays the screen content indicating that the “good sound mode” is currently being executed and the set “alarm time”.
Also, on the sound mode execution screen 508, a sound mode release key (wakes up) 508a that is operated when canceling the sound mode before reaching the “alarm time” is displayed as a software key.
Further, on the sound mode execution screen 508, contents that can be operated by the user while the “good sound mode” is being executed are displayed as a message. This message includes, for example, “Recording is interrupted when the power button or home button is pressed”.

When the control unit 20 displays the sound mode execution screen 508 on the display unit 13, the control unit 20 operates as the good night sound output control unit 24 of the audio output control unit 20 </ b> C and is set on the good night sound setting screen 503 (see FIG. 5). The sound output means 16 outputs “good night sound” which is a song.
The night sound output control unit 24 of the control means 20 starts outputting the “night sound”, then monitors the output time of the “night sound”, and sets the night sound setting screen 503 (see FIG. 5). When the output time of the music set by the key 503d elapses, the output of the “good night sound” is stopped.

Further, when the control unit 20 displays the sound mode execution screen 508 on the display unit 13, the control unit 20 operates as the body motion calculation unit 25 of the data collection unit 20 B which is the body motion calculation unit of the present invention, and transmits from the acceleration sensor 18. The received acceleration signal is input, and the numerical value indicated by the acceleration signal is stored in the storage means 12 as acceleration data.
As the acceleration sensor 18, for example, a semiconductor type acceleration sensor using MEMS (Micro Electro Mechanical Systems) can be used. As a specific operation, the acceleration sensor 18 detects externally applied vibration based on a change in position of the minute movable part, and the detected position change of the minute movable part is set as the magnitude of vibration acceleration. The signal is output as an acceleration signal.
The acceleration sensor 18 is built in the terminal device 10. The user places the terminal device 10 on his bedside before going to bed. As a result, the acceleration sensor 18 detects the vibration transmitted through the bed, the floor, the futon, etc., when the sleeping user turns over and moves his / her body. An electrical signal corresponding to the magnitude of the acceleration of this vibration is output as an acceleration signal.

  When the body motion calculation unit 25 of the control means 20 receives the acceleration signal sent from the acceleration sensor 18, the numerical value indicated by the acceleration signal is a numerical value within a predetermined range (for example, a numerical value in 256 steps from 0 to 255). ), And the converted numerical value is stored in the storage means 12 as acceleration data. At this time, the control unit 20 stores the date and time when the acceleration is detected by the acceleration sensor 18 in the storage unit 12 in association with the acceleration data.

  Further, when the control unit 20 displays the sound mode execution screen 508 on the display unit 13, the control unit 20 operates as the recording unit 26 of the data collection unit 20 </ b> B, and converts the analog audio input by the audio input unit 15 into an audio signal. As described above, recording is performed by storing in the storage unit 12.

The voice input means 15 is composed of, for example, a microphone and inputs sound generated outside the terminal device 10.
It is assumed that the terminal device 10 incorporating the voice input unit 15 is placed on the bedside of a sleeping user. For this reason, the voice input means 15 can input sounds such as snoring and sleeping from a sleeping user.
In the present embodiment, snoring and sleeping are assumed as the sound input by the voice input unit 15, but the sound input unit 15 is not limited to snoring and sleeping and has a sound pressure and volume that can be input by the voice input unit 15. Any sound can be used. For example, it may be a sleep or bruxism emitted by a user, a voice of a person near the user, a sound of falling objects in the vicinity, a sound of a car or a train passing outdoors.

The recording unit 26 of the control unit 20 records the analog voice transmitted from the voice input unit 15 by storing it in the storage unit 12 as a voice signal. At this time, the recording unit 26 stores the date and time when the voice is input by the voice input unit 15 in the storage unit 12 in association with the voice signal.
The recording unit 26 sets a certain sound pressure as a threshold value, and when a sound having a sound pressure equal to or higher than the threshold value is input to the voice input unit 15 among the sounds input to the voice input unit 15. Recording of this sound can be started and the sound can be recorded (stored) in the storage means 12.
Furthermore, after the sound recording unit 26 starts recording the sound once, the sound pressure drops to zero (0) or a predetermined sound pressure or lower, and the state of the sound pressure zero or the predetermined sound pressure or lower is constant. When the time has elapsed, the recording can be terminated.
Alternatively, the recording unit 26 can start recording a sound and end the recording after a predetermined time has elapsed.

Further, the control unit 20 operates as the sound pressure calculation unit 27 of the data collection unit 20B, which is a sound value calculation unit of the present invention. After the sound mode execution screen 508 is displayed on the display unit 13, the sound input unit 15 The sound pressure of the input analog voice is calculated, and the calculated sound pressure is stored in the storage unit 12 as sound pressure data.
Here, when the analog sound sent from the sound input means 15 is input, the sound pressure calculation unit 27 of the control means 20 calculates the sound pressure of the analog sound, and the calculated sound pressure falls within a predetermined range. The value is converted into a numerical value (for example, a numerical value in 256 steps from 0 to 255), and the converted numerical value is stored in the storage unit 12 as sound pressure data. At this time, the control unit 20 causes the storage unit 12 to store the date and time when the analog voice is input by the voice input unit 15 in association with the sound pressure data.

  The control unit 20 operates as the sound analysis unit 28 of the data collection unit 20B, which is a voice conversion unit of the present invention, and activates a voice recognition program stored in the storage unit 12 and also outputs an analog signal from the storage unit 12. By extracting the voice signal and executing the activated voice recognition program, the analog voice signal is analyzed and converted into character data, and the character data is stored in the storage means 12. At this time, the control unit 20 causes the storage unit 12 to store the date and time when the voice is input by the voice input unit 15 in association with the character data.

The control unit 20 operates as the sleep depth calculation unit 29 of the data collection unit 20B which is the sleep depth calculation unit of the present invention, and is the sleep depth of the user based on the acceleration data and the sound pressure data. Calculate sleep depth.
The sleep depth can be calculated using the following equation.
Sleep depth = acceleration data + sound pressure data (Equation 1)

  The sleep depth calculated using Equation 1 is stored as sleep depth data in association with the date and time when the acceleration data and sound pressure data used when calculating the sleep depth are acquired. It is stored in the means 12.

The acceleration data is represented within a numerical value range of 0 to 255, and the sound pressure data is also represented within a numerical value range of 0 to 255. The obtained sleep depth is represented within a numerical range of 0 to 510.
However, also about sleep depth, when it is set as the numerical value represented within the range of the numerical value of 0-255, sleep depth can be calculated using following Formula.
Sleep depth = (acceleration data + sound pressure data) / 2 (Formula 2)
The sleep depth data calculated using Equation 2 is a numerical value represented within a numerical value range of 0 to 255.

The control unit 20 operates as the alarm management unit 30 of the audio output control unit 20C, and monitors the current time indicated by the time measuring unit 17 during execution of the “smooth mode”. Then, it is determined whether or not the current time has reached a time a predetermined time before the “wake-up time” (for example, a time five minutes before the “wake-up time”).
When the alarm management unit 30 determines that the current time has reached a predetermined time before the “wake-up time”, the control means 20 sets the music set on the refreshing sound setting screen 504 (see FIG. 6). The “sounding sound” is output from the audio output means 16.
Then, the alarm management unit 30 of the control means 20 starts outputting the “refreshing sound”, then monitors the output time of the “refreshing sound”, and sets the setting key 504d on the refreshing sound setting screen 504 (see FIG. 6). When the output time of the song set by the elapses, the output of the “fresh sound” is stopped.

The control unit 20 operates as the alarm management unit 30 and monitors the current time indicated by the time measuring unit 17 during execution of the “smooth mode”, and whether or not the current time has reached the “alarm time”. Judging.
When the alarm management unit 30 determines that the current time has reached the “wake-up time”, the control unit 20 operates as the display control unit 21 of the recording display control unit 20D, and displays the wake-up display screen on the display unit 13. 509 is displayed.

As shown in FIG. 11, the wake-up display screen 509 is a screen that displays a message indicating that the “smooth mode” has ended and a set “alarm time”.
The message indicating that the “good mode” has ended includes, for example, “Good morning”.
Further, on the wake-up display screen 509, for example, a sound mode end confirmation key (wakes up) 509a to be operated by the user at the end of the “good sound mode” is displayed as a software key.

Further, when the control means 20 operates as the alarm management unit 30 and determines that the current time has reached the “wake-up time”, the sound (“normal sound” set on the alarm type setting screen 505 (see FIG. 7)). The sound set when the “alarm” key 505a is selected, the set sound when the “lover mode” is selected, or the set sound when the “army mode” is selected. Let
When the “lover mode” key 505b is selected on the alarm type setting screen 505 (see FIG. 7) and “lover mode” is set, the control means 20 displays the “lover mode” on the display means 13. Can be displayed.
When the “army mode” key 505c is selected on the alarm type setting screen 505 (see FIG. 7) and “army mode” is set, the control means 20 displays the “army mode” on the display means 13. Can be displayed.

When the wake-up display screen 509 is displayed on the display means 13, when the user presses the sound mode end confirmation key 509a displayed on the wake-up display screen 509, the control means 20 displays the recording display control section. It operates as a 20D operation detection unit 22 and detects that the sound mode end confirmation key 509a has been operated. Then, the control unit 20 operates as the display control unit 21 of the recording display control unit 20D, and causes the display unit 13 to display the bedtime display screen 510.
As shown in FIG. 12, the bedtime display screen 510 is a screen that displays the time when the user went to bed.
In addition, on the bedtime display screen 510, an “OK” key 510a, which is a confirmation key operated when the display of this screen is terminated, is displayed as a software key.

  When the “OK” key 510a displayed on the bedtime display screen 510 is operated by the user's operation, the control unit 20 operates as the operation detection unit 22 of the recording display control unit 20D, and the “OK” key 510a. Detects that has been operated. Then, the control unit 20 operates as the display control unit 21 of the recording display control unit 20D, and causes the display unit 13 to display an opening screen 501 (see FIG. 3).

When the “view recording” key 501e is selected from the software keys displayed on the opening screen 501, the control unit 20 operates as the operation detection unit 22 of the recording display control unit 20D. It is detected that the “view recording” key 501e is selected. Then, the control unit 20 operates as the display control unit 21 of the recording display control unit 20D, and causes the display unit 13 to display the date selection screen 511.
As shown in FIG. 13, the date selection screen 511 is a screen that displays a date list display section 511a, a next month display key 511b, a previous month display key 511c, and a “BACK” key 511d.

The date list display unit 511a is an area for displaying a list of dates on which the “smooth mode” has been executed in the past, and the displayed dates are displayed as selectable software keys for each date.
In the date list display section 511a of the date selection screen 511 shown in FIG. 13, two “February 4” are displayed. This indicates that the number of times that the sleep behavior recording program was executed, more specifically, the number of times that the “smooth mode” was executed was twice in the 24 hours that is “February 4”. Thus, the “smooth mode” can be executed a plurality of times during the day.
Further, the date of the day when the “good mode” is not executed is not displayed in the date list display section 511a.

The next month display key 511b is a key operated when the date displayed on the date list display unit 511a is changed to the date of the next month.
The previous month display key 511c is a key operated when the date displayed in the date list display unit 511a is changed to the date of the previous month.
The “BACK” key 511d is a key operated when displaying the opening screen 501 which is the previous screen on the display means 13.

When one date is selected by the user's operation from the dates displayed as a list on the date list display unit 511a, the control unit 20 operates as the operation detection unit 22 of the recording display control unit 20D, and the one date is displayed. Detect that is selected.
And the control means 20 operate | moves as the graph control part 31 of recording display control part 20D, and the acceleration data, the sound pressure data, and the sleep depth data which were memorize | stored corresponding to the selected date from the memory | storage means 12. The data is taken out and converted into data that can be displayed on the display 13.

The control unit 20 operates as the display control unit 21 of the recording display control unit 20D, and causes the display unit 13 to display the graph display screen 512.
As shown in FIG. 14, the graph display screen 512 is a screen that displays a sleep depth display area 512a, a body movement graph display area 512b, a sleeping graph display area 512c, and a “BACK” key 512d.
The sleep depth display area 512a is an area in which sleep depth data is displayed in a graph with the horizontal axis representing time and the vertical axis representing sleep depth. By displaying the sleep depth data as a graph in the sleep depth display area 512a, the user can know the depth of sleep of the user based on the size of the waveform shown in the graph in the vertical axis direction.
Also, in this sleep depth display area 512a, the color is divided into four stages in the vertical axis direction, with the “sleep depth” being shallow at the top and the “sleep depth” being deep at the bottom. Is shown. Thereby, the depth of sleep can be easily grasped visually.

The body movement graph display area 512b is an area for displaying acceleration data in a graph with the horizontal axis representing time and the vertical axis representing acceleration magnitude. By displaying the acceleration data in a graph in the body movement graph display area 512b, the user can know that he / she turned over while he / she was sleeping from the presence / absence of the waveform. In addition, the user can know the size of the roll-over at that time by confirming the size of the waveform shown in the graph in the vertical axis direction.
The sleeping graph display area 512c displays sound pressure data in a graph with the horizontal axis representing time and the vertical axis representing sound pressure. By displaying the sound pressure data in a graph in the sleeping graph display area 512c, the user can know that he / she has spoken from the presence / absence of a waveform. Further, the user can know the magnitude of the sound pressure of the sleep sound at that time by checking the magnitude of the waveform shown in the graph in the vertical axis direction.
The “BACK” key 512d is a key operated when displaying the date selection screen 511, which is the previous screen, on the display means 13.

On the graph display screen 512, a sleeping display key 512e is displayed as a software key in or near the sleeping graph display area 512c.
When the user operates the sleep display key 512e, the control unit 20 operates as the operation detection unit 22 of the recording display control unit 20D, and detects that the sleep display key 512e is operated. Then, the control unit 20 operates as the display control unit 21 of the recording display control unit 20D, and causes the display unit 13 to display the sleeping history display screen 513.

As shown in FIG. 15, the sleeping history display screen 513 is a screen that displays a sleeping list display portion 513a and a “BACK” key 513b.
The “BACK” key 513b is a key operated when displaying the graph display screen 512, which is the previous screen, on the display means 13.

The sleeping word list display unit 513a is a piece of character data corresponding to each of one or more voices recorded on one date selected from the dates displayed on the date list display unit 511a of the date selection screen 511. It is an area for displaying a list of parts or all.
For example, it is assumed that one date selected from the dates displayed on the date list display unit 511a of the date selection screen 511 is “February 4”.
When the “good sound mode” of the sleep behavior recording program is executed on this “February 4”, the number of times the sound is recorded in this one “good sound mode” is 0, once, or plural Times. This is because recording is started when the sound pressure (or volume, etc.) of the sound uttered outside the terminal device 10 exceeds a certain value during execution of the “good sound mode”, and then the sound pressure (or When the time when the sound volume (such as volume) falls below a certain value exceeds the specified time, the recording ends, and recording continues until a sound with a sound pressure (or volume, etc.) greater than a certain value is input. It is because it does not do. For example, in the case where the time when the “good mode” is executed is 7 hours, when the user makes snoring three times at a predetermined time interval, the snoring is performed in one execution of the “good mode”. It will be recorded three times.

The sound analysis unit 28 of the control means 20 converts the sound into character data for each sound. The character data is stored in the storage unit 12 in association with the sound before conversion.
When “February 4” is selected from the dates displayed on the date list display unit 511a of the date selection screen 511, the selected “February 4” is displayed on the sleeping list display unit 513a. Character data corresponding to each of one or two or more voices recorded in is displayed as a list for each voice recorded. In the above example, the character data corresponding to each of the three snores recorded on “February 4” is displayed in a list on the sleeping word list display portion 513a.

In addition, the sleeping time list display unit 513a displays the time when the corresponding audio signal was recorded together with the character data.
Then, the character data and the time are displayed as selectable software keys for each of the character data and the like on the sleeping word list display unit 513a.

Furthermore, the character data displayed on each of the software keys is part or all of the character data converted from the corresponding audio signal. That is, when the number of characters indicated by the character data is greater than or equal to a predetermined number, a part of the character data is displayed on the software key.
Here, there is a limit on the number of characters of character data that can be displayed on one software key. Only when the number of characters indicated by character data is less than this limit, all of the character data is stored on the software key. Is displayed.
On the other hand, when the number of characters indicated by the character data is larger than the limit number, a part of the character data (for example, the first few characters among the characters indicated by the character data) is displayed on the software key. Thereby, the character data displayed on the software key plays a role as an index of each character data in the sleeping word list display portion 513a.

When one character data is selected by the user's operation from the character data displayed as a list on the sleeping word list display unit 513a, the control unit 20 operates as the operation detection unit 22 of the recording display control unit 20D. It is detected that the character data of is selected.
Then, the control unit 20 operates as the display control unit 21 of the recording display control unit 20D, and causes the display unit 13 to display the sleeping phrase conversion character display screen 514.

As shown in FIG. 16, the sleeping character conversion character display screen 514 includes a sleeping message display area 514a, a next character display key 514b, a previous character display key 514c, a reproduction key 514d, a stop key 514e, a “post” key 514f, and a “BACK” key. It is a screen displaying 514g.
The sleepiness display area 514a is a display area that lists acquired sleepiness as character data every predetermined time (for example, every 30 seconds) or every recording.
The display of the character data in the sleeping display area 514a is executed by the control unit 20 functioning as the text control unit 32 of the recording display control unit 20D. When the converted text display screen 514 is displayed on the display means 13, the text control unit 32 converts the character data converted from the voice signal corresponding to the character data selected on the sleeping list display unit 513 a of the sleeping history display screen 513. Are taken out from the storage means 12 and displayed in the sleeping phrase display area 514a of the sleeping phrase converted character display screen 514.

The next character display key 514b is operated to display character data corresponding to the analog voice recorded next to the analog voice corresponding to the character data displayed in the sleeping word display area 514a in the sleeping word display area 514a. Key.
When the next character display key 514b is selected, the text control unit 32 of the control means 20 erases the character data displayed in the sleeping display area 514a and the analog voice corresponding to the character data is recorded. Later, the character data converted from the analog voice recorded next to the analog voice is taken out from the storage means 12 and displayed in the sleeping display area 514a.

The previous character display key 514c is operated when displaying the character data corresponding to the analog voice recorded before the analog voice corresponding to the character data displayed in the sleeper display area 514a in the sleeper display area 514a. Key.
When the previous character display key 514c is selected, the text control unit 32 of the control means 20 erases the character data displayed in the sleeping display area 514a, and the analog voice corresponding to the character data is recorded. The character data converted from the analog sound recorded most recently in the past is taken out from the storage means 12 and displayed in the sleeping display area 514a.

The reproduction key 514d is a key operated when reproducing an audio signal corresponding to the character data displayed in the sleeping display area 514a among the analog audio signals recorded in the storage unit 12.
When the reproduction key 514d is operated by the user, the control unit 20 operates as the sound output control unit 33 of the recording display control unit 20D which is the sound output unit of the present invention, and the characters displayed in the sleeping display area 514a. An audio signal corresponding to the data is taken out from the storage means 12 and reproduced and output from the audio output means 16. As a result, the user can listen to snoring and sleep that he / she uttered and recorded on the terminal device 10 after waking up.
In addition, while the sleep key or the like is being played by operating the play key 514d, snoring or sleep character data is displayed in the sleep display area 514a of the sleep conversion character display screen 514. For this reason, the user can listen to snoring and sleeping speech that he / she uttered at the same time while visually recognizing the snoring and sleeping character data displayed in the sleeping display display area 514a.

In this way, the user can visually recognize the snoring and sleep that he / she spoke as characters, and at the same time, can listen to the snoring and sleep as speech, so that these characters can be compared with the speech.
Here, the character data displayed in the sleeping word display area 514a of the sleeping character conversion character display screen 514 is character data converted from the voice signal by the voice recognition program. However, the voice recognition program does not necessarily have a simple Japanese voice signal. It does not convert to a word sentence.
The reason for this is that snoring and sleep are not established in Japanese.
For example, among those snoring and snoring, snoring is a vibration sound or a friction sound in the upper respiratory tract, tongue base, etc., such as `` gar '' or `` go, go, go ''. , “We”, “5, 5, 5”, etc.
When the user sees the character data displayed in the sleeping expression display area 514a of the sleeping expression conversion character display screen 514, his / her snoring has been converted to "I", "5, 5, 5", etc. I feel interesting. Also, when you hear the snoring that you have heard by operating the play key 514d, the snoring you are listening to is saying "gar" or "go, go, go". The humor is memorized by the fact that "we" or "5, 5, 5" etc. are displayed in the area 514a. In this way, the user's snoring is displayed on the screen as characters, and by making the snoring reproducible, the user can be provided with fun and enjoyment.

On the other hand, sleeping words are words that are uttered unconsciously, so there are many sporadic vocabularies, and even long sentences are often not words.
For example, screams such as “Ah” and “Wa”, single words such as “Ogi, Gogo”, and utterances such as “N-, N-A, N-W-A-W, A-E--” etc. May be emitted.
When the voice recognition program converts these sleep words into characters, for example, “Ah”, “Wa”, “Right, Move”, “N-, N-ring, Kami-wa, A-”, etc. Sometimes.
The user who visually recognizes the character data converted in this way on the sleeping display area 514a is surprised and ashamed that he / she uttered such sleeping while sleeping, and operates the playback key 514d. While listening to the sleeper that uttered, when comparing this sleeper with the displayed character data, the character data has been converted successfully, or unexpected conversion has been performed. I feel interesting. As described above, the user's sleep is displayed on the screen as characters, and the sleep is reproducible, so that the user can be provided with fun and fun.

The stop key 514e is a key operated when stopping the reproduction of analog audio.
The “post” key 514f is operated when posting the character data displayed in the sleeping display area 514a to Twitter (registered trademark), Facebook (registered trademark), or the like.
The “BACK” key 514g is a key operated when displaying the graph display screen 512, which is the previous screen, on the display means 13.

In the terminal device 10 having the above-described configuration, a function for recording and playing back sleep and snoring emitted from a sleeping user, a function for converting and displaying the sleep and snoring into characters, A function that detects the user's rollover as a body movement, a function that calculates the user's sleep depth based on these body movements and the sound pressure of snoring and sleep, and a graph display of the body movement, sound pressure, and sleep depth It is possible to realize the function to perform.
Such operation of the terminal device 10 will be described below as a sleep behavior management method.

[Sleep behavior management method]
Next, the operation of the mobile terminal according to the present embodiment will be described as a sleep behavior management method with reference to FIGS.
Here, the following items will be described in order.
(1) Opening screen processing (2) “Good sound recording” processing (3) “Good sound mode” processing (4) “View recording” processing

(1) Opening Screen Processing When the terminal device 10 is powered on, the control unit 20 starts up the OS and causes the display unit 13 to display a startup screen.
When an icon indicating a sleep behavior recording program among the icons displayed on the activation screen is selected and operated by the user, the control unit 20 activates the sleep behavior recording program that is application software (S10 in FIG. 17, S is S). Step).
Next, the display control unit 21 of the control means 20 displays the opening screen 501 on the display means 13 (S11).

The operation detection unit 22 of the control unit 20 determines whether or not the “sound recording” key 501a displayed on the opening screen 501 has been selected by an operation by the user (S12).
When it is determined that the “good recording” key 501a is selected (S12—Yes), the control means 20 executes the “good recording” process (S13).

On the other hand, when it is determined that the “sound recording” key 501a is not selected (S12—No), the operation detection unit 22 of the control unit 20 performs “recording” displayed on the opening screen 501 by the user's operation. It is determined whether or not the “view” key 501e is selected (S14).
When it is determined that the “view recording” key 501e is selected (S14—Yes), the control means 20 executes a “view recording” process (S15).

On the other hand, when it is determined that the “view recording” key 501e is not selected (S14-No), the operation detection unit 22 of the control unit 20 performs another operation displayed on the opening screen 501 by the user's operation. It is determined whether or not the key (501b, 501c, 501d, 501f) has been selected (S16).
When it is determined that another key (501b, 501c, 501d, 501f) has been selected (S16-Yes), the control means 20 corresponds to the selected key (501b, 501c, 501d, 501f). The process is executed (S17).
On the other hand, when another key (501b, 501c, 501d, 501f) displayed on the opening screen 501 is not selected (S16-No), the process waits until any key is selected.

(2) “Good sound recording” processing When it is determined that the “good sound recording” key 501a displayed on the opening screen 501 is selected by the user's operation (S12-Yes in FIG. 17), the control means 20 A “sound recording” process is executed (S13).

The display control unit 21 of the control unit 20 displays the sound setting screen 502 on the display unit 13 (S20 in FIG. 18).
The operation detection unit 22 of the control unit 20 determines whether or not the “good night sound” key 502a displayed on the sound setting screen 502 is selected by the user's operation (S21).
When it is determined that the “good night sound” key 502a is selected (S21-Yes), the display control unit 21 of the control unit 20 displays the good night sound setting screen 503 on the display unit 13 (S22).
Then, “original sound” or “music sound” is selected as “good night sound” by the user's operation (S23). The selected “good night sound” is set by being stored in the storage unit 12 by the setting unit 23 of the control unit 20.

Thereafter, the operation detection unit 22 of the control unit 20 determines whether or not the “BACK” key 503f displayed on the good night sound setting screen 503 has been selected by the user's operation (S24).
When the “BACK” key 503f is not selected (S24-No), the state where the “night sound” can be selected is continued.
On the other hand, when it is determined that the “BACK” key 503f is selected (S24-Yes), the display control unit 21 of the control unit 20 displays the sound setting screen 502 on the display unit 13 (S20).

Whether the “refreshing sound” key 502b displayed on the sound setting screen 502 is selected by the user's operation in the state where the sound setting screen 502 is displayed on the display unit 13, in the operation detection unit 22 of the control unit 20. It is determined whether or not (S25).
When it is determined that the “fresh sound” key 502b is selected (S25-Yes), the display control unit 21 of the control means 20 displays the refreshing sound setting screen 504 on the display means 13 (S26).
Then, the “original sound” or “music sound” is selected as the “fresh sound” by the user's operation (S27). The selected “fresh sound” is set by being stored in the storage unit 12 by the setting unit 23 of the control unit 20.

Thereafter, the operation detection unit 22 of the control means 20 determines whether or not the “BACK” key 504f displayed on the sound setting screen 504 has been selected by the user's operation (S28).
When the “BACK” key 504f is not selected (S28—No), the state where “Refreshing sound” can be selected is continued.
On the other hand, when it is determined that the “BACK” key 504f is selected (S28-Yes), the display control unit 21 of the control unit 20 displays the sound setting screen 502 on the display unit 13 (S20).

Whether the “alarm” setting key 502c displayed on the sound setting screen 502 is selected by the user's operation in the state where the sound setting screen 502 is displayed on the display unit 13, in the operation detection unit 22 of the control unit 20. It is determined whether or not (S29).
When it is determined that the “alarm” setting key 502c is selected (S29-Yes), the display control unit 21 of the control unit 20 displays the alarm type setting screen 505 on the display unit 13 (S30).
Then, the “alarm sound” is selected by the user's operation (S31). The selected “alarm sound” is set by being stored in the storage unit 12 by the setting unit 23 of the control unit 20.

Thereafter, the operation detection unit 22 of the control unit 20 determines whether or not the “BACK” key 505f displayed on the alarm type setting screen 505 is selected by the user's operation (S32).
If the “BACK” key 505f is not selected (S32—No), the state where the “alarm sound” can be selected is continued.
On the other hand, when it is determined that the “BACK” key 505f has been selected (S32—Yes), the display control unit 21 displays the sound setting screen 502 on the display unit 13 (S20).

Whether or not the “OK” key 502e displayed on the sound setting screen 502 is selected by the user's operation in the state in which the sound setting screen 502 is displayed on the display unit 13. Is determined (S33).
When it is determined that the “OK” key 502e has been selected (S33—Yes), the control means 20 executes a “smooth mode” process (S34).
On the other hand, when it is determined that the “OK” key 502e is not selected (S33—No), the control means 20 selects one of the software keys displayed on the sound setting screen 502. Wait until

(3) “Good Mode” Processing The display control unit 21 of the control unit 20 displays the alarm time setting screen 506 on the display unit 13 (S40 in FIG. 19).
The “alarm time” is selected by operating the alarm time setting dial 506a by an operation by the user (S41).

Thereafter, the operation detection unit 22 of the control unit 20 determines whether or not the “OK” key 506b displayed on the alarm time setting screen 506 is selected by the user's operation (S42).
When the “OK” key 506b is not selected (S42—No), the state where the “alarm time” can be selected is continued.
On the other hand, when it is determined that the “OK” key 506b is selected (S42-Yes), the setting unit 23 of the control unit 20 stores the “alarm time” selected by operating the alarm time setting dial 506a. 12, the “alarm time” is set (S43), and the display control unit 21 of the control unit 20 causes the display unit 13 to display the sound mode start screen 507 (S44).

The operation detection unit 22 of the control unit 20 determines whether or not the “OK” key 507a displayed on the sound mode start screen 507 is selected by the user's operation (S45).
If it is determined that the “OK” key 507a is not selected (S45—No), the operation detection unit 22 waits until the “OK” key 507a is selected.
On the other hand, when it is determined that the “OK” key 507a is selected (S45-Yes), the display control unit 21 of the control unit 20 displays the sound mode execution screen 508 on the display unit 13 (S46).

The good night sound output control unit 24 of the control means 20 causes the sound output means 16 to output “good night sound”, which is a song set on the good night sound setting screen 503 (see FIG. 5) (S47).
Then, the good night sound output control unit 24 of the control means 20 stops the output of the “good night sound” after the set time has elapsed.

The body motion calculation unit 25 of the control unit 20 inputs the acceleration signal sent from the acceleration sensor 18, digitizes the value indicated by the acceleration signal, and stores it in the storage unit 12 as acceleration data (S48).
The recording unit 26 of the control unit 20 records the analog voice input by the voice input unit 15 by storing it in the storage unit 12 as a voice signal (S49).
The sound pressure calculation unit 27 of the control unit 20 extracts an analog audio signal from the storage unit 12, calculates the sound pressure of the audio signal, and stores it in the storage unit 12 as sound pressure data (S50).

The sound analysis unit 28 of the control unit 20 executes the voice recognition program stored in the storage unit 12, takes out an analog voice signal from the storage unit 12, analyzes the voice signal and converts it into character data, Character data is stored in the storage means 12 (S51).
The sleep depth calculation unit 29 of the control means 20 takes out the acceleration data and the sound pressure data from the storage means 12, calculates the sleep depth by adding the acceleration data and the sound pressure data, and calculates the sleep depth. The data is stored in the storage unit 12 (S52).

The operation detection unit 22 of the control means 20 determines whether or not the sound mode release key 508a displayed on the sound mode execution screen 508 is operated by an operation by the user (S53).
When it is determined that the sound mode release key 508a is not operated (S53-No), the alarm management unit 30 of the control unit 20 determines whether the current time has reached a predetermined time before the “wake-up time”. It is determined whether or not (S54).
When it is determined that the current time has not reached a predetermined time before the “wake-up time” (S54-No), the processing after S48 is executed.
On the other hand, when it is determined that the current time has reached a predetermined time before the “wake-up time” (S54—Yes), the alarm management unit 30 causes the sound output means 16 to output “fresh sound” ( S55).

The alarm management unit 30 of the control means 20 determines whether or not the current time has reached the “wake-up time” (S56).
When it is determined that the current time has not reached the “wake-up time” (S56-No), the process waits until the current time reaches the “wake-up time”.
On the other hand, when it is determined that the current time has reached the “wake-up time” (S56-Yes), the display control unit 21 causes the display means 13 to display the wake-up display screen 509 (S57). Then, the alarm management unit 30 of the control unit 20 outputs the “alarm sound” from the audio output unit 16 (S58).

The operation detection unit 22 of the control unit 20 determines whether or not the sound mode end confirmation key (wake up) 509a displayed on the wake-up display screen 509 has been operated by the user's operation (S59).
When it is determined that the sound mode end confirmation key (wakes up) 509a is not operated (S59-No), the operation detection unit 22 waits until the sound mode end confirmation key (wakes up) 509a is operated.
On the other hand, when it is determined that the sound mode end confirmation key (wakes up) 509a has been operated (S59-Yes), the display control unit 21 of the control unit 20 causes the display unit 13 to display the bedtime display screen 510. (S60).
Even when it is determined in S53 that the sound mode release key 508a has been operated (S53-Yes), the display control unit 21 causes the display unit 13 to display the bedtime display screen 510 (S60). ).

The operation detection unit 22 of the control unit 20 determines whether or not the “OK” key 510a displayed on the bedtime display screen 510 is operated by the user's operation (S61).
When it is determined that the “OK” key 510a is not operated (S61—No), the operation detection unit 22 stands by until the “OK” key 510a is operated.
On the other hand, when it is determined that the “OK” key 510a has been operated (S61—Yes), the display control unit 21 of the control unit 20 displays the opening screen 501 on the display unit 13 (S62).
This completes the “good mode” process.

  In addition, about acceleration data acquisition processing (S48), sound recording processing (S49), sound pressure data acquisition processing (S50), character data acquisition processing (S51), and sleep depth data calculation processing (S52), for example, “Refreshing sound Until the start of the output of "" or until the time when the "alarm time" is reached. However, if it is determined in S53 that the sound mode release key 508a has been operated (S53-Yes), the execution of these processes is terminated at this point.

(4) “View Recording” Process When it is determined that the “View Recording” key 501e displayed on the opening screen 501 is selected by the user's operation (S14—Yes in FIG. 17), the control means 20 Executes the “view recording” process (S15).

The display control unit 21 of the control unit 20 displays the date selection screen 511 on the display unit 13 (S70 in FIG. 20).
The operation detection unit 22 of the control unit 20 determines whether one date has been selected from the date list display unit 511a displayed on the date selection screen 511 by an operation by the user (S71).
When it is determined that one date is not selected (S71-No), the process waits until it is selected.
On the other hand, when it is determined that one date is selected (S71-Yes), the graph control unit 31 of the control unit 20 stores acceleration data and sound pressure data stored in association with the selected date. The sleep depth data is extracted from the storage unit 12 and converted into data for graph so that the display unit 13 displays the graph.
Further, the display control unit 21 of the control unit 20 causes the display unit 13 to display a graph display screen 512, displays a graph of acceleration data in the body movement graph display area 512b, and displays a graph of sound pressure data in a sleeping graph. The information is displayed in the area 512c, and the sleep depth data graph is displayed in the sleep depth display area 512a (S72).

The operation detection unit 22 of the control unit 20 determines whether or not the sleep display key 512e displayed on the graph display screen 512 is operated by the user's operation (S73).
When it is determined that the sleep display key 512e has not been operated (S73-No), it waits until it is selected.
On the other hand, when it is determined that the sleeping display key 512e has been operated (S73-Yes), the display control unit 21 of the control unit 20 causes the display unit 13 to display the sleeping history display screen 513 (S74).

The operation detection unit 22 of the control unit 20 determines whether or not one character data is selected from the sleeping list display unit 513a displayed on the sleeping history display screen 513 by an operation by the user (S75).
When it is determined that one character data is not selected (S75-No), the process waits until it is selected.
On the other hand, when it is determined that one character data has been selected (S75-Yes), the display control unit 21 of the control means 20 displays the sleeping word conversion character display screen 514 on the display means 13 and selects it. All of the character data converted from the audio signal corresponding to the character data thus displayed is displayed in the sleeping display area 514a (S76).

By executing the sleep behavior recording method having the above-described contents, the terminal device 10 can display information such as sleepiness and snoring, a user's turnover, a sleep depth, etc., emitted from a sleeping user. it can. In addition, it is possible to convert sleep words and snoring uttered by the user into characters and display them.
By enabling the terminal device 10 to realize such a function, the user of the terminal device 10 can know after waking up that he / she was snoring and sleeping during sleep. In addition, by visually recognizing the character data displayed on the display means 13 of the terminal device 10, it is possible to know the sleep that is uttered by the user as characters.

[Sleep behavior recording program]
Next, the sleep behavior recording program will be described.
The sleep behavior recording function (function for executing the sleep behavior recording method) of the terminal device 10 which is a computer in the above embodiment is stored in the storage means 12 (for example, ROM (Read Only Memory), hard disk, etc.). Realized by the sleep behavior recording program.

The sleep behavior recording program is stored in the control means 20 (CPU (Central
In other words, a command is sent to each component of the terminal device 10 to read a predetermined process, for example, a screen display process of the display means 13 in the terminal apparatus 10, a voice input process of the voice input means 15, and a body. Body motion calculation processing of the motion calculation unit 25, recording processing of the recording unit 26, sound pressure (speech value) calculation processing of the sound pressure calculation unit 27, speech conversion processing of the sound analysis unit 28, sleep depth of the sleep depth calculation unit 29 The sound calculation processing, the night sound output processing of the night sound output control unit 24, the refreshing sound output processing of the alarm management unit 30, the alarm sound output processing, and the like are performed.
Thus, the sleep behavior recording function is realized by the cooperation of the sleep behavior recording program that is software and each component of the computer (terminal device 10) that is hardware resources.

Note that the sleep / behavior recording program for realizing the sleep / behavior recording function is stored in a ROM, a hard disk, or the like, which is the storage unit 12 of the terminal device 10, or a computer-readable recording medium such as an external storage device It can be stored in a portable recording medium or the like.
An external storage device is a CD-ROM (Compact
A memory expansion device that incorporates a storage medium such as Disk-Read Only Memory and is externally connected to the terminal device 10. On the other hand, the portable recording medium is a recording medium that can be mounted on a recording medium driving device (drive device) and is portable, and refers to, for example, a flexible disk, a memory card, a magneto-optical disk, and the like.

A program recorded on the recording medium is stored in a RAM (Random Access) that is the storage unit 12 of the terminal device 10.
Memory) or the like and executed by the control means 20. By this execution, the function of the terminal device 10 of the above-described embodiment is realized.
Furthermore, when the sleep behavior recording program is loaded on the terminal device 10, the sleep behavior recording program held by another computer can be downloaded to its own RAM or an external storage device using a communication line. The downloaded sleep behavior recording program is also executed by the control means 20, and realizes the sleep behavior recording function of the terminal device 10 of the embodiment.

As described above, according to the terminal device, the sleep behavior recording method, and the sleep behavior recording program of the present embodiment, the subject who was sleeping himself / herself screamed and snored during sleep. I can know.
You can also learn about the specific words that were uttered.
On the other hand, in the technique described in Patent Document 1 described above, when it is determined whether the subject has snored, the determination device outputs a detection signal, and the height of the bed is determined based on the detection signal. The snoring was stopped by adjusting the weight and sliding the bed.
That is, in this technology, even if the determination device detects snoring, it has not been considered until the detection result is presented to the subject after waking up.
For this reason, the subject could not know that he had snored.
Further, the technique described in Patent Document 2 displays the pressure fluctuation indicated by the pressure information on the screen, and displays the pressure fluctuation in a waveform.
For this reason, it was impossible to know what kind of words the sleeping words uttered by the subject were specifically.

The preferred embodiments of the terminal device, sleep behavior recording method, and sleep behavior recording program of the present invention have been described above. However, the terminal device, sleep behavior recording method, and sleep behavior recording program according to the present invention are limited to the above-described embodiments. It goes without saying that various modifications can be made within the scope of the present invention.
For example, in the above-described embodiment, the terminal device is described as a portable information processing device typified by a smartphone or the like. However, the present invention is not limited to this, and the terminal device is mounted on a table, for example. It may be an information processing apparatus that is used by being placed on the floor or installed on the floor, specifically, a desktop personal computer or a notebook personal computer. In this case, an acceleration sensor for detecting the user's body movement can be provided outside the terminal device, and connected to the main body of the terminal device with a cable or the like.

Further, in the above-described embodiment, the terminal device records snoring and sleep that are uttered by the user of the terminal device. In other words, the target person who records snoring or the like is the user of the terminal device, but the target person is not limited to the user of the terminal device, and the person other than the user of the terminal device is the target person. You can also record sleep and sleep.
Further, in the above-described embodiment, when a sound such as snoring or sleep sound emitted from the subject is input, the sound pressure of this sound is calculated and displayed as a graph. However, the voice value that is data related to the input sound is not limited to the sound pressure, and may be, for example, the volume of the sound, the wavelength, frequency, and amplitude of the sound wave. Among these, when using the sound volume, the sound value calculation unit of the terminal device calculates the sound volume as a sound value, the graph control unit converts the sound volume to be graphable, and the display means The volume can be displayed as a graph on the graph display screen.

  Further, in the description of the sleep behavior recording method in the above-described embodiment, for convenience of explanation, the operation of the terminal device when the main software key is operated is described, and other software keys such as the “BACK” key are used. The explanation of the operation when operating was omitted. However, it goes without saying that when any one of the software keys displayed on the display means is operated, an operation corresponding to the operated software key is executed.

DESCRIPTION OF SYMBOLS 10 Terminal device 12 Memory | storage means 13 Display means 15 Audio | voice input means 16 Audio | voice output means (sound output means)
18 Acceleration sensor 20 Control means 25 Body motion calculation unit (body motion calculation means)
27 Sound pressure calculation unit (voice value calculation means)
28 Sound analysis unit (voice conversion means)
29 Sleep depth calculator (sleep depth calculator)
33 Sound output controller (sound output means)

Claims (5)

A terminal device provided with voice input means for inputting sound generated externally,
Storage means for storing a sound emitted from a subject in a sleeping state and input by the voice input means;
First graph display means for displaying a first graph in which the presence or absence of a sound stored in the storage means is shown in correspondence with the time when the object is emitted;
Second graph display means for displaying a second graph in which presence or absence of the subject's body motion is shown corresponding to the time when the body motion is detected;
Third graph display means for displaying a third graph in which the depth of sleep of the subject is shown corresponding to time;
With
The respective graphs are displayed side by side by the first graph display means, the second graph display means, and the third graph display means ,
Multiple alarm modes can be set,
In the first alarm mode, the sound input by the voice input means is stored,
A terminal device configured to not store a sound input by the voice input means in the second alarm mode . A terminal device provided with voice input means for inputting sound generated externally,
Storage means for storing a sound emitted from a subject in a sleeping state and input by the voice input means;
First graph display means for displaying a first graph in which the presence or absence of a sound stored in the storage means is shown in correspondence with the time when the object is emitted;
Second graph display means for displaying a second graph in which presence or absence of the subject's body motion is shown corresponding to the time when the body motion is detected;
Third graph display means for displaying a third graph in which the depth of sleep of the subject is shown corresponding to time;
Voice conversion means for converting the sound stored in the storage means into characters;
Character display means for displaying at least part of the characters converted by the voice conversion means;
Sound output means for reproducing and outputting the sound;
With
The respective graphs are displayed side by side by the first graph display means, the second graph display means, and the third graph display means ,
A first operation unit is disposed within a display frame of the first graph,
A second operation unit is disposed within a display frame of the character displayed by the character display means;
When the first operation unit is operated, the characters can be displayed by the character display means,
When the second operation unit is operated, a sound corresponding to the character displayed by the character display means can be output by the sound output means . The storage means stores a program for storing the sound emitted from the subject in a sleeping state,
The control means of the terminal device executes the program, stores the sound in the storage means,
The storage means stores the sound each time the program is executed, and stores the character corresponding to each sound,
The character display means displays, for each sound stored in the storage means for each execution of the program, a part of a character corresponding to the sound in a list in time order together with the stored time,
When one character is selected from one or more characters displayed in a list, the character display means displays all the characters converted from the sound corresponding to the selected character on the screen. The terminal device according to claim 2. A sleep behavior recording method comprising a process in which a voice input means of a terminal device inputs a sound generated outside the terminal device,
A process in which the storage means of the terminal device stores a sound emitted from a subject in a sleeping state and input by the voice input means;
A first graph display process in which the first graph display means of the terminal device displays a first graph in which the presence or absence of a sound stored in the storage means is indicated in correspondence with the time when the object is emitted;
A second graph display process in which the second graph display means of the terminal device displays a second graph in which the presence or absence of the subject's body movement is shown corresponding to the time when the body movement is detected;
A third graph display process in which the third graph display means of the terminal device displays a third graph in which the depth of sleep of the subject is shown corresponding to time;
Have
In the first graph display processing, the second graph display processing, and the third graph display processing, the respective graphs are displayed side by side ,
Multiple alarm modes can be set,
In the first wake-up mode, a process for storing the sound input by the voice input means;
A process of not storing the sound input by the voice input means in the second alarm mode;
Sleep behavior recording method characterized by having a. A sleep behavior recording program for causing the terminal device to execute a step of inputting sound generated outside the terminal device,
Memorizing sounds emitted from subjects who are asleep;
A first graph display step for displaying a first graph in which the presence or absence of the sound stored in the storing step is displayed corresponding to the time when the sound is emitted from the subject;
A second graph display step for displaying a second graph in which presence or absence of the subject's body movement is indicated corresponding to the time when the body movement is detected;
A third graph display step for displaying a third graph in which the depth of sleep of the subject is shown corresponding to time;
To the terminal device,
In the first graph display step, the second graph display step, and the third graph display step, the respective graphs are displayed side by side ,
Multiple alarm modes can be set,
Storing the sound input by the voice input means of the terminal device in the first alarm mode;
Not storing the sound input by the voice input means in the second alarm mode;
The terminal device executes the sleep behavior recording program.