JP6790386B2 - Control and audio equipment - Google Patents

Description

The present invention relates to a control device and an acoustic device.

Devices that control control targets such as electronic devices are known so that users can sleep comfortably.
Patent Document 1 describes a sleep timer that determines a timing to start lowering the volume of the output sound based on a time set by the user, and executes a fade-out operation to start lowering the volume of the output sound at that timing. Has been done.
In Patent Document 2, the biological information of the user is detected by a sensor, the sleeping state of the user is determined based on the biological information, and when it is determined that the user is in a sleeping state, the illuminance of lighting is lowered or audiovisual A sleeping device that reduces the sound output of the device is described.
In Patent Document 3, the brain wave of the user is detected, the alertness of the user is determined from the detection result, and when it is determined that the user is in a sleep state, the volume of music is reduced and the user is in a sleep state. A music playback device that stops the playback of music when it is determined to be present is described.

Jikkenhei 5-93120 Japanese Patent No. 2780436 JP-A-2015-130907

In the sleep timer described in Patent Document 1, the start timing of the fade-out operation is determined based on the time set by the user regardless of the sleep state of the user. Therefore, the volume of the output sound is increased in the sleep state of light sleep. May change. In this case, the user may notice the change in the volume and wake up.
In the sleeping device described in Patent Document 2 and the music playing device described in Patent Document 3, the volume of output sound and the illuminance of lighting change in a light sleep state. Therefore, even in this case, the user may wake up by noticing a change in the volume of the output sound or a change in the illuminance of the lighting.

The present invention has been made in view of the above circumstances, and an object of the present invention is to prevent a user who has fallen asleep from waking up.

One aspect of the control device of the present invention is a sleep onset detection unit that detects falling asleep based on biological information indicating the state of the user's living body, and a control when a predetermined time elapses from the time when the sleep onset detection unit detects sleep onset. It is provided with an adjusting unit that outputs a control signal for adjusting the control amount of the target to a predetermined value.
According to this aspect, the control amount of the controlled object is adjusted to a predetermined value when a predetermined time elapses from the time when the sleep onset detection unit detects the onset of sleep. Therefore, the control amount of the control target can be changed when the sleep depth becomes deeper than that at the time of falling asleep, and the user notices the change in the control amount as compared with the case where the control amount of the control target is changed at the time of falling asleep. It is possible to prevent the person from waking up.

In one aspect of the acoustic device of the present invention, a sleep onset detection unit that detects sleep onset based on biological information indicating the state of the user's living body, an output unit that outputs a sound signal whose amplitude is adjusted, and the sleep onset detection unit When it is detected that the sleep onset is detected, the amplitude of the sound signal is gradually reduced after maintaining the amplitude of the sound signal, and the amplitude of the sound signal becomes zero when a predetermined time elapses from the detection of the sleep onset. It is provided with a sound signal control unit that executes a fade-out process for controlling the output unit.
According to this aspect, when falling asleep is detected, the amplitude of the sound signal is gradually reduced after maintaining the amplitude of the sound signal. Therefore, when the sleep depth becomes deeper than that at the time of falling asleep, it is possible to start the operation of gradually reducing the volume of the sound according to the sound signal. Therefore, as compared with the case where the volume of the sound corresponding to the sound signal is gradually reduced from the time when the sleep onset is detected, it is possible to prevent the user from noticing the change in the volume and waking up.

One aspect of the audio apparatus of the present invention includes an estimation unit that estimates the depth of sleep based on biological information indicating the state of the user's living body, an output unit that outputs a sound signal with adjusted amplitude, and the estimation unit. When it is detected that the depth of sleep estimated in is a predetermined depth deeper than falling asleep, a fade-out process is executed to control the output unit so that the amplitude of the sound signal is gradually reduced to zero. It is provided with a sound signal control unit.
According to this aspect, when the depth of sleep reaches a predetermined depth deeper than falling asleep, a fade-out process is executed in which the output unit is controlled so that the amplitude of the sound signal is gradually reduced to zero. Therefore, as compared with the case where the volume of the sound corresponding to the sound signal is gradually reduced from the time when the sleep onset is detected, it is possible to prevent the user from noticing the change in the volume and waking up.

In one aspect of the audio device described above, when the sound signal control unit detects that the sleep depth estimated by the estimation unit has become shallow during the fade-out process, the sound signal control unit interrupts the fade-out process and the above-mentioned It is desirable to control the output unit so as to maintain the amplitude of the sound signal.
According to this aspect, since the change in volume can be stopped when the depth of sleep becomes shallow, it is possible to avoid the situation where the user who has become shallow in sleep notices the change in volume and wakes up.

In one aspect of the above-mentioned acoustic device, the sound signal control unit resumes the fade-out process when it detects that the depth of sleep estimated by the estimation unit has become deeper after interrupting the fade-out process. Is desirable.
According to this aspect, since the fade-out process is restarted in the state where the sleep is deepened, it is possible to prevent the user from noticing the restarted volume change and waking up.

In one aspect of the audio device described above, the sleep onset detection unit estimates the sleep depth based on the biological information, and when the sleep depth reaches a depth corresponding to the sleep onset, the sleep onset is performed. It is desirable that it is an estimation unit to detect.
According to this aspect, sleep onset can be detected according to the depth of sleep.

In one aspect of the above-mentioned acoustic device, a storage unit for storing a history of time changes in sleep depth estimated by the estimation unit is provided, and the sound signal control unit starts and ends the fade-out process. It is desirable to determine the time of the above with reference to the history of the time change of the sleep depth stored in the storage unit.
In one sleep, the depth of sleep changes cyclically. The sleep cycle, which is a periodic change in sleep depth, differs from user to user. According to this aspect, the history of time changes in sleep depth stored in the memory represents the user's past sleep cycle. Therefore, the time from the start to the end of the fade-out process can be adjusted according to the sleep cycle of the user. Therefore, it is possible to customize the time from the start to the end of the fade-out process according to the user.

In one aspect of the audio device described above, the power supply unit for supplying electric power to the output unit is provided, and the sound signal control unit is such that the power supply to the output unit is turned off when the fade-out process is completed. It is desirable to control.
According to this aspect, unnecessary power supply to the output unit in which the amplitude of the sound signal is zero can be stopped.

It is a figure which showed the system 1 including the acoustic apparatus 20 which concerns on 1st Embodiment. It is a figure which showed an example of the system 1. It is a figure which showed an example of a sleep cycle. It is a flowchart for demonstrating the operation of "aspect 1". It is a figure which showed the example of the amplitude Am1 of a sound signal in "aspect 1". It is a flowchart for demonstrating the operation of "aspect 2". It is a figure which showed the example of the amplitude Am2 of the sound signal in "aspect 2". It is a figure which showed the modification of 1st Embodiment. It is a figure which showed the system 1B including the audio apparatus 20B which concerns on 2nd Embodiment. It is a flowchart for demonstrating the operation of "aspect 3". It is a flowchart which showed the operation which interrupts and resumes a fade-out process. It is a figure which showed the example of the amplitude Am3 of the sound signal at the time of the operation shown in FIG. It is a flowchart for demonstrating the operation of "aspect 4". It is a figure which showed the example of the amplitude Am4 of a sound signal in "aspect 4". It is a figure which showed the modification of the 2nd Embodiment. It is a figure which showed the system 1D including the audio apparatus 20D which concerns on 3rd Embodiment. It is a flowchart for demonstrating the determination operation of the 1st fade-out processing time. It is a flowchart for demonstrating the 2nd fade-out processing time determination function. It is a figure which showed the modification of embodiment.

Hereinafter, the audio device 20 will be described as an example of the control device that adjusts the control amount of the controlled object to a predetermined value.
<First Embodiment>
FIG. 1 is a diagram showing an overall configuration of a system 1 including an audio device 20 according to a first embodiment to which the present invention is applied.
The system 1 includes a sensor 10, an acoustic device 20, and speakers 31 and 32. The system 1 causes the user E to listen to the sounds emitted from the speakers 31 and 32 so that the user E who is lying on the bed B at night can relax and sleep.
Then, in the system 1, when the user E falls asleep, it is possible that the sleep of the user E becomes deeper than that at the time of falling asleep so that the user E does not wake up due to the change in the volume. The sound output is stopped when the value becomes high.

The sensor 10 is, for example, a sheet-shaped piezoelectric element. The sensor 10 is arranged at the lower part of the mattress of the bed B or the like. When the user E lies on the bed B, the sensor 10 detects biological information indicating the state of the living body of the user E. The sensor 10 detects information including various movements of the user E's body due to the user E's respiration, heartbeat, body movement, etc. as biological information. As the sensor 10, a sensor mounted on a wearable device such as a wristwatch type and detecting the biological information of the user E may be used instead of the sheet-shaped piezoelectric element.

The audio device 20 acquires the biological information output from the sensor 10. The sound device 20 detects the sleep state (sleep state and sleep depth) of the user E based on this biological information.

The speakers 31 and 32 are arranged at positions where the user E in a lying position can hear the stereo sound. The speaker 31 amplifies the stereo left (L) signal output from the sound device 20 by the built-in amplifier and emits the sound. Similarly, the speaker 32 amplifies the stereo light (R) signal output from the sound device 20 by the built-in amplifier and emits the sound. Headphones may be used instead of the speakers 31 and 32.

FIG. 2 is a configuration diagram of a sensor 10, a speaker 30, and an audio device 20. In FIG. 2, the speakers 31 and 32 shown in FIG. 1 are collectively shown as the “speaker 30”.
The sound device 20 includes a CPU 101, a memory 102, a sound signal output unit 21, and a power supply unit 22. By reading and executing the control program stored in the memory 102, the CPU 101 realizes the functions as the biometric information acquisition unit 23, the sleep onset detection unit 24, and the sound signal control unit 25. The sound signal output unit 21 and the power supply unit 22 are each composed of hardware (for example, a sound signal output circuit and a power supply circuit). The biometric information acquisition unit 23, the sleep onset detection unit 24, and the sound signal control unit 25 may each be composed of hardware (for example, a biometric information acquisition circuit, a sleep onset detection circuit, and a sound signal control circuit). ..

The sound signal output unit 21 outputs a sound signal whose amplitude has been adjusted to the speaker 30. The speaker 30 outputs a sound corresponding to the sound signal. The speaker 30 increases the volume of sound according to the sound signal as the amplitude of the sound signal increases. The sound signal output unit 21 is an example of an output unit. The power supply unit 22 supplies electric power to the sound signal output unit 21.

The biological information acquisition unit 23 acquires biological information by receiving the biological information output by the sensor 10. As another method for the biological information acquisition unit 23 to acquire the biological information, a method for the biological information acquisition unit 23 to acquire the biological information from the sensor 10 may be used.

The sleep onset detection unit 24 detects the sleep onset of the user E based on the biological information acquired by the biological information acquisition unit 23. For the detection of falling asleep, for example, there are two detection modes described below.
The first detection mode is to detect falling asleep based on the body movement of the user E. Specifically, the sleep onset detection unit 24 detects falling asleep when the body movement such as turning over of the user E is stopped continuously for a certain period of time. As described above, the biological information includes not only the heartbeat and respiration but also the components of the body movement accompanying the body movement of the user E. The sleep onset detection unit 24 extracts a component of body movement accompanying the body movement of the user E from the biological information, and when the component continues for a certain period of time to be below a predetermined level, the sleep onset detection unit 24 detects sleep onset. .. Further, the sleep onset detection unit 24 may detect the onset of sleep by combining the body movement of the user E and the heartbeat cycle. In the process of falling asleep, the heartbeat cycle becomes longer and longer. Therefore, even if the sleep onset detection unit 24 detects falling asleep when the heartbeat cycle is extended by a predetermined time from the heartbeat cycle at the time of getting on the bed and the body movement component is kept below the predetermined level for a certain period of time. Good.

In the second detection mode, the sleep depth is estimated based on the biological information, and when the estimated sleep depth reaches a predetermined depth, falling asleep is detected.
Human sleep is roughly divided into light sleep REM sleep and deep sleep non-REM sleep. A person's sleep first shifts to non-REM sleep when falling asleep, and then to light sleep REM sleep. In human sleep, two types of sleep with different properties are repeated at a constant rhythm 4 to 5 times a night in a cycle of about 90 minutes. In this way, the depth of human sleep fluctuates in a cycle of about 90 minutes. In the following description, the time variation of sleep depth in overnight sleep is referred to as a sleep cycle.
FIG. 3 is a diagram showing an example of a sleep cycle.
In the example shown in FIG. 3, the sleep cycle from rest to deep sleep and waking up by the user E is shown by the sleep depth indicating the depth of sleep. In the example shown in FIG. 3, the sleep depth is set to "Getting out of bed", "Awakening Wake", "REM sleep REM", "1st stage ST1", "2nd stage ST2", "3rd stage ST3", and " It is shown in 7 stages of "4th stage ST4". These 7 levels of sleep depth are "Getting out of bed", "Awakening Wake", "REM sleep REM", "1st stage ST1", "2nd stage ST2", "3rd stage ST3", "4th stage ST4". It gets deeper in the order of. The seven levels of sleep depth are specified based on the biological information acquired by the biological information acquisition unit 23. The sleep onset detection unit 24 estimates the sleep depth using, for example, a heartbeat cycle extracted from biological information.

Based on the biometric information acquired by the biometric information acquisition unit 23, the sleep onset detection unit 24 detects a state in which the sleep depth of the user E reaches the first stage ST1 from the awake state as sleep onset. Therefore, the sleep onset detection unit 24 does not have to have a function of detecting whether or not the sleep depth of the user E is the second stage ST2, the third stage ST3, or the fourth stage ST4. When the sleep onset detection unit 24 does not have this detection function, the function of the sleep onset detection unit 24 can be simplified as compared with the sleep onset detection unit 24 having this detection function.
Although an example in which the depth of sleep is 7 stages is shown, the 1st stage ST1 and the 2nd stage ST2 are combined into one as "light sleep", and the 3rd stage ST3 and the 4th stage ST4 are regarded as "deep sleep". By combining them into one, the depth of sleep may be set to 5 levels. In this case, the sleep onset detection unit 24 detects a state in which the sleep depth of the user E reaches "light sleep" from the awake state based on the biometric information acquired by the biometric information acquisition unit 23 as sleep onset.

The sound signal control unit 25 controls the amplitude of the sound signal of the sound signal output unit 21 by using the sleep onset detection unit 24 as a trigger.
The control modes performed by the sound signal control unit 25 include the following "mode 1" and "mode 2".
"Aspect 1": The amplitude of the sound signal is changed to zero at a time to make the volume zero (silence, stop).
"Aspect 2": The amplitude of the sound signal is gradually reduced to reduce the volume (fade out).
In addition, aspect 1 and aspect 2 are independent of each other. That is, the sound signal control unit 25 controls the first aspect or the second aspect.

<Aspect 1>
First, "Aspect 1" will be described.
In the first aspect, the sound signal control unit 25 changes the amplitude of the sound signal of the sound signal output unit 21 to zero after a predetermined time (for example, 20 minutes) has elapsed from the time when the sleep onset detection unit 24 detects the sleep onset.

Here, the predetermined time will be described.
Sleep deepens after falling asleep. Therefore, by changing the amplitude of the sound signal to zero and making the volume zero when a predetermined time has passed from the time when the sleep onset is detected, the volume is increased when the sleep depth of the user E is deeper than that of the sleep onset. It will be possible to make changes. Therefore, the change in volume is less likely to be noticed by the user E.
In addition, it is generally said that a person goes into a deep sleep state about 15 to 20 minutes after falling asleep. Therefore, if the time required from when a person falls asleep to the deep sleep state (for example, the time of 15 to 20 minutes) is used as the predetermined time, the volume can be changed with high probability in the deep sleep state. , It becomes difficult for user E to notice the change in volume. The predetermined time is not limited to 15 minutes to 20 minutes and can be changed as appropriate.

Here, the sound signal control unit 25 outputs a control signal for adjusting the amplitude of the sound signal, which is the control amount of the control target, to a predetermined value when a predetermined time elapses from the time when the sleep onset detection unit 24 detects the sleep onset. Output to unit 21. The sound signal output unit 21 is an example of a control target, and zero amplitude is an example of a predetermined value. Further, the predetermined value is not limited to zero amplitude, and an amplitude smaller than the amplitude of the sound signal maintained from the detection of falling asleep until a predetermined time elapses may be used. Further, in the first aspect, the sound signal control unit 25 is an example of the adjustment unit.

Next, the operation of "Aspect 1" is performed.
FIG. 4 is a flowchart for explaining the operation of “Aspect 1”. In aspect 1, the operation shown in FIG. 4 is repeated.
In the following, as shown in FIG. 1, it is assumed that the user E lies on the bed B on which the sensor 10 is arranged, and the sound signal output unit 21 outputs a sound signal to the speaker 30. At this time, it is assumed that the sound signal output unit 21 outputs the sound signal to the speaker 30 in a state where the amplitude of the sound signal is constant.

When the biological information acquisition unit 23 acquires the biological information output from the sensor 10 (step S401), the biological information acquisition unit 23 outputs the biological information to the sleep onset detection unit 24.

When the sleep onset detection unit 24 receives the biological information from the biological information acquisition unit 23, the sleep onset detection unit 24 determines whether the user E has fallen asleep based on the biological information (step S402).
When the sleep onset detection unit 24 determines that the user E has fallen asleep (YES in step S402), the sleep onset detection unit 24 outputs the sleep onset information indicating the sleep onset to the sound signal control unit 25.

When the sound signal control unit 25 receives the sleep onset information from the sleep onset detection unit 24, the sound signal control unit 25 waits until a predetermined time (for example, 20 minutes) elapses after receiving the sleep onset information (NO in step S403). Specifically, when the sound signal control unit 25 receives the sleep onset information, it starts timing and waits until a predetermined time is reached.

When a predetermined time elapses after receiving the sleep onset information (YES in step S403), the sound signal control unit 25 controls the sound signal output unit 21 to reduce the amplitude of the sound signal output from the sound signal output unit 21 to zero. (Mute) (step S404).

FIG. 5 is a diagram showing an example in which the amplitude Am1 of the sound signal becomes zero at the timing tb when the predetermined time T10 elapses from the timing (sleep onset detection timing) ta when the sleep onset information is received.

On the other hand, if the sleep onset detection unit 24 does not detect sleep onset in step S402, the process shown in FIG. 4 is completed, and then the process shown in FIG. 4 is executed again.

According to the first aspect of the present embodiment, the sound signal control unit 25 changes the amplitude of the sound signal to zero when a predetermined time elapses from the time when the sleep onset detection unit 24 detects the onset of sleep. Therefore, it is possible to change the amplitude of the sound signal when the sleep depth becomes deeper than when falling asleep, and the user can change the amplitude of the sound signal as compared with the case where the amplitude of the sound signal is changed when falling asleep. It is possible to prevent the person from waking up by noticing the change in volume due to the change.

In the present embodiment, the sound signal control unit 25 maintains the amplitude of the sound signal from the sound signal output unit 21 until a predetermined time elapses after the sleep onset is detected.

<Aspect 2>
Next, "Aspect 2" will be described.
In the second aspect, when the sound signal control unit 25 detects that the sleep onset detection unit 24 has detected the onset of sleep, the sound signal control unit 25 gradually reduces the amplitude of the sound signal after maintaining the amplitude of the sound signal for a predetermined time from the time of detecting the onset of sleep For example, when 20 minutes have passed, a fade-out process for controlling the sound signal output unit 21 is executed so that the amplitude of the sound signal becomes zero. Hereinafter, the fade-out process executed in the second aspect will be referred to as a "first fade-out process".

Subsequently, the operation of "Aspect 2" is performed.
FIG. 6 is a flowchart for explaining the operation of “Aspect 2”. In aspect 2, the operation shown in FIG. 6 is repeated. In FIG. 6, the same reference numerals are given to the processes having the same contents as those shown in FIG. Hereinafter, among the processes shown in FIG. 6, the points different from the processes shown in FIG. 4 will be mainly described.

When the sound signal control unit 25 receives the sleep onset information from the sleep onset detection unit 24, the sound signal control unit 25 waits until the first hour elapses after receiving the sleep onset information (NO in step S601). Here, the first time may be a time shorter than the predetermined time described above. Further, the first time may be a fixed time, or may be changed by the sound signal control unit 25 within a time shorter than the above-mentioned predetermined time.

When the first time elapses after receiving the sleep onset information (YES in step S601), the sound signal control unit 25 controls the sound signal output unit 21 to gradually reduce the amplitude of the sound signal and reduce the amplitude of the sound signal. When the second time elapses from the start, the amplitude of the sound signal is set to zero (step S602). Here, the second time is a time obtained by subtracting the first time from the above-mentioned predetermined time. Therefore, the relationship of the first time + the second time = the predetermined time described above is established.

Of the processes shown in FIG. 6, the first fade-out process is configured in steps S601 and S602.

In FIG. 7, the amplitude Am2 of the sound signal is maintained from the timing of receiving the sleep onset information (sleep onset detection timing) ta to the first hour T11, and after the first hour T11 elapses, the amplitude of the sound signal is gradually reduced. It is a figure which showed the example which made the amplitude of the sound signal zero at the time point (timing tc) which the 2nd time T12 elapsed. The timing tc corresponds to the timing tb shown in FIG.
In the example shown in FIG. 7, the first fade-out process is executed in the period between the timing ta and the timing tk.

According to the second aspect of the present embodiment, when the sound signal control unit 25 detects that the sleep onset detection unit 24 has detected the onset of sleep, the sound signal control unit 25 gradually reduces the amplitude of the sound signal after maintaining the amplitude of the sound signal. When the sleep depth becomes deeper than the time, it is possible to start the operation of gradually reducing the volume of the sound according to the sound signal. Therefore, according to this aspect, the user notices the change in volume and wakes up as compared with the case where the amplitude of the sound signal is gradually reduced so that the volume is gradually reduced from the time when falling asleep is detected. Can be suppressed.

<Modified example of the first embodiment>
FIG. 1 shows an example in which the sensor 10 transmits biometric information to the acoustic device 20 by wired communication. However, as in the modified example shown in FIG. 8, the biometric information is transmitted to the acoustic device 20A via wireless communication. It may be transmitted. In FIG. 8, the same components as those shown in FIG. 2 are designated by the same reference numerals. Hereinafter, among the configurations shown in FIG. 8, the points different from the processing shown in FIG. 2 will be mainly described.
In the system 1A shown in FIG. 8, the sensor 10 transmits biometric information to the mobile terminal 40 having a wireless communication function by wire communication. The mobile terminal 40 wirelessly transmits the biological information received from the sensor 10 to the audio device 20A. The sound device 20A has a communication unit 26 in addition to the configuration of the sound device 20 shown in FIG. When the communication unit 26 receives the biometric information wirelessly transmitted from the mobile terminal 40, the communication unit 26 outputs the biometric information to the biometric information acquisition unit 23.
According to this modification, the audio device 20A can receive the biological information detected by the sensor 10 by wireless communication. In addition, instead of the mobile terminal 40, a device having a wireless communication function, for example, a PC (personal computer) may be used, or a wireless communication unit may be provided in the sensor 10 to directly communicate with the communication unit 26. Good.

<Second Embodiment>
FIG. 9 is a diagram showing a system 1B including an audio device 20B according to a second embodiment to which the present invention is applied. In FIG. 9, the same components as those shown in FIG. 2 are designated by the same reference numerals.

In the first embodiment, the sound signal output unit 21 is controlled by the detection of falling asleep by the falling asleep detection unit 24 as a trigger. On the other hand, in the second embodiment, instead of the sleep onset detection unit 24, the estimation unit 27 that estimates the sleep depth of the user E is used, and the sound signal output unit 21 controls based on the estimation result of the estimation unit 27. Will be done. Hereinafter, the sound device 20B will be described focusing on the differences from the sound device 20 shown in FIG.

The sound device 20B is different from the sound device 20 in that it has an estimation unit 27 instead of the sleep onset detection unit 24 and a sound signal control unit 25B instead of the sound signal control unit 25. The sound device 20B includes a CPU 101B, a memory 102B, a sound signal output unit 21, and a power supply unit 22. The CPU 101B realizes the functions as the biological information acquisition unit 23, the estimation unit 27, and the sound signal control unit 25B by reading and executing the control program stored in the memory 102B. The biological information acquisition unit 23, the estimation unit 27, and the sound signal control unit 25B may each be composed of hardware (for example, a biological information acquisition circuit, an estimation circuit, and a sound signal control circuit).

The estimation unit 27 estimates the sleep depth (sleep depth) of the user E based on the biometric information acquired by the biometric information acquisition unit 23. In the following, it is assumed that the estimation unit 27 estimates which of the seven levels of sleep depth shown in FIG. 3 is the sleep depth of the user E based on the biological information.

The sound signal control unit 25B controls the amplitude of the sound signal of the sound signal output unit 21 based on the estimation result of the estimation unit 27.
The control modes performed by the sound signal control unit 25B include the following "mode 3" and "mode 4".
"Aspect 3": The amplitude of the sound signal is controlled by using a trigger when the depth of sleep reaches a depth corresponding to falling asleep. In the following, the first stage ST1 is used as the depth corresponding to falling asleep.
"Aspect 4": The amplitude of the sound signal is controlled by using a trigger when the depth of sleep reaches a predetermined depth deeper than falling asleep. In the following, the second stage ST2 is used as a predetermined depth deeper than falling asleep.
It should be noted that aspects 3 and 4 are independent of each other. That is, the sound signal control unit 25B controls the third aspect or the fourth aspect.

<Aspect 3>
In the third aspect, when the sound signal control unit 25B estimates the depth corresponding to falling asleep (first stage ST1), in other words, the estimation unit 27 detects the falling asleep, as described in the above-described second aspect. The first fade-out process is executed.

Next, the operation of "Aspect 3" will be described.
FIG. 10 is a flowchart for explaining the operation of “Aspect 3”. In aspect 3, the operation shown in FIG. 10 is repeated. In FIG. 10, the same reference numerals are given to the processes having the same contents as those shown in FIG. In the process shown in FIG. 10, step S1001 is executed instead of step S402 shown in FIG. Hereinafter, among the processes shown in FIG. 10, the points different from the processes shown in FIG. 6 will be mainly described.

When the estimation unit 27 receives the biometric information from the biometric information acquisition unit 23, the estimation unit 27 estimates the sleep depth of the user E based on the biometric information. Subsequently, the estimation unit 27 determines whether the sleep depth of the user E is the first stage ST1 (step S1001).
When the sleep depth of the user E is the first stage ST1 (YES in step S1001), the estimation unit 27 outputs the sleep onset information to the sound signal control unit 25B. Upon receiving the sleep onset information, the sound signal control unit 25B executes steps S601 and S602.

On the other hand, if the sleep depth of the user E is not the first stage ST1 in step S1001, the process shown in FIG. 10 is completed, and then the process shown in FIG. 10 is executed again.

The transition of the amplitude of the sound signal in the third aspect is the same as the transition of the amplitude Am2 shown in FIG.

According to the third aspect of the present embodiment, when the sound signal control unit 25B detects that the estimation unit 27 has detected falling asleep, the sound signal amplitude is gradually reduced after maintaining the amplitude of the sound signal. When the sleep depth becomes deeper than that, the operation of gradually reducing the volume of the sound according to the sound signal can be started. Therefore, according to this aspect, the user notices the change in volume and wakes up as compared with the case where the amplitude of the sound signal is gradually reduced so that the volume is gradually reduced from the time when falling asleep is detected. Can be suppressed.

<Modified example of aspect 3 of this embodiment>
In the third aspect of the present embodiment, the estimation unit 27 can estimate the sleep depth of the user E after the sleep onset is detected. Therefore, the sound signal control unit 25B can perform control according to the sleep depth by obtaining the estimation result of the estimation unit 27.

Therefore, when the sound signal control unit 25B detects that the sleep depth estimated by the estimation unit 27 has become shallow during the first fade-out process, the sound signal control unit 25B interrupts the first fade-out process and changes the amplitude of the sound signal. The sound signal output unit 21 may be controlled so as to maintain the sound signal output unit 21. In this case, since the change in volume can be stopped when the depth of sleep becomes shallow, it is possible to avoid the situation where the user who has become shallow in sleep notices the change in volume and wakes up.

Further, the sound signal control unit 25B may restart the first fade-out process when it detects that the depth of sleep estimated by the estimation unit 27 has become deeper after interrupting the first fade-out process. In this case, since the first fade-out process is restarted in a state where the sleep is deepened, it is possible to prevent the user from waking up noticing the restarted volume change.

In FIG. 11, when the depth of sleep becomes shallow during the process of gradually reducing the amplitude of the sound signal (hereinafter referred to as “amplitude reduction process”) in the first fade-out process, the amplitude reduction process is interrupted. After that, it is a flowchart for demonstrating an example of the process which restarts the amplitude reduction process when the depth of sleep becomes deep.
It is assumed that the estimation unit 27 sequentially outputs the estimation result of the sleep depth to the sound signal control unit 25B.

When the sound signal control unit 25B starts the amplitude reduction process (step S1101), the sleep depth indicated by the latest estimation result of the estimation unit 27 is a reference for interrupting the amplitude reduction process (hereinafter referred to as "first reference"). ) Is shallower than the depth of sleep (step S1102). As the first criterion, for example, the second stage ST2 is used. The first criterion is not limited to the second stage ST2 and can be changed as appropriate.

When the sleep depth indicated by the latest estimation result becomes shallower than the first reference (second stage ST2) (YES in step S1102), the sound signal control unit 25B interrupts the amplitude reduction process (step S1103). For example, when the sleep depth changes from the second stage ST2 to the first stage ST1, the sound signal control unit 25B interrupts the amplitude reduction process.

Subsequently, in the sound signal control unit 25B, the sleep depth indicated by the latest estimation result of the estimation unit 27 is higher than the sleep depth that serves as a reference (hereinafter referred to as “second reference”) for restarting the amplitude reduction process. It is determined whether it has become deeper (step S1104). As the second criterion, for example, the second stage ST2 is used. The second criterion is not limited to the second stage ST2 and can be changed as appropriate. Further, the second criterion does not have to be the same stage (sleep depth) as the first criterion.

When the sleep depth indicated by the latest estimation result is not deeper than the second reference (NO in step S1104), the sound signal control unit 25B returns the process to step S1103 and continues to interrupt the amplitude reduction process.
On the other hand, when the sleep depth indicated by the latest estimation result is deeper than the second reference (YES in step S1104), the sound signal control unit 25B resumes the interrupted amplitude reduction process (step S1105). ..

Subsequently, the sound signal control unit 25B determines whether the amplitude of the sound signal is zero (step S1106).
The sound signal control unit 25B returns the process to step S1102 if the amplitude of the sound signal is not zero (NO in step S1106), while YES if the amplitude of the sound signal is zero (YES in step S1106). ), The amplitude reduction process is completed. Here, ending the amplitude reduction processing means ending the fade-out processing.

If the sleep depth indicated by the latest estimation result is not shallower than the first reference (NO in step S1102), the sound signal control unit 25B proceeds to the process in step S1106.

In FIG. 12, the amplitude reduction process is started after the lapse of the first time T11 from the timing of receiving the sleep onset information (sleep onset detection timing) ta, and then the sleep depth of the user E becomes shallower than the first reference at the timing td. After that, it is a figure which showed the example of the amplitude Am3 of the sound signal in the situation where the sleep depth of the user E became deeper than the 2nd reference by the timing te.
As shown in FIG. 12, at the timing td when the sleep depth of the user E becomes shallower than the first reference, the amplitude reduction processing is interrupted, and at the timing te when the sleep depth of the user E becomes deeper than the second reference. Amplitude reduction processing is restarted.

<Aspect 4> (second fade-out process)
Next, "Aspect 4" will be described.
In the fourth aspect, when the sound signal control unit 25B detects that the sleep depth estimated by the estimation unit 27 has reached a predetermined depth deeper than falling asleep (for example, the second stage ST2), the sound signal is transmitted. A fade-out process (hereinafter referred to as "second fade-out process") for controlling the sound signal output unit 21 so that the amplitude is gradually reduced to zero is executed.

Subsequently, the operation of "Aspect 4" will be described.
FIG. 13 is a flowchart for explaining the operation of “Aspect 4”. In aspect 4, the operation shown in FIG. 13 is repeated. In FIG. 13, the same reference numerals are given to the processes having the same contents as those shown in FIG. Hereinafter, among the processes shown in FIG. 13, the points different from the processes shown in FIG. 4 will be mainly described.

When the estimation unit 27 receives the biometric information from the biometric information acquisition unit 23, the estimation unit 27 estimates the sleep depth of the user E based on the biometric information. Subsequently, the estimation unit 27 outputs the estimation result of the sleep depth of the user E to the sound signal control unit 25B.
Upon receiving the estimation result of the estimation unit 27, the sound signal control unit 25B determines whether the estimation result indicates the second stage ST2 (step S1301).
When the estimation result of the estimation unit 27 indicates the second stage ST2 (YES in step S1301), the sound signal control unit 25B controls the sound signal output unit 21 so that the amplitude of the sound signal is gradually reduced to zero. The second fade-out process is executed (step S1302).
On the other hand, when the estimation result of the estimation unit 27 does not indicate the second stage ST2 (NO in step S1301), the process shown in FIG. 13 is completed, and then the process shown in FIG. 13 is executed again.

FIG. 14 shows that the amplitude Am4 of the sound signal is gradually reduced from the timing tf that received the estimation result indicating the second stage ST2, and the amplitude Am4 of the sound signal is set to zero when the third time T13 elapses (timing tg). It is a figure which showed an example.
In the example shown in FIG. 14, the second fade-out process is executed in the period between the timing tf and the timing tg.

According to the fourth aspect of the present embodiment, when the sleep depth becomes a predetermined depth deeper than the sleep onset, the sound signal output unit 21 is controlled so that the amplitude of the sound signal is gradually reduced to zero. The fade-out process is executed. Therefore, as compared with the case where the volume of the sound corresponding to the sound signal is gradually reduced from the time when the sleep onset is detected, it is possible to prevent the user from noticing the change in the volume and waking up.

Also in this aspect, according to the modified example of the third aspect of the present embodiment, the sound signal control unit 25B detects that the sleep depth estimated by the estimation unit 27 becomes shallow during the second fade-out process. , The sound signal output unit 21 may be controlled so as to interrupt the second fade-out process and maintain the amplitude of the sound signal. Further, the sound signal control unit 25B may restart the second fade-out process when it detects that the depth of sleep estimated by the estimation unit 27 has become deeper after interrupting the second fade-out process.

<Modified example of the second embodiment>
Also in the second embodiment, biometric information may be transmitted to the audio device 20C via wireless communication, for example, as in the modified example shown in FIG. In FIG. 15, the same components as those shown in FIGS. 8 and 9 are designated by the same reference numerals. In the system 1C shown in FIG. 15, the mobile terminal 40 wirelessly transmits the biological information received from the sensor 10 to the audio device 20C. The sound device 20C has a communication unit 26 in addition to the configuration of the sound device 20 shown in FIG. In addition, instead of the mobile terminal 40, a device having a wireless communication function, for example, a PC (personal computer) may be used, or a wireless communication unit may be provided in the sensor 10 to directly communicate with the communication unit 26. Good.

<Third Embodiment>
The estimation result of the estimation unit 27 included in the second embodiment represents the sleep pattern of the user E. Therefore, by using the history of the estimation result of the estimation unit 27 (the past estimation result of the estimation unit 27), it is possible to obtain the average sleep pattern of the user E.
In addition, if the sound is heard when the user E is in a deep sleep state, the quality of sleep may deteriorate and the feeling of awakening the next morning may not be good.
In the third embodiment to which the present invention is applied, the first fade-out is performed by using the history of the estimation result of the estimation unit 27 so that the sound is more likely to be zero when the user E goes into deep sleep. Determine the processing time and the second fade-out processing time.

FIG. 16 is a diagram showing a system 1D including an audio device 20D according to a third embodiment to which the present invention is applied. In FIG. 16, the same reference numerals are given to those having the same configuration as that shown in FIG. Hereinafter, the audio apparatus 20D will be mainly described as being different from the audio apparatus 20B shown in FIG.

The sound device 20D differs from the sound device 20B in that it has a storage unit 28 and has a sound signal control unit 25D instead of the sound signal control unit 25B. The sound device 20D includes a CPU 101D, a memory 102D, a sound signal output unit 21, a power supply unit 22, and a storage unit 28. The CPU 101D realizes the functions as the biological information acquisition unit 23, the estimation unit 27, and the sound signal control unit 25D by reading and executing the control program stored in the memory 102D. The biological information acquisition unit 23, the estimation unit 27, and the sound signal control unit 25D may each be composed of hardware (for example, a biological information acquisition circuit, an estimation circuit, and a sound signal control circuit).

The storage unit 28 stores the history of the time change of the sleep depth estimated by the estimation unit 27. This history shows the past sleep pattern of user E.
In addition to the functions of the sound signal control unit 25B, the sound signal control unit 25D sets the time from the start to the end of the first or second fade-out process as the depth of sleep stored in the storage unit 28. It has a function of deciding by referring to the history of time change (hereinafter referred to as "decision function").

FIG. 17 is a flowchart for explaining a determination function for determining the first fade-out processing time.
The sound signal control unit 25D executes the determination process shown in FIG. 17 from the time when YES in step S1001 shown in FIG. 10 to before the execution of step S601.

The sound signal control unit 25D reads the history of the transition time from the first stage ST1 to the third stage ST3 from the storage unit 28 (step S1701).
For example, when the storage unit 28 stores the estimation results for 20 days estimated by the estimation unit 27 for the sleep of the user E, the sound signal control unit 25D sets the sleep state of the user E to the first stage ST1. Information on the time (transition time) required to transition from to the third stage ST3 is read for 20 days. The sound signal control unit 25D does not have all the estimation results stored in the storage unit 28, but a plurality of estimation results (from the first stage ST1 to the third stage ST3) in the order of newest among all the estimation results. The required transition time) may be read.

Subsequently, the sound signal control unit 25D determines the average of the transition times required from the read first stage ST1 to the third stage ST3 as the first fade-out time (step S1702).

Subsequently, the sound signal control unit 25D executes steps S601 and S602 shown in FIG. At this time, the sound signal control unit 25D determines the first time and the second time so that the total time of the first time and the second time coincides with the first fade-out time determined in step S1702. ..

FIG. 18 is a flowchart for explaining a determination function for determining the second fade-out processing time.
The sound signal control unit 25D executes the determination process shown in FIG. 18 from the time when YES in step S1301 shown in FIG. 13 to before the execution of step S1302.

The sound signal control unit 25D reads the history of the transition time from the second stage ST2 to the third stage ST3 from the storage unit 28 (step S1801).
For example, when the storage unit 28 stores the estimation results for 40 days estimated by the estimation unit 27 for the sleep of the user E, the sound signal control unit 25D sets the sleep state of the user E to the second stage ST2. Information on the time (transition time) required to transition from to the third stage ST3 is read for 40 days. The sound signal control unit 25D does not have all the estimation results stored in the storage unit 28, but a plurality of estimation results (from the second stage ST2 to the third stage ST3) in the order of newest among all the estimation results. The required transition time) may be read.

Subsequently, the sound signal control unit 25D determines the average of the transition times required from the second stage ST2 to the third stage ST3 read in step S1801 as the second fade-out time (step S1802).

Subsequently, the sound signal control unit 25D executes step S1302 shown in FIG. At this time, the sound signal control unit 25D sets the time of the second fade-out process performed in step S1302 as the second fade-out time determined in step S1802.

According to the present embodiment, the storage unit 28 stores the history of the time change of the sleep depth estimated by the estimation unit 27, and the sound signal control unit 25D is the time from the start to the end of the fade-out process. Is determined with reference to the history of the time change of the sleep depth stored in the storage unit 28.
The history of the time change of the sleep depth stored in the storage unit 28 represents the past sleep pattern of the user E. Therefore, the time from the start to the end of the fade-out process can be adjusted according to the sleep pattern of the user. Therefore, it is possible to customize the time from the start to the end of the fade-out process according to the user E. Therefore, it is possible to reduce the phenomenon that the sound is produced when the user E is in a deep sleep state, the sleep quality of the user E deteriorates, and the feeling of awakening in the next morning is not good.

The storage unit 28 shown in the present embodiment is provided in the modified example of the second embodiment shown in FIG. 15, and the sound signal control unit shown in the present embodiment is used instead of the sound signal control unit 25B of the modified example. 25D may be used.

<Modification example>
The present invention is not limited to the above-described embodiment, and for example, various applications and modifications as described below are possible. In addition, the following deformation modes may be appropriately combined with one or more arbitrarily selected deformations.

<Modification example 1>
In each of the above-described embodiments, the sound signal control unit 25, the sound signal control unit 25B, and the sound signal control unit 25D set the amplitude of the sound signal output from the sound signal output unit 21 to zero, and then the sound signal output unit 21. The power supply unit 22 may be controlled so as to turn off the power supply to the power supply unit 22. For example, the sound signal control unit 25, the sound signal control unit 25B, and the sound signal control unit 25D set the amplitude of the sound signal output from the sound signal output unit 21 to zero, and then send the sound to the power supply unit 22 and the sound from the power supply unit 22. A stop instruction for stopping the power supply to the signal output unit 21 is output to turn off the power supply from the power supply unit 22 to the sound signal output unit 21.

<Modification 2>
In the above-described embodiment, the sound signal control unit 25 outputs a control signal that adjusts the amplitude of the sound signal, which is the control amount of the control target, to a predetermined value (for example, zero) when a predetermined time elapses from the time when falling asleep is detected. did. The controlled amount of the controlled object of the present invention is not limited to the amplitude of the sound signal and can be changed as appropriate.
FIG. 19 shows an example in which the external device 301 is used as the control target. In FIG. 19, the same components as those shown in FIG. 2 are designated by the same reference numerals.
For example, when the external device 301 shown in FIG. 19 is a lighting device or a fan, the lighting device or the fan is an example of a control target. When a lighting device is used as a control target, for example, the illuminance of the lighting device is used as a control amount, and the illuminance as a setting target is an example of a predetermined value. When a fan is used as a control target, for example, the air volume of the fan is used as the control amount, and the air volume as a setting target is an example of a predetermined value. In these cases, the illuminance and air volume to be set targets do not necessarily have to be zero.

<Modification example 3>
In the second embodiment described above, the sound signal control unit 25B keeps the amplitude of the sound signal constant until the estimation result of the estimation unit 27 shows a predetermined depth deeper than falling asleep (for example, the third stage ST3). If the value is maintained and the estimation result of the estimation unit 27 shows the predetermined depth, the amplitude of the sound signal may be set to zero. The predetermined depth deeper than falling asleep is not limited to the third stage and can be changed as appropriate.

<Modification example 4>
In each of the above-described embodiments, a mat-shaped piezoelectric element has been exemplified as the sensor 10 for detecting biological information, but the present invention is not limited thereto. For example, it may be a motion sensor using a camera that detects the movement of an object. In this case, the motion sensor outputs a signal indicating the movement of the body of the user E as biological information. Then, the sleep onset detection unit 24 may detect the onset of sleep when the movement of the user E's body is continuously stopped for a period of time based on the biological information.
Further, a plurality of sensors may be used as the sensor 10. For example, the electrode of the first sensor may be attached to the forehead of the user E to detect the brain wave (α wave, β wave, δ wave, θ wave, etc.) of the user E. Further, a second sensor may be attached to the wrist of the user E to detect, for example, a pressure change in the radial artery, that is, a pulse wave. Since the pulse wave is synchronized with the heartbeat, it means that the heartbeat is indirectly detected. Further, a third sensor for detecting acceleration may be provided between the head of the user E and the pillow to detect the body movement of the user E, specifically, respiration or heartbeat. Further, as a type of sensor for detecting biological information, there are a pressure sensor, an air pressure sensor, a vibration sensor, an optical sensor, an ultrasonic doppler, an RF doppler, a laser doppler and the like.

1 ... System, 10 ... Sensor, 20 ... Sound device, 21 ... Sound signal output unit, 22 ... Power supply unit, 23 ... Biological information acquisition unit, 24 ... Sleep detection unit, 25 ... Sound signal control unit, 30 ... Speaker.

Claims (5)

An estimation unit that estimates the depth of sleep based on biological information indicating the state of the user's living body and detects the sleep onset when the sleep depth reaches a depth corresponding to the onset of sleep .
An output unit that outputs a sound signal with adjusted amplitude,
When the estimation unit detects that the sleep onset has been detected, the amplitude of the sound signal is gradually reduced after maintaining the amplitude of the sound signal, and when a predetermined time elapses from the detection of the sleep onset, the sound signal is transmitted. A sound signal control unit that executes a fade-out process that controls the output unit so that the amplitude becomes zero, and
A storage unit that stores the history of time changes in sleep depth estimated by the estimation unit,
Bei to give a,
The sound signal control unit determines the time from the start to the end of the fade-out process with reference to the time change history of the sleep depth stored in the storage unit.
Audio equipment. An estimation unit that estimates the depth of sleep based on biological information that indicates the state of the user's living body,
An output unit that outputs a sound signal with adjusted amplitude,
When it is detected that the sleep depth estimated by the estimation unit has reached a predetermined depth deeper than falling asleep, the output unit is controlled to fade out so that the amplitude of the sound signal is gradually reduced to zero. The sound signal control unit that executes processing and
Equipped with a,
When the sound signal control unit detects that the sleep depth estimated by the estimation unit has become shallow during the fade-out process, the sound signal control unit interrupts the fade-out process and maintains the amplitude of the sound signal. Control the output unit,
Audio equipment. The sound device according to claim 2 , wherein the sound signal control unit resumes the fade-out process when it detects that the depth of sleep estimated by the estimation unit has become deeper after interrupting the fade-out process. A storage unit that stores the history of time changes in sleep depth estimated by the estimation unit is provided.
The sound signal control unit determines the time from the start to the end of the fade-out process with reference to the time change history of the sleep depth stored in the storage unit.
The acoustic device according to claim 2 . A power supply unit that supplies electric power to the output unit is provided.
When the fade-out process is completed, the sound signal control unit controls the power supply unit so as to turn off the power supply to the output unit.
The acoustic device according to any one of claims 1 to 4 .

Images