JP2011059419A - Reproduction speed synchronizing device, reproduction speed synchronizing method, data structure of content with breath distribution, program and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To control feeling such as feeling of viewer's togetherness and presence to a content, by controlling a reproduction speed of the content according to breath of a content viewer. <P>SOLUTION: By using the content with breath distribution including content information corresponding to each reproduction position along a time axis, and breath target information for specifying a breath state determined for each breath target setting position which is at least a part of reproduction position, the reproduction speed is set so that the breath state specified by the breath target information corresponding to any of the breath target setting position, becomes closer to the breath state of the viewer when the content information corresponding to the breath target setting position is restored. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a content reproduction technique, and more particularly, to a technique for synchronizing a content reproduction position with a viewer's breathing.

  It has been reported that the viewer's breathing tempo is induced based on the tempo of content that progresses along the time axis such as music content (see, for example, Non-Patent Documents 1 and 2). . Utilizing the phenomenon of breathing into this content, for example, inventions and product developments that induce viewers' breathing based on the music tempo have been carried out. For example, in the apparatus disclosed in Non-Patent Document 3, the time length of the presentation sound is changed for the purpose of guiding or converging to a certain target respiratory tempo.

F. HAAS, S. Distenfeld and K. Axen, “Effects of perceived musical rhythm on respiratory pattern,” J. Appl Physiol, 1986, 61, pp. 1185-1191 Toshie Nakamura, “About“ between ”and breathing in music,” Acoustical Society of Japan Acoustical Society, 1994, MA94, 16 “RESPeRATE TO LOWER BLOOD PRESSURE”, [online], [searched August 26, 2009], Internet <http://www.resperate.com/us/discover/resperatedemo>

  On the other hand, from the phenomenon that breathing is drawn into the content described above, it is considered that the synchronization of the scene with the content and the viewer's breathing is related to the sense of unity and realism of the content. However, what has been studied in the past is only a method for setting the tempo of content such as a music tempo for the purpose of guiding or converging to a preset breathing tempo as a target. A method of synchronizing the content tempo with the breathing of the viewer of the content, not the induction or convergence of the respiratory tempo, has not been studied so far. In other words, the conventional technology does not assume the psychological influence on the viewer due to the relationship between the scene of the content and the viewer's breathing. Accordingly, it does not control the degree of synchronization (correlation) by changing the playback speed of the content.

  The present invention has been made in view of these points, and controls the playback speed of the content in accordance with the breathing of the content viewer, and controls the viewer's sense of unity and realism. The purpose is to provide a technology that can do this.

  In the present invention, content information corresponding to each reproduction position along the time axis and respiration target information for specifying a respiration state predetermined for each respiration target setting position which is at least a part of the reproduction position The content with respiratory distribution is stored in the storage unit, and the respiratory index for specifying the viewer's respiratory state is extracted from the respiratory information obtained by measuring the viewer, and either respiratory target setting Reproduction speed information is obtained such that the respiration state specified by the respiration target information corresponding to the position approaches the respiration state of the viewer at the time when the content information corresponding to the respiration target setting position is reproduced, and the replay speed Reproduction information for sequentially reproducing each piece of content information corresponding to each reproduction position at the reproduction speed specified by the information is output.

  In the present invention, the breathing state specified by the breathing target information corresponding to any one of the breathing target setting positions is brought closer to the viewer's breathing state at the time when the content information corresponding to the breathing target setting position is reproduced. Since the playback speed is set, the content playback speed is controlled in accordance with the breathing of the viewer of the content, and the viewer's sense of unity and realism can be controlled.

FIG. 1 is a block diagram for illustrating the functional configuration of the playback speed synchronization apparatus. FIG. 2 is a graph illustrating the respiration level V (t) output from the respiration measurement unit. FIG. 3 is a diagram for explaining an example of the predicted value of the expiration start time. FIG. 4 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the first embodiment. FIG. 5 is a flowchart for illustrating the playback speed synchronization method. FIG. 6 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the second embodiment. FIG. 7 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the third embodiment. FIG. 8A is a diagram for explaining an example of a respiratory index calculated by the respiratory index extraction unit of the third embodiment. FIG. 8B is a diagram illustrating the relationship among the respiratory index φ (t1), the respiratory target information Φ (p (t1)), and L (t1). FIGS. 9A to 9C are diagrams for explaining a specific example of the function D [L]. FIG. 10 is a flowchart for illustrating the playback speed synchronization method. FIG. 11 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the fifth embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

〔Definition of terms〕
Terms are defined as follows:

  Content: Sound information and video information for viewing purposes, such as various music, voice, movies, movies and television programs.

  Content information: Information that constitutes content and is sequentially played back along the time axis.

  Reproduction position: means the reproduction position of each piece of content information that is sequentially reproduced along the time axis, that is, the progress position on the time axis in content reproduction. More specifically, for example, the frame position, sample point, time code, song position pointer, etc. correspond to the playback position.

  Blank information (blank): means information that is reproduced in the first section that is temporally before the content information that is subject to viewing and is not subject to viewing. Examples of blank information include information indicating the silent state of the section before the music starts playing and the pause section between the music and the black screen or sandstorm screen before the start of playback of movie content such as a movie Information indicating (sandstorm).

  Null information (null): means empty information. For example, content information that is null information means that content information does not exist.

  Respiratory target setting position: means a predetermined reproduction position at least in part.

  Respiratory state: Means each state during a breathing exercise performed periodically. More specifically, for example, an exhalation start state that is a state at the time of starting an exhalation exercise, an exhalation state at each time point during the exhalation exercise, an expiration end state that is a state at the time of ending the exhalation exercise, an inspiration An inhalation start state, which is a state at the time of starting, an inhalation state at each point in time during the inspiratory motion, an inhalation end state, which is a state at the end of the inspiratory motion, and the like correspond to the respiratory state.

  Respiration information: Information obtained by measuring the breathing state of content viewers. More specifically, it means, for example, the length around the chest or the abdomen, the respiratory airflow, the temperature difference between exhaled air and inhaled air.

  Reproduction speed: means the reciprocal of the time required from reproducing the content information at a certain reproduction position A to reproducing the content information at the next reproduction position B. This is a concept that can be read as the playback tempo or clock interval.

[First Embodiment]
Next, a first embodiment of the present invention will be described.

<Configuration>
FIG. 1 is a block diagram for illustrating the functional configuration of the playback speed synchronization apparatus.

  As illustrated in FIG. 1, the playback speed synchronization apparatus 1 of the first embodiment includes an input unit 11, a storage unit 12 that stores content 12 a with respiratory distribution, a respiratory measurement unit 13, and a respiratory index extraction unit 14. A playback speed calculation unit 15, a content playback speed control unit 16, a playback unit 17, and a control unit 19.

[Input unit 11]
The input unit 11 is a functional unit that receives input of the content 12a with respiratory distribution. Examples of the input unit 11 include an input port, an input interface, a reading device, and a receiving device.

[Contents 12a with respiratory distribution]
The content with respiratory distribution 12a is for specifying content information corresponding to each reproduction position along the time axis and a respiratory state predetermined for each respiration target setting position which is at least a part of the reproduction position. And data having a data structure including respiratory target information.

  In this example, the sample point is the playback position, the MIDI data indicating the pitch and the intensity of the sound is the content information, and the sample point (respiration target sample point) that is desirable as the time to start exhalation exercise is the respiration target setting position. The exhalation start state is set as a predetermined respiration state at the respiration target sample point, and information for specifying the exhalation start state at the respiration target sample point is used as the respiration target information. For example, the content with respiratory distribution 12a illustrated in FIG. 4 includes content information d (τ) that is MIDI data indicating the pitch and intensity corresponding to each sample point τ along the time axis, and expiratory motion. This is data having a data structure including respiration target information Bpe (μ) for specifying an expiration start state defined for each respiration target sample point, which is a desirable sample point as a start time. Here, the sample point τ in this example is an integer greater than or equal to 0, and a larger value corresponds to a later time. The respiration target information Bpe (μ) in this example indicates a sample point τ (respiration target sample point) corresponding thereto. For example, the value of the respiration target information Bpe (μ) determined for the respiration target sample point τ = 100 is 100. μ is an index given for convenience of explanation, and is a continuous integer of 0 or more for identifying each respiration target information Bpe (μ). A larger value μ corresponds to later respiratory target information in time. In addition, in the content 12a with respiratory distribution illustrated in FIG. 4, the content information corresponding to each sample point τ to be reproduced is sequentially reproduced while the sample points τ to be reproduced are sequentially updated along the time axis. The update cycle of the sample point τ to be reproduced is called a sample update interval, and a standard set value of a predetermined sample update interval is set to S0.

[Storage unit 12]
The storage unit 12 is an information storage device such as a magnetic recording device, an optical disc, a magneto-optical recording medium, or a semiconductor memory.

[Respiration measurement unit 13]
The respiration measurement unit 13 is a well-known device that measures the respiration state of the content viewer 100 and outputs respiration information obtained thereby. In the example of this embodiment, information (respiration level) corresponding to the length around the chest and the abdomen is used as respiration information, and a device that detects respiration from a resistance change of a rubber tube wound around the chest or abdomen (for example, Nippon Koden TR-753T manufactured by AD and MLT1132 manufactured by ADInstruments are used as the respiratory measurement unit 13. The respiration measuring unit 13 in this example measures and outputs a respiration level V (t) at a certain set cycle T1. Note that t is an integer index corresponding to a discrete time, and “time t” means a time corresponding to the integer index t. V (t) represents the respiration level at time t.

  FIG. 2 is a graph illustrating the respiration level V (t) output from the respiration measurement unit.

  In the example of FIG. 2, the respiration level V (t) becomes maximum at the exhalation start time (bpe (n-1), etc.) that is the time when exhalation starts, and the respiration level V (t) decreases as the exhalation state progresses The breathing level V (t) becomes minimal at the inhalation start time (bpi (n), etc.), which is the time when inspiration starts, and the breathing level V (t) increases as the inspiratory state progresses, and the next exhalation starts A state in which the respiration level V (t) is maximized again at time (bpe (n), etc.) is repeated periodically.

[Respiration index extraction unit 14]
The respiratory index extraction unit 14 is a processing unit configured by, for example, a predetermined program being read into a CPU (central processing unit). The breathing index extraction unit 14 extracts a breathing index for specifying the viewer's breathing state from the breathing information obtained by measuring the viewer, and outputs the breathing index. The breathing index extraction unit 14 of the example of this embodiment receives the breathing level V (t) output from the breathing measurement unit 13 as an input, and indicates the latest exhalation start time of the viewer as the measurement target from the time t. The predicted value pbpe (n) is output as a respiratory index. Here, n is an index given for convenience of explanation, and is an integer corresponding to the number of breaths of the viewer.

  FIG. 3 is a diagram for explaining an example of the predicted value of the expiration start time.

  The predicted exhalation start time pbpe (n) can be obtained, for example, by estimating the latest past respiratory cycle viewed from the current time t = t1 as the latest future respiratory cycle viewed from the time t = t1. . That is, the predicted value pbpe (n) of the expiration start time can be calculated as follows, for example.

pbpe (n) = bpe (n-1) + (bpe (n-1) -bpe (n-2))
= 2 ・ bpe (n-1) -bpe (n-2)… (1)
Where bpe (n-1) is the most recent past exhalation start from time t calculated using respiration levels V (t1), V (t1-1), V (t1-2), ... Bpe (n-2) is the exhalation start time bpe (n-1) calculated using the respiration levels V (t1), V (t1-1), V (t1-2), ... ) Represents the most recent exhalation start time. More specifically, for example, the time corresponding to the maximum value of the most recent respiratory level seen from time t = t1 is bpe (n-1), and the latest respiratory level seen from the expiration start time bpe (n-1) is set. The time corresponding to the maximum value is bpe (n-2) (see FIG. 2).

[Reproduction speed calculation unit 15]
The reproduction speed calculation unit 15 is, for example, a processing unit configured by reading a predetermined program into the CPU. The reproduction speed calculation unit 15 receives the respiration target information and the respiration index, and the respiration state specified by the respiration target information corresponding to one of the respiration target setting positions is the content information corresponding to the respiration target setting position. Set the playback speed when sequentially playing the content information corresponding to each playback position along the time axis so as to approach the viewer's breathing state at the time of playback, and specify the set playback speed Output playback speed information. In other words, the playback speed calculation unit 15 is configured to display the breathing state specified by the breathing target information corresponding to one of the breathing target setting positions and the viewer's point in time when the content information corresponding to the breathing target setting position is played back. The content playback speed is set so that the correlation with the breathing state is high. Note that the set playback speed is not a speed for inducing the viewer's breathing, but a speed for synchronizing the progress of content with the viewer's breathing.

  FIG. 4 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the first embodiment.

  The playback speed calculation unit 15 of this embodiment sets the playback speed of the content by determining the sample update interval. Further, the reproduction speed calculation unit 15 of this embodiment determines the sample update interval S (t) every time the respiration measurement unit 13 obtains the respiration level V (t), that is, the period T1, and uses this as the reproduction speed information. Output. Here, p (t) represents a sample point τ corresponding to the content information reproduced at time t. Hereinafter, the process of the reproduction speed calculation unit 15 will be exemplified with reference to FIG.

  It is assumed that the reproduction up to the content information d (p (t1)) corresponding to the sample point τ = p (t1) is completed at the time t = t1. At this time, the nearest future respiratory target sample point is Bpe (m) (μ = m) from the sample point τ = p (t1) included in the content 12a with respiratory distribution, and the respiratory index at time t = t1 Assume that the predicted value (respiration index) of the expiration start time output from the unit 14 is pbpe (n). In this case, the playback speed calculation unit 15 extracts from the predicted value pbpe (n) of the expiration start time that is the respiratory index output from the respiratory index extraction unit 14 and the content 12 a with respiratory target distribution stored in the storage unit 12. The breath target sample point Bpe (m) and the sample point τ = p (t1) are input, and the predicted value pbpe (n) of the expiration start time is used as content information d ( The sample update interval S (t1) is calculated and output as follows so that the reproduction time of τ) approaches.

S (t1) = (pbpe (n) -t1) / (Bpe (m) -p (t1))… (2)
That is, the playback speed calculation unit 15 sets the sample update interval S (t1) such that the sample point to be played is updated from p (t1) to Bpe (m) from time t1 to time pbpe (n). The sample update interval S (t1) is output as reproduction speed information.

[Content playback speed control unit 16]
The content playback speed control unit 16 is, for example, a processing unit configured by reading a predetermined program into the CPU. The content playback speed control unit 16 receives the playback speed information and the content information, and outputs playback information for sequentially playing back each piece of content information corresponding to each playback position at the playback speed specified by the playback speed information. To do.

  The content playback speed control unit 16 of this embodiment is extracted from the sample update interval S (t1) that is the playback speed information output from the playback speed calculation unit 15 and the content 12a with a respiratory target distribution stored in the storage unit 12. Content information d (τ) is input, and the content information d (τ) corresponding to the sample point τ to be reproduced is reproduced while updating the sample point τ to be reproduced at the sample update interval S (t1). Reproduction information r (τ) (acoustic signal etc.) is sequentially output. For example, the content playback speed control unit 16 updates the content point d (τ) corresponding to the sample point τ to be reproduced while updating the sample point τ to be reproduced at the sample update interval S (t1). Are sequentially extracted, and reproduction information r (τ) for reproducing the extracted content information d (τ) is sequentially output.

[Playback unit 17]
The reproduction unit 17 is a known presentation device that includes, for example, an amplifier, a speaker, and an image display device. The playback unit 17 receives the playback information r (τ) output from the content playback speed control unit 16 and outputs content such as acoustic information specified by the playback information r (τ).

[Control unit 19]
The control unit 19 is, for example, a processing unit configured by reading a predetermined program into the CPU. The control unit 19 controls the entire processing of the reproduction speed synchronization apparatus 1.

<Method>
Next, the playback speed synchronization method of this embodiment will be exemplified.

  FIG. 5 is a flowchart for illustrating the playback speed synchronization method.

  First, the content 12a with respiratory distribution is input to the input unit 11 (step S11) and stored in the storage unit 12 (step S12).

  The breathing measurement unit 13 attached to the viewer 100 measures the breathing state of the viewer 100 at a cycle T1, and the breathing levels V (t1), V (t1-1), V ( t1-2),... are output (step S13). The breathing levels V (t1), V (t1-1), V (t1-2),... Are input to the breathing index extracting unit 14, and the breathing index extracting unit 14 sets the expiration start time according to the equation (1). The predicted value pbpe (n) (respiration index) is calculated, and the predicted value pbpe (n) of the exhalation start time is output (step S14). Next, the control part 19 determines whether the respiration level by the required time was measured (step S14-2). In the present embodiment, the control unit 19 determines whether or not the respiratory level up to the time when one expiration start time (bpe (1)) can be specified has been measured. Here, when it is determined that the respiratory level up to the required time has not been measured, the process returns to step S13.

  On the other hand, when it is determined that the respiratory level up to the required time has been measured, the playback speed calculation unit 15 stores the predicted value pbpe (n) of the expiration start time output from the respiratory index extraction unit 14 and the storage unit 12. Sample respiration target sample point Bpe (m) and sample point τ = p (t1) extracted from the respirated target distribution content 12a are input, and sample update interval S (t1) (reproduction speed information) according to equation (2) Is calculated and output (step S15).

  The content playback speed control unit 16 includes the sample update interval S (t1) output from the playback speed calculation unit 15, the content information d (τ) extracted from the content 12a with the respiratory target distribution stored in the storage unit 12, and Is input, and the reproduction information r (τ) for reproducing the content information d (τ) corresponding to the sample point τ to be reproduced is sequentially updated while updating the sample point τ to be reproduced at the sample update interval S (t1). Output (step S16).

  The playback unit 17 receives the playback information r (τ) output from the content playback speed control unit 16 and outputs the content specified by the playback information r (τ) (step S17).

  Next, it is determined whether or not it is time t = t1 + 1 when the respiration measurement unit 13 measures a new respiration level V (t1 + 1) (step S18). Here, when it is determined that it is not the time t = t1 + 1 at which the new respiration level V (t1 + 1) is measured, the process returns to step S16. On the other hand, when it is determined that the time t = t1 + 1 at which the new respiration level V (t1 + 1) is measured, the control unit 19 then includes all the content information d ( It is determined whether or not the reproduction of [tau] has been completed (step S19).

  Here, when it is determined that the reproduction of all the content information d (τ) has not been completed, t1 + 1 is set as a new t1 and the process returns to step S13. On the other hand, if it is determined that the reproduction of the content information d (τ) has been completed, the process ends.

[Second Embodiment]
The second embodiment is a modification of the first embodiment. The content with respiratory distribution of the second embodiment further includes a synchronization importance that is a coefficient corresponding to each reproduction position, and the reproduction speed calculation unit of the second embodiment further receives the synchronization importance and inputs each synchronization importance. For each reproduction position corresponding to the degree, a reproduction speed depending on the synchronization importance corresponding to the reproduction position is determined.

  In the second and subsequent embodiments, the description will focus on matters that are different from the first embodiment, and descriptions of items that are common to the first embodiment will be omitted. The same reference numerals are used for the same processing units and processing steps, and the description is not repeated.

<Configuration>
As illustrated in FIG. 1, the playback speed synchronization apparatus 2 according to the second embodiment includes an input unit 21, a storage unit 22 that stores content 22 a with respiratory distribution, a respiratory measurement unit 13, and a respiratory index extraction unit 14. A playback speed calculation unit 25, a content playback speed control unit 16, a playback unit 17, and a control unit 19.

[Input unit 21, storage unit 22, content with respiratory distribution 22a]
The input unit 21 is a functional unit that receives an input of the content 22a with respiratory distribution, and the storage unit 22 stores the content 22a with respiratory distribution. The content 22a with respiratory distribution is used for specifying content information corresponding to each playback position along the time axis and a respiratory state predetermined for each respiratory target setting position that is at least a part of the playback position. This is data having a data structure including respiratory target information and synchronization importance that is a coefficient corresponding to each reproduction position. Here, the synchronization importance indicates the importance of the breathing target information corresponding to the reproduction position corresponding to the synchronization importance. That is, the greater the importance of synchronization, the greater the importance of synchronizing the breathing target information corresponding to the reproduction position corresponding thereto with the breathing of the viewer 100 when the content information corresponding to the reproduction position is reproduced. Take a large value. In the case of the second embodiment, it is desirable that the synchronization importance is set to a value between 0 and 1.

  For example, the content 22a with respiratory distribution illustrated in FIG. 6 includes content information d (τ) which is MIDI data indicating the pitch and the sound intensity corresponding to each sample point τ (reproduction position) along the time axis. In addition to the breathing target information Bpe (μ) for specifying the breathing start state defined for each breathing target sample point, which is a desirable sample point as the time point when the expiration movement is started, and further, at each sample point τ The data has a data structure including the synchronization importance α (τ), which is a corresponding coefficient.

[Reproduction speed calculation unit 25]
The reproduction speed calculation unit 25 is a processing unit configured, for example, by reading a predetermined program into the CPU. The reproduction speed calculation unit 25 receives the breathing target information, the synchronization importance, and the breathing index, and the breathing state specified by the breathing target information corresponding to any one of the breathing target setting positions corresponds to the breathing target setting position. For each playback position corresponding to each synchronization importance level, a playback speed that depends on the synchronization importance level corresponding to the playback position is set and set so as to approach the viewer's breathing state at the time when the content information is played back. Playback speed information for specifying the playback speed is output.

  FIG. 6 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the second embodiment.

  The reproduction speed calculation unit 25 outputs the respiratory target extracted from the breath target distribution with the predicted respiratory rate pbpe (n) output from the respiratory index extraction unit 14 and the respiratory target distribution content 22 a stored in the storage unit 22. The sample point Bpe (m), the synchronization importance α (p (t1)) and the sample point τ = p (t1) are input, and the synchronization importance α (p (t1)) of the sample point τ = p (t1) The sample update interval S (t1) is set so that the reproduction time of the content information d (τ) corresponding to the breath target sample point Bpe (m) approaches the predicted value pbpe (n) of the expiration start time. Calculate as follows.

S (t1) = α (p (t1)) {(((pbpe (n) -t1) / (Bpe (m) -p (t1)))-S0} + S0… (3)
Here, S0 is a preset standard setting value of the sample update interval, and α (p (t1)) {((pbpe (n) -t1) / (Bpe (m) -p (t1)))- S0} is a change amount of the sample update interval. That is, when the synchronization importance α (p (t1)) is 1, the playback speed calculation unit 25 sets the sample point to be played back from p (t1) to Bpe between time t1 and time pbpe (n). A sample update interval S (t1) that is updated up to (m) is calculated. On the other hand, when the synchronization importance α (p (t1)) is 0 or more and less than 1, the playback speed calculation unit 25 determines that the change amount of the sample update interval with respect to the standard setting value S0 is the synchronization importance α (p (t1)). A sample update interval S (t1) smaller than that in the case of 1 is calculated. In particular, when the synchronization importance α (p (t1)) is 0, S (t1) = S0.

<Method>
Next, the playback speed synchronization method of this embodiment will be illustrated with reference to FIG.

  The difference from the first embodiment is that, instead of the processing of steps S11 and S12, the content 22a with respiratory distribution is input to the input unit 21 (step S21) and stored in the storage unit 22 (step S22). Instead of the processing of step S15, the reproduction speed calculation unit 25 uses the predicted value pbpe (n) of the expiration start time output from the respiratory index extraction unit 14 and the content 22a with a respiratory target distribution stored in the storage unit 22. The extracted respiration target sample point Bpe (m), synchronization importance α (p (t1)) and sample point τ = p (t1) are input, and the sample update interval S (t1) (reproduction speed) according to equation (3) Information) is calculated and output (step S25). Others are the same as the first embodiment.

[Modification of First and Second Embodiments]
The respiratory index extraction unit 14 of the first and second embodiments calculates the predicted value pbpe (n) of the expiration start time according to the equation (1). However, the respiration index extraction unit applies a mathematical model to the respiration level V (t), and predicts the future respiration level V (t) from the current time t = t1 (the future value illustrated in FIG. 4). (The dotted line indicating the respiratory level V (t)) may be calculated, and the predicted value pbpe (n) of the expiration start time may be calculated using the predicted value of the respiratory level V (t).

  For example, when the AR model is used as a mathematical model, the predicted value PV of the future respiratory level is calculated from the respiratory level V (t), V (t-1), V (t-2), ... at time t. (t + 1) can be obtained as follows.

PV (t + 1) = a + a0 ・ V (t) + a1 ・ V (t-1) + a2 ・ V (t-2) + ... + aj ・ V (tj)… (4)
Here, a, a0, a1,..., Aj are prediction coefficients obtained by linear prediction analysis. Each of the prediction coefficients a, a0, a1,..., Aj minimizes the energy of the difference (prediction residual) between the predicted value PV (t + 1) of the respiratory level and the actual respiratory level V (t + 1). Selected as The calculation of each prediction coefficient a, a0, a1,..., Aj may be performed by a sequential method such as the Levinson-Durbin method or the Burg method, As in the covariance method, it may be performed by solving simultaneous equations (simultaneous equations having a linear prediction coefficient that minimizes the prediction residual) for each prediction order ("Takehiro Moriya," speech coding "See The Institute of Electronics, Information and Communication Engineers, 1998", "Mikio Hino," Spectrum Analysis ", Asakura Shoten, 1979"). J is an integer of 0 or more. j may be a constant or a variable.

Here, the predicted value PV (t1 + 1) of the respiration level at time t = t1 + 1 is obtained by applying Equation (4) to the current time t = t1. Further, by setting this PV (t1 + 1) as V (t1 + 1) and applying equation (4) to time t = t1 + 1, the predicted value PV of the respiratory level at time t = t1 + 2 (t1 + 2) is obtained. By repeating such processing and applying Equation (4) k times (k is an integer of 2 or more), the predicted value PV (t of each respiratory level from time t = t1 + 1 to t = t1 + k ) Is obtained. And for example, every time a new respiration level prediction is calculated by applying equation (4) while increasing k by 1.
PV (t1 + k-1) -PV (t1 + k-2)> 0… (5)
(PV (t1 + k) -PV (t1 + k-1)) ・ (PV (t1 + k-1) -PV (t1 + k-2)) <0… (6)
Whether or not both of these expressions are satisfied is determined, and the predicted value pbpe (n) of the expiration start time is obtained by the following expression using k when these expressions are satisfied for the first time.

    pbpe (n) = t1 + k-1 (7)

<Method>
Next, the playback speed synchronization method of this embodiment will be illustrated with reference to FIG.
The difference from the first embodiment is that, instead of determining whether or not the breathing level up to the time when the control unit 19 can specify one exhalation start time (bpe (1)) is measured in step S14-2, It is determined whether or not j + 1 respiratory levels V (t) have been measured. If No, the process returns to Step S13, and if Yes, the process proceeds to Step S15 (S25).

[Third Embodiment]
This embodiment is a modification of the first and second embodiments. The respiratory target information and the respiratory index of the third embodiment are information for specifying the phase of the periodic respiratory motion, respectively, and the reproduction speed calculation unit of the third embodiment is in any respiratory target setting position. Playback that specifies a playback speed such that the difference between the phase specified by the corresponding breathing target information and the phase specified by the breathing index at the time when the content information corresponding to the breathing target setting position is played back becomes small Output speed information.

<Configuration>
As illustrated in FIG. 1, the playback speed synchronization device 3 of the third embodiment includes an input unit 31, a storage unit 32 that stores content 32 a with respiratory distribution, a respiratory measurement unit 13, and a respiratory index extraction unit 34. A playback speed calculation unit 35, a content playback speed control unit 16, a playback unit 17, and a control unit 19.

[Input unit 31, storage unit 32, content 32a with respiratory distribution]
The input unit 31 is a functional unit that receives input of content with respiratory distribution 32a, and the storage unit 32 stores content with respiratory distribution 32a. The content with respiratory distribution 32a is for specifying content information corresponding to each reproduction position along the time axis and a respiratory state predetermined for each respiration target setting position which is at least a part of the reproduction position. Breathing target information. The difference from the first and second embodiments is that the respiratory target information is information for specifying the phase of the periodic respiratory motion.

  For example, the content 32a with respiratory distribution illustrated in FIG. 7 includes content information d (τ) that is MIDI data indicating the pitch and the sound intensity corresponding to each sample point τ (playback position) along the time axis. , Information Φ (τ) (respiration target information), which is determined for all sample points τ (respiration target setting position), for specifying a desirable “period of respiratory motion” at each sample point τ; , Data having a data structure including synchronization importance α (τ). A specific example of the respiratory target information Φ (τ) of this embodiment will be described later.

[Respiration index extraction unit 34]
The respiratory index extraction unit 34 is a processing unit configured by, for example, a predetermined program being read into the CPU. The respiratory index extraction unit 34 extracts information for specifying the phase of the periodic respiratory motion of the viewer as a respiratory index from the respiratory information obtained by measuring the viewer, and outputs the respiratory index. is there.

  FIG. 8A is a diagram for explaining an example of a respiratory index calculated by the respiratory index extraction unit of the third embodiment.

  There is no particular limitation on what value is used as “information for specifying the phase of the viewer's periodic respiratory motion”. In the following, the polar coordinate declination in the space (phase space) of the Cartesian coordinate system with the respiratory level V (t) as the value of the first dimension and the delay value V (t-γ) as the value of the second dimension. Used as “information for identifying the phase of the viewer's periodic respiratory movement (respiration index φ (t))”. In this case, the processing corresponding to the time t of the respiratory index extraction unit 34 is as follows, for example.

  1. The respiration level V (t) at time t output from the respiration measurement unit 13 is set as the first dimension value of the phase space.

  2. Let the respiration level V (t-γ) obtained by passing the respiration level V (t) through the time delay filter be the second-dimensional value of the phase space. Here, γ is the delay width of the time delay filter, and in the case of breathing, about 200 ms to 800 ms is desirable.

  3. The deviation angle when the point (V (t), V (t-γ)) in the orthogonal coordinate system of the phase space is displayed in polar coordinates is obtained as the respiratory index φ (t) and output (see FIG. 8A). .

  When such a value is used as the respiratory index φ (t), the desired respiratory index φ (t) at each predetermined sample point τ is the respiratory target information Φ (τ) ( As shown in FIG. 7, it is set to the content 32a with respiratory distribution.

[Reproduction speed calculation unit 35]
The reproduction speed calculation unit 35 is, for example, a processing unit configured by reading a predetermined program into the CPU. The reproduction speed calculation unit 35 is specified by the phase specified by the respiration target information corresponding to one of the respiration target setting positions and the respiration index at the time when the content information corresponding to the respiration target setting position is reproduced. Reproduction speed information for specifying a reproduction speed such that the difference from the phase is small is output.

  FIG. 7 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the third embodiment.

  The playback speed calculation unit 35 of this embodiment sets the playback speed of the content by determining the sample update interval. In addition, the reproduction speed calculation unit 35 of this embodiment determines the sample update interval S (t) every time the respiration measurement unit 13 obtains the respiration level V (t), that is, the period T1, and uses this as the reproduction speed information. Output.

  It is assumed that the reproduction up to the content information d (p (t1)) corresponding to the sample point τ = p (t1) is completed at the time t = t1. At this time, the respiration target information corresponding to the sample point τ = p (t1) included in the content 32a with respiration distribution is Φ (p (t1)), and is output from the respiration index unit 34 at time t = t1. Assume that the respiratory index (information for specifying the phase of the viewer's periodic respiratory motion) is φ (t1). The reproduction speed calculation unit 35 receives the respiration index φ (t1) and the respiration target information Φ (p (t1)) as input, and the angle formed by these in the phase space of FIG. Obtained with a sign.

R (t1) = φ (t1) -Φ (p (t1)) (8)
If | R (t1) |> π then L (t1) = R (t1) -Sgn (R (t1)) ・ 2π else L (t1) = R (t1)… (9)
However, Sgn (δ) is a sign function, and the function value is Sgn (δ) =-1 when δ <0, Sgn (δ) = 0 when δ = 0, and δ> 0. Sometimes Sgn (δ) = 1. When L (t1)> 0, the viewer's breathing has progressed more than the breath indicated by the breathing target information at time t1, and when L (t1) <0, the viewer's breathing has been at the breathing target at time t1. It is later than the breath indicated by the information. FIG. 8B illustrates the relationship between the respiratory index φ (t1), the respiratory target information Φ (p (t1)), and L (t1). FIG. 8B shows an example of L (t1) <0.

  Then, the playback speed calculation unit 35 calculates the sample update interval S (t1) at time t1 as follows, and outputs this as playback speed information.

S (t1) = S0 / {α (p (t1)) ・ C ・ L (t1) +1}… (10)
Here, S0 is a standard setting value of a predetermined sample update interval, and C is an arbitrary constant that satisfies C> 0. For example, if the constant C is determined so that α (p (t)) · C · L (t) +1> 0 for all possible α (τ) and L (t), the playback speed When the viewer's breathing is more advanced than the breathing indicated by the breathing target information (L (t1)> 0), the calculation unit 25 calculates a sample update interval S (t1) larger than S0, and the viewer's breathing Is synchronized with the breath indicated by the respiratory target information (L (t1) = 0), the sample update interval S (t1) equal to S0 is calculated, and the viewer's breath is delayed from the breath indicated by the respiratory target information If so (L (t1) <0), a sample update interval S (t1) smaller than S0 is calculated.

<Method>
Next, the playback speed synchronization method of this embodiment will be illustrated with reference to FIG.

  The difference from the first embodiment is that instead of the processing of steps S11 and S12, the content 32a with respiratory distribution is input to the input unit 31 (step S31) and stored in the storage unit 32 (step S32). Instead of the process of step S14, the respiratory index extraction unit 34 receives a respiratory level V (t) as an input, and calculates a respiratory index φ (t) that is information for specifying the phase of the viewer's periodic respiratory motion. Point generated and output (step S34), instead of step S14-2, the control unit 19 determines whether or not λ + 1 respiratory levels V (t) have been measured. In the case of Yes, the process proceeds to the following step S35 (step S34-2). Instead of step S15, the reproduction speed calculation unit 35 uses the respiration index φ (t1) and the respiration target information Φ (p (t1)) as input and follow equations (8)-(10) Thus, the sample update interval S (t1) is calculated and output as reproduction speed information (step S35). Others are the same as the first embodiment.

[Modification 1 of Third Embodiment]
The playback speed calculator 35 of the third embodiment calculates the sample update interval S (t1) according to the equation (10). However, the sample update interval S (t1) may be calculated according to the following equation (11) instead of equation (10).

S (t1) = S0 / {α (p (t1)) · D [L (t1)] + 1} (11)
However, D [L (t)] is a function value obtained by applying the function D [L] to L (t). In accordance with the function D [L], it is possible to change the manner in which the playback speed of the content follows the breathing of the viewer 100.

  FIGS. 9A to 9C are diagrams for explaining a specific example of the function D [L].

FIG. 9A shows
D [L] = C ・ L… (12)
It is the figure which illustrated the function shown by. The function value D [L (t)] in this case is proportional to L (t). The processing in this example is the same as that in the third embodiment.

FIG. 9B shows
D [L] = C1 * L (L <0)… (13)
D [L] = C2 * L (L> = 0)… (14)
It is the figure which illustrated the function shown by. However, C1 and C2 are arbitrary constants that satisfy the condition of C1>C2> 0. In the case of this function D [L], the change amount of the function value D [L (t)] relative to the change amount of L (t) when L (t)> 0 is L (t) <0 Is smaller than the change amount of the function value D [L (t)] with respect to the change amount of L (t). In this case, the playback speed calculation unit adjusts the sample update interval when the viewer's breathing phase is ahead of the breathing phase indicated by the breathing target information (L (t1)> 0). ) Is more emphasizing the adjustment of the sample update interval (adjustment to slow down the playback speed) when the viewer's breathing phase is behind the breathing phase indicated by the breathing target information (L (t1) <0) Will do. That is, for L (t1) with the same absolute value, the amount of change in S (t1) with respect to S0 when L (t1) <0 is the change in S (t1) with respect to S0 when L (t1)> 0. Greater than the amount.

FIG. 9C shows
D [L] = SIN (L)… (15)
It is the figure which illustrated the function shown by. In the case of this function D [L], the playback speed calculation unit has a larger phase difference between the viewer's breath and the breath indicated by the breathing target information than when the function D [L] in FIG. 9A is used. However, the change amount of the sample update interval is not increased so much.

  That is, when the function value D [L (t)] is not proportional to L (t) as shown in FIGS. 9B and 9C, the respiration target information corresponding to any respiration target setting position. The amount of change in the playback speed (the amount of change in the sample update interval) with respect to the amount of change in the difference between the phase specified by the phase and the phase specified by the breathing index at the time when the content information corresponding to the respiration target setting position is played back ) Is the relative value (L) of the phase specified by the respiration index at the time when the content information corresponding to the respiration target setting position is reproduced with respect to the phase specified by the respiration target information corresponding to the respiration target setting position. (t)).

[Modification 2 of the third embodiment]
In the third embodiment and its modification example 1, the respiratory index extraction unit outputs the respiratory index φ (t) at the current time t = t1, and the playback speed calculation unit performs the breathing at the current time t = t1. Respiration target information corresponding to the sample point τ = p (t1) to be reproduced at time t = t1 in the index φ (t) (information for identifying the phase of the viewer's periodic respiratory motion) The sample update interval S (t1) is determined so that Φ (p (t1)) approaches. However, the respiratory index extraction unit applies a mathematical model to the respiratory index φ (t) obtained from the respiratory level V (t) to predict the future respiratory index φ (t) from the current time t = t1. The value may be calculated, and the playback speed calculation unit may determine the sample update interval using the predicted value of the respiration index φ (t).

  For example, when the AR model is used as a mathematical model, the future breathing is calculated from the respiratory indices φ (t), φ (t-1), φ (t-2),. The predicted value pφ (t + 1) of the index can be obtained as follows.

pφ (t + 1) = a + a0 ・ φ (t) + a1 ・ φ (t-1) + a2 ・ φ (t-2),. . . , aj ・ φ (tj)… (16)
As described above, a, a0, a1,..., Aj are prediction coefficients obtained by linear prediction analysis. In addition, each prediction coefficient a, a0, a1,..., Aj has the smallest energy (prediction residual) energy between the predicted value PV (t + 1) of the respiratory level and the actual respiratory level V (t + 1). Is selected. J is an integer of 0 or more. j may be a constant or a variable.

  Here, the predicted value pφ (t1 + 1) of the respiratory index at the time t = t1 + 1 is obtained by applying the equation (16) to the current time t = t1. Further, by setting this pφ (t1 + 1) as φ (t1 + 1) and applying equation (16) to time t = t1 + 1, the predicted value pφ of the respiratory index at time t = t1 + 2 (t1 + 2) is obtained. By repeating such processing and applying Equation (16) q times (q is an integer equal to or greater than 1), the predicted value pφ (t of each respiratory index from time t = t1 + 1 to t = t1 + q ) Is obtained. The respiratory index extraction unit outputs a predicted value pφ (t1 + q) of the respiratory index.

  In this case, the playback speed calculation unit receives the predicted value pφ (t1 + q) of the respiratory index, and the sample point τ = pp () of the content with respiratory distribution 32a expected to be played back at time t = t1 + q. t1 + q) is obtained from the predicted value pφ (t1 + q) of the respiratory index and the sample update interval S (t1) calculated for the current time t = t1 as follows.

pp (t1 + q) = p (t1) + T1 ・ q / S (t1)… (17)
However, when S (t1) does not exist, such as at the start of reproduction, the sample point τ = pp (t1 + q) is obtained as follows.

pp (t1 + q) = p (t1) + T1 ・ q / S0 (18)
Then, the playback speed calculation unit extracts the respiration target information Φ (pp (t1 + q)) corresponding to the sample point τ = pp (t1 + q) thus obtained from the content 32a with respiration distribution, and Using the predicted value pφ (t1 + q) of the respiratory index, the sample update interval S (t1 + q) is obtained as follows.

R (t1 + q) = pφ (t1 + q) -Φ (pp (t1 + q))… (19)
If | R (t1 + q) |> π then L (t1) = R (t1 + q) -Sgn (R (t1 + q)) ・ 2π
else L (t1 + q) = R (t1 + q)… (20)
S (t1 + q) = S0 / {α (pp (t1 + q)) ・ C ・ L (t1 + q) +1} (21)
Alternatively, the following equation (22) may be used instead of equation (21).

S (t1 + q) = S0 / {α (pp (t1 + q)) ・ D [L (t1 + q)] + 1}… (22)
[Modification 3 of the third embodiment]
Further, as a modification of Modification 2 of the third embodiment, as in the modification of the first and second embodiments, the respiration index extraction unit applies a mathematical model to the respiration level V (t) and Calculate the predicted value of the respiration level V (t1 + q) at time t = t1 + q in the future from time t = t1, and the respiration index extraction unit will calculate the respiration index φ at future time t = t1 + q (t1 + q) is generated and output, and the playback speed calculation unit determines the breathing index φ (t) at the future time t = t1 + q (to identify the phase of the viewer's periodic breathing motion) Sample update interval S so that the respiration target information Φ (p (t1 + q)) corresponding to the sample point τ = p (t1 + q) to be reproduced approaches the information) at time t = t1 + q (t1 + q) may be determined.

[Modification 4 of the third embodiment]
In the third embodiment, an example is shown in which phase space representation is used in which the respiration level V (t) is taken in the first dimension and the delay value V (t-γ) is taken in the second dimension. However, other phase space expressions may be used in the third embodiment and its modification example 1-3. For example, the respiratory level V (t) is taken as the first dimension, and the Hilbert transform value of V (t) (generally called an analytic signal) is taken as the second dimension. (For example, “K. Kotani, K. Takamasu, Y. Jimbo, Y. Yamamoto,“ Postural-induced phase shift of respiratory sinus arrhythmia and blood pressure variations: insight from respiratory-phase domain analysis, ”Am. J. Physiol. Heart. Circ. Physiol., Vol. 294, pp. H1481-H1489, 2008 ”). When the differential value W (t) of the respiratory level V (t) is obtained, the respiratory level V (t) is taken as the first dimension, and the differential value W (t) of the respiratory level V (t) is taken as the two-dimensional Good for the eyes. If the differential value W (t) of the respiratory level V (t) cannot be obtained, a pseudo differential value obtained by passing the respiratory level V (t) through a differential filter (for example, V (t) −V (t -1)) / T1) may be used in the second dimension (for example, a value corresponding to W (t) can be measured by using TR-712 manufactured by Nihon Kohden).

[Modification 5 of the third embodiment]
In the third embodiment and its modified example 1-4, the sample update interval S (t1) generated by the playback speed calculator when | L (t1) |> Z changes by 50% or more with respect to S0. , Synchronization importance α (τ) over all sampling points τ α (τ)> 1 / (C · Z)… (23)
And For example, when Z = 0.05 · π, the synchronization importance α (τ) is set to α (τ)> 1 / (C · 0.05 · π)… (24) over all sampling points τ.
And

  As a result, Φ (τ) sufficiently matches φ (p (t1)) during content reproduction, and the reproduction position sufficiently follows the viewer's breathing.

[Modification 6 of the third embodiment]
In the third embodiment and its modification example 1-4, the content with the respiratory distribution may be configured not to include the synchronization importance α (τ). In this case, all the synchronization importance α (τ) during the calculation performed by the reproduction speed calculation unit may be replaced with a constant such as 1.

[Fourth Embodiment]
The fourth embodiment is a modification of the third embodiment and its modifications 1-6, and the playback speed calculation unit corresponds to the phase specified by the current breathing index and the “specific breathing target setting position”. When the difference from the phase specified by the respiratory target information to be played is less than or equal to the threshold value, each content information corresponding to each playback position after the specific respiratory target setting position is sequentially played back along the time axis. Output of playback speed information for specifying the playback speed is started, and the content playback speed control unit is specified by the phase specified by the current respiratory index and the respiratory target information corresponding to the “specific respiratory target setting position”. When the difference from the phase is less than or equal to the threshold value, each piece of content information corresponding to each reproduction position after the “specific breathing target setting position” is reproduced at the reproduction speed specified by the reproduction speed information. To start the output of the reproduction information for the next play. Hereinafter, as an example, a case will be described in which “specific breathing target setting position” is the sample point τ = 0 (see FIG. 7) of the first content information d (τ) and “threshold value” is 0. In this case, when the phase specified by the current respiratory index φ (t1) output from the respiratory index extraction unit is equal to the phase specified by the respiratory target information Φ (0), the content information is reproduced. Will be started.

<Configuration>
As illustrated in FIG. 1, the playback speed synchronization device 4 of the fourth embodiment includes an input unit 31, a storage unit 32 that stores content 32 a with respiratory distribution, a respiratory measurement unit 13, a respiratory index extraction unit 34, and the like. A playback speed calculation unit 45, a content playback speed control unit 46, a playback unit 17, and a control unit 19.

[Reproduction speed calculation unit 45]
The reproduction speed calculation unit 45 is, for example, a processing unit configured by reading a predetermined program into the CPU. The reproduction speed calculation unit 45 reads the respiration target information Φ (0) corresponding to the head content information d (0) from the respiration target distribution-attached content 32a before starting the reproduction of the content information d (τ), and extracts a respiration index. When the phase specified by the current respiratory index φ (t1) output from the unit 34 and the phase specified by the read respiratory target information Φ (0) become equal, the sampling points after τ = 0 Generation and output of the sample update interval S (t) corresponding to each sample τ is started. Note that the method for generating the sample update interval may be the same as that in the third embodiment and its modifications 1-6.

[Content playback speed control unit 46]
The content playback speed control unit 46 is, for example, a processing unit configured by reading a predetermined program into the CPU. The content playback speed control unit 46 determines that the phase specified by the current respiratory index φ (t1) output from the respiratory index extraction unit 34 and the phase specified by the respiratory target information Φ (0) are equal. In addition, reproduction information r (τ for sequentially reproducing each piece of content information d (τ) corresponding to each sample point τ after the sample point τ = 0 at the reproduction speed specified by the sample update interval S (t) ) Output.

<Method>
Next, the playback speed synchronization method of this embodiment will be exemplified.

  FIG. 10 is a flowchart for illustrating the playback speed synchronization method.

  First, the processes of steps S31 and S32 described in the third embodiment are performed. Next, similarly to step S13 described in the first embodiment, the respiration measurement unit 13 measures the respiration state of the viewer 100 at a cycle T1, and the respiration level V (t1), which is respiration information obtained thereby. V (t1-1), V (t1-2),... Are output (step S43), and the breathing index extraction unit 34 performs the breathing level V (t) in the same manner as step S34 described in the third embodiment. ) As an input, a respiratory index φ (t), which is information for specifying the phase of the viewer's periodic respiratory motion, is generated and output (step S44). At this time, the reproduction of the content information d (τ) has not started.

  The reproduction speed calculation unit 45 reads the respiration target information Φ (0) corresponding to the first content information d (0) from the respiration target distribution-equipped content 32a, and the current respiration index φ ( It is determined whether or not the phase specified by t1) is equal to the phase specified by the read respiratory target information Φ (0) (step S48). If it is determined that they are not equal, the process returns to step S43.

  On the other hand, when it is determined that they are equal, the reproduction speed calculation unit 45 receives the respiration index φ (t1) and the respiration target information Φ (p (t1)) as inputs, and the equations (8)-(10) The sample update interval S (t1) is calculated according to the above, and this is output as reproduction speed information (step S35). Then, when the processing of steps S16 to S19 described in the first embodiment is executed and it is determined in step S19 that the reproduction of all the content information d (τ) has not ended, t1 + 1 is replaced with a new t1. As described above, the processes of steps S13, S34, S35, and S16-S19 are repeated. On the other hand, if it is determined that the reproduction of the content information d (τ) has been completed, the process ends.

  In the present embodiment, as an example, a case has been described in which the “specific respiration target setting position” is the sample point τ = 0 of the top content information d (τ) and the “threshold value” is 0. However, the “specific respiration target setting position” may be the leading sample point τ of the content information d (τ) at other positions. For example, a sample point that is located before the sample point corresponding to the content information and that is not associated with the content information may be set as the “specific breathing target setting position”. A positive value may be used as the “threshold value”.

[Fifth Embodiment]
The fifth embodiment is a modification of the third embodiment and its modifications 1-6. The content information corresponding to a part of the playback position of the content with breath distribution of the fifth embodiment is null information or blank information, and the part of breath target information of the content with breath distribution is null information or blank information. It is defined for the breathing target setting position corresponding to the content information. The reproduction speed calculation unit of the present embodiment further includes a phase specified by respiration target information corresponding to a respiration target setting position corresponding to content information that is null information or blank information, and a phase specified by a current respiration index Output the second playback speed information that specifies the update interval of the playback position corresponding to the content information that is the null information or the blank information, and the content playback speed control unit of the present embodiment further includes: Using the second playback speed information as input, the playback position corresponding to the content information that is null information or blank information is updated along the time axis at an update interval specified by the second playback speed information.

  Thus, the reproduction position of the content information can be synchronized with the breathing of the viewer 100 during the period in which the content information is not reproduced or the period in which the content information that is blank information is reproduced. The correlation between the content information and the breathing of the viewer 100 at the time when the reproduction of the substantial content information to be reproduced is started can be increased.

<Configuration>
As illustrated in FIG. 1, the reproduction speed synchronization device 5 according to the fifth embodiment includes an input unit 51, a storage unit 52 that stores content 52 a with respiration distribution, a respiration measurement unit 13, and a respiration index extraction unit 34. A playback speed calculation unit 55, a content playback speed control unit 56, a playback unit 17, and a control unit 19.

[Input unit 51, storage unit 52, content 52a with respiratory distribution]
The input unit 51 is a functional unit that receives input of the content 52a with respiratory distribution, and the storage unit 52 stores the content 52a with respiratory distribution. The content information corresponding to a part of the reproduction position of the content with respiration distribution 52a is null information or blank information, and the part of respiration target information of the content with respiration distribution 52a is content information that is null information or blank information. It is defined for the corresponding breathing target setting position.

  For example, in the content 52a with respiratory distribution illustrated in FIG. 11, content information d (0),..., D (b-1) corresponding to the sample points τ = 0,. ) Is null information or blank information, respectively, and the content information d (b), d (b + 1),... Corresponding to each sample point after the sample point τ = b is the corresponding pitch or sound. MIDI data indicating the strength of the. Note that b is an integer of 1 or more. In addition, all sample points τ (respiration target setting position) are synchronized with information Φ (τ) (respiration target information) for identifying the desired “phase of respiratory motion” at each sample point τ. The degree α (τ) is associated.

[Reproduction speed calculation unit 55]
The playback speed calculation unit 55 of this embodiment is a processing unit configured by, for example, reading a predetermined program into the CPU. The playback speed calculation unit 55 outputs the sample update interval as playback speed information in the same manner as in the third embodiment and its modifications 1-6, and further, breaths corresponding to content information that is null information or blank information. The reproduction position corresponding to the content information that is the null information or the blank information is set so that the difference between the phase specified by the respiratory target information corresponding to the target setting position and the phase specified by the current respiratory index becomes small. A sample update interval for specifying the update interval is output as second reproduction speed information. The method for generating the sample update interval that is the second playback speed information is the same as that in the third embodiment and its modifications 1-6, except that the respiration target setting position to be dealt with corresponds to content information that is null information or blank information. This is the same as the sample update interval generation method described above.

  FIG. 11 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the fifth embodiment.

  In the case of the example in FIG. 11, the playback speed calculating unit 55 performs sampling points τ = 0,... Of the content 52a with respiratory distribution until playback of the content information d (τ) after the sampling points τ = b is started. , b-1 respiratory target information Φ (0), ..., Φ (b-1) and synchronization importance α (0), ..., α (b-1) Using the respiration index φ (t2) at the current time t = t2 output from the index extraction unit 34, the same processing (t1 is changed to t2) as described in the third embodiment and its modifications 1-6. The sample update interval S (t2) (second reproduction speed information) is generated and output by the replacement process. In addition, after the reproduction of the content information d (τ) after the sample point τ = b is started, the reproduction speed calculation unit 55 performs the sample update interval S (t1) described in the third embodiment and the modifications 1-6. ) Is generated and output. In FIG. 11, each time at which each piece of content information, which is null information or blank information, is reproduced is expressed as t = t2, and each time at which the content information to be viewed is reproduced It is expressed as t = t1 as in the third embodiment and its modifications 1-6.

[Content playback speed control unit 56]
The content playback speed control unit 56 according to the present embodiment is a processing unit configured, for example, by reading a predetermined program into the CPU. The content playback speed control unit 56 receives the sample update interval S (t2) (second playback speed information), and is content information that is null information or blank information at an update interval specified by the sample update interval S (t2). The playback position corresponding to is updated along the time axis. When the playback position reaches the position corresponding to the content information to be viewed by this update, the content playback speed control unit 56 starts the same processing as the content playback speed control unit of the third embodiment or its modification 1-6. To do.

  In the example of FIG. 11, the content playback speed control unit 56 uses the sample update interval S (t2) at each time t = t2 that is sequentially input, and samples at the update interval specified by the sample update interval S (t2). Update the point from τ = 0 to τ = b-1. Then, after the sample point reaches τ = b, the content playback speed control unit 56 uses the sample update interval S (t1) at each time t = t1 that is sequentially input, and uses the third embodiment or its modification example 1. Playback information r (τ) similar to that of the content playback speed control unit of −6 is output.

[Sixth Embodiment]
The sixth embodiment is a modification of the first to fifth embodiments and their modifications. The playback speed calculation unit of the sixth embodiment does not set playback speed information that reverses the playback position of the content information. That is, the playback speed set by the playback speed calculation unit of this embodiment indicates that playback is performed without updating the playback position, or playback is performed while updating the playback position toward the future. For example, the playback speed calculation unit of the sixth embodiment sets the sample update interval to 0 when the sample update interval calculated by the method as described in the first to fifth embodiments and the modifications thereof is less than 0. Output. Alternatively, when the playback speed calculation unit of the sixth embodiment calculates the sample update interval similarly to the 3-5 embodiment and their modifications, the sample update interval calculated by the playback speed calculation unit is always 0 or more. As described above, the range of the synchronization importance α (τ) of the content with the respiratory target distribution is limited. For example, when the sample update interval is calculated by Equation (10), the range of the synchronization importance α (τ) is limited as follows.

-1 / (C ・ π) <α (τ) <1 / (C ・ π)… (25)
[Other variations]
The present invention is not limited to the above-described embodiment.

  For example, in each of the above-described embodiments and modifications thereof, the content with respiratory target distribution in which the respiratory target information and the synchronization importance are associated with the sample points is illustrated. However, if the breathing target information and the synchronization importance are associated with any reproduction position, the breathing target information and the synchronization importance are not necessarily associated with the sample point. For example, the respiratory target information and synchronization importance may be distributed and recorded in the content with the respiratory target distribution at a frequency equal to (1 / natural number) times the sampling frequency of the content, or may be recorded at an arbitrary interval. May be. When recording at an arbitrary interval, for example, start point information for specifying the start point of the content information and respiration target information for the start point information and information for specifying the relative position Δ of the synchronization importance are included in the content with the respiration target distribution. Store it. Further, the respiratory target information and the synchronization importance need not be discrete data, and may be recorded in an analog manner. Further, the breathing target information and the synchronization importance need not be defined for the entire content, but may be defined for only a part thereof.

  Further, in each of the above-described embodiments and modifications thereof, the sample update interval is illustrated as a specific example of the reproduction speed information output from the reproduction speed calculation unit. However, this does not limit the present invention, and a signal that can adjust the reproduction time (speed) such as tempo information, frame position, and clock frequency may be used as the reproduction speed information.

  In each of the above-described embodiments and modifications thereof, the respiratory level is exemplified as a specific example of the respiratory information output from the respiratory measurement unit. However, for example, the differential value of the respiratory level may be used as the respiratory information. The differential value of the respiratory level is obtained, for example, by detecting the respiratory airflow.

  Further, in each of the above-described embodiments and modifications thereof, MIDI data indicating the pitch and the intensity of sound is shown as a specific example of the content information. However, content data may be other data that specifies audio information or video information for viewing purposes, such as music, sound, moving images such as movies and television programs. In addition, the content playback speed control unit does not change the pitch or sound quality if sound, even if the playback speed changes, and playback time control processing that includes processing such as suppressing video disturbance due to frame advance or fast forward if video. It is desirable to do.

  In the second embodiment, it has been shown that a synchronization importance level of 0 or more and 1 or less is preferable. However, this does not limit the present invention, and the synchronization importance may be less than 0 or greater than 1. Thereby, the variation of the reproduction | regeneration method of a content can be increased, and the choice of how to enjoy can be increased. For example, by setting the synchronization importance level to less than 0, it is possible to reproduce content that is uncomfortable for the viewer, and the range of artistic expression is expanded. Also, in all the embodiments and modifications thereof, the playback speed calculation unit may use a value obtained by inverting the sign of the synchronization importance level of the content with the respiratory target distribution as the synchronization importance level for calculating the playback speed. Good. This makes it possible to reproduce content with a sense of incongruity. Moreover, the structure which can select whether the sign of the synchronization importance of the content with a breathing target distribution is reversed or not may be used.

  In each of the above-described embodiments and modifications thereof, each time the respiration measurement unit outputs respiration information, the respiration index extraction unit generates a respiration index, and the playback speed calculation unit determines the sample update interval. These processes may be performed at other timings. For example, a breathing index or a sample update interval may be generated at a cycle that is an integral multiple (twice or more) of the cycle T1 at which the breathing measurement unit generates breathing information. A breathing index or a sample update interval may be set for each target setting position.

  Each block in the block diagram illustrated in FIG. 1 is a conceptually divided processing section, and each block does not have to exist as an independent device. Moreover, each block does not need to be configured as one device, and may be distributed in a plurality of devices.

  In addition, the various processes described above are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Needless to say, other modifications are possible without departing from the spirit of the present invention.

[Features of each embodiment]
The effects obtained by each embodiment are listed.

  In all the embodiments and modifications thereof, respiratory target information is set for a respiratory target setting position that is an arbitrary reproduction position of content with a respiratory target distribution, and respiratory target information corresponding to one of the respiratory target setting positions The content reproduction speed is controlled so that the breathing state specified by the value approaches the breathing state of the viewer when the content information corresponding to the breathing target setting position is reproduced. Therefore, in all the embodiments and modifications thereof, the correlation between the respiratory state specified by the respiratory target information and the viewer's respiratory state can be enhanced at a desired respiratory target setting position. As a result, satisfaction such as a sense of unity and high presence in content appreciation can be enhanced.

  As in the second embodiment, when the content with respiration distribution further includes a synchronization importance that is a coefficient corresponding to each reproduction position, and the reproduction speed is controlled in consideration of the synchronization importance, the content is specified by the respiration target information. It is possible to adjust the level of correlation between the breathing state being played and the viewer's breathing state for each playback position where the synchronization importance is set. This makes it possible to define a playback position that is desired to match the viewer's breath, a playback position that is not required to match the viewer's breath, and the like, and to adjust the correlation realized for each playback position to some extent. For example, it is highly necessary to play back at a normal playback speed regardless of the viewer's breathing state and to follow the viewer's breathing state at a playback position where the need to follow the viewer's breathing state is low The reproduction position can be controlled to be reproduced at a reproduction speed that causes the breathing state specified by the suction target information to follow the breathing state of the viewer. Also, even if the content is the same, changing the setting method of the breathing target information and the synchronization importance level can increase the variation of content reproduction, and can expand the selection of ways of enjoying.

  In the third to fifth embodiments and their modifications, the breathing target information and the breathing index are information for specifying the phase when the periodic breathing motion is expressed in phase space, and any breathing target setting Control the playback speed so that the difference between the phase specified by the breathing target information corresponding to the position and the phase specified by the breathing index at the time when the content information corresponding to the breathing target setting position is played back becomes small It was decided to. This enables synchronization in an intermediate state such as mid-inspiration (not represented by a time-discrete index such as the exhalation start point or tempo). Further, in this case, compared to the case where the breathing level is directly used, the influence of the reproduction speed due to the characteristics not directly related to the synchronization of the breathing amplitude depending on the individual physique of the viewer can be reduced.

  In the first modification of the third embodiment, the playback speed having various characteristics can be adjusted by changing the shape of the function D [L]. For example, in the case where the function D [L] illustrated in FIG. 9B is used, the control for lowering the playback speed is emphasized rather than the control for increasing the playback speed. To be emphasized. In addition, by introducing a function that matches human sensitivity as D [L], more natural playback speed adjustment is possible.

  In the fifth modification of the third embodiment, the reproduction position sufficiently follows the viewer's breathing. Therefore, for example, it is possible to function as a playback speed control device (a kind of command system) that arbitrarily controls the playback rhythm by breathing.

  In the fourth and fifth embodiments, content reproduction can be performed from the beginning of content in a state where the correlation between the respiratory state indicated by the respiratory target information and the viewer's respiratory state is high. In particular, in the case of the fifth embodiment, synchronization at the start point can be realized in the same processing loop as that in the first to third embodiments and the modification thereof without performing special synchronization processing at the content start point.

  In the sixth embodiment, since the playback speed is limited so as not to be negative, the content playback can be performed without disturbing the temporal relationship of the content.

[Program, data structure, recording medium]
When the above configuration is realized by a computer, the processing contents of the functions that each device should have are described by a program. The processing functions are realized on the computer by executing the program on the computer.

  Further, the program describing the processing contents and the content with the respiratory target distribution having the data structure described above can be recorded on a computer-readable recording medium. The computer-readable recording medium may be any recording medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory.

  The distribution of the program and the content with the respiratory target distribution is performed by selling, transferring, or lending a portable recording medium such as a DVD or a CD-ROM in which the program or the content with the respiratory target distribution is recorded. Furthermore, the program and the content with respiratory target distribution are stored in the storage device of the server computer, and the content with the respiratory target distribution is distributed by transferring the content with the respiratory target distribution from the server computer to another computer via the network. Also good.

  In each of the above-described embodiments, the present apparatus is configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware. .

  1-5 Playback speed synchronization device

Claims (12)

Content information corresponding to each reproduction position along the time axis, and respiration target information for specifying a respiration state predetermined for each respiration target setting position that is at least a part of the reproduction position, Including a storage unit for storing content with respiratory distribution,
A breathing index extracting unit for extracting a breathing index for specifying the viewer's breathing state from breathing information obtained by measuring the viewer, and outputting the breathing index;
The respiration target information and the respiration index are input, and the content information corresponding to the respiration target setting position is reproduced as the respiration state specified by the respiration target information corresponding to any one of the respiration target setting positions. Playback that sets the playback speed when sequentially playing back each piece of content information corresponding to each playback position along the time axis so as to approach the viewer's breathing state at the time of playback, and identifies the set playback speed A playback speed calculator for outputting speed information;
A content playback speed control unit which receives the playback speed information and the content information and outputs playback information for sequentially playing back each piece of content information corresponding to each playback position at the playback speed specified by the playback speed information When,
A reproduction speed synchronization apparatus having The playback speed synchronization device of claim 1,
The content with respiratory distribution further includes a synchronization importance that is a coefficient corresponding to at least a part of the playback positions,
The playback speed calculation unit further inputs the synchronization importance, and determines the playback speed depending on the synchronization importance corresponding to the playback position for each playback position corresponding to each synchronization importance.
A reproduction speed synchronization apparatus characterized by the above. The playback speed synchronization device according to claim 1 or 2,
The respiratory target information and the respiratory index are information for specifying the phase of a periodic respiratory motion,
The reproduction speed calculation unit includes the phase specified by the respiration target information corresponding to any one of the respiration target setting positions, and the respiration index at the time when the content information corresponding to the respiration target setting position is reproduced. Therefore, the playback speed information that specifies the playback speed so that the difference from the specified phase is small is output.
A reproduction speed synchronization apparatus characterized by the above. A playback speed synchronization device according to claim 3,
The phase specified by the respiratory target information corresponding to any one of the respiratory target setting positions and the phase specified by the respiratory index at the time when the content information corresponding to the respiratory target setting position is reproduced The amount of change in the reproduction speed relative to the amount of change in the difference is the time at which the content information corresponding to the respiration target setting position is reproduced with respect to the phase specified by the respiration target information corresponding to the respiration target setting position. Depends on the relative value of the phase specified by the respiratory index,
A reproduction speed synchronization apparatus characterized by the above. The playback speed synchronization device according to claim 3 or 4,
When the difference between the phase specified by the current respiratory index and the phase specified by the respiratory target information corresponding to a specific respiratory target setting position is less than or equal to a threshold, Start outputting the reproduction speed information for specifying the reproduction speed when sequentially reproducing each content information corresponding to each reproduction position after the specific breathing target setting position along the time axis,
When the difference between the phase specified by the current respiratory index and the phase specified by the respiratory target information corresponding to a specific respiratory target setting position is equal to or less than a threshold, the content playback speed control unit Starting output of the reproduction information for sequentially reproducing each content information respectively corresponding to each reproduction position after the specific respiration target setting position at a reproduction speed specified by the reproduction speed information;
A reproduction speed synchronization apparatus characterized by the above. The playback speed synchronization device according to claim 3 or 4,
The content information corresponding to the playback position of a part of the content with the respiratory distribution is null information or blank information,
The respiratory target information of a part of the content with the respiratory distribution is determined with respect to the respiratory target setting position corresponding to the content information that is null information or blank information,
The reproduction speed calculator further includes a phase specified by the respiratory target information corresponding to the respiratory target setting position corresponding to content information that is null information or blank information, and a phase specified by the current respiratory index The second playback speed information for specifying the update interval of the playback position corresponding to the content information that is the null information or the blank information, so that the difference between
The content playback speed control unit further receives the second playback speed information, and sets a playback position corresponding to the content information that is the null information or blank information at an update interval specified by the second playback speed information. Update along the time axis,
A reproduction speed synchronization apparatus characterized by the above. The playback speed synchronization device according to any one of claims 1 to 6,
The playback speed indicates that playback is performed without updating the playback position, or indicates that playback is performed while updating the playback position toward the future.
A reproduction speed synchronization apparatus characterized by the above. Content information corresponding to each reproduction position along the time axis, and respiration target information for specifying a respiration state predetermined for each respiration target setting position that is at least a part of the reproduction position, Storing content with respiratory distribution in the storage unit;
A step of extracting a breathing index for specifying the viewer's breathing state from breathing information obtained by measuring the viewer, and outputting the breathing index;
A reproduction speed calculation unit receives the respiration target information and the respiration index, and a respiration state specified by the respiration target information corresponding to any one of the respiration target setting positions corresponds to the respiration target setting position. Set and set the playback speed when sequentially playing each content information corresponding to each playback position along the time axis so as to approach the viewer's breathing state at the time when the content information is played back Outputting playback speed information for specifying the playback speed;
A content playback speed control unit receives the playback speed information and the content information as input, and plays back playback information for sequentially playing back each piece of content information corresponding to each playback position at the playback speed specified by the playback speed information. Output step;
A playback speed synchronization method.   A program for causing a computer to function as the playback speed synchronization device according to any one of claims 1 to 7. Content information corresponding to each playback position along the time axis,
Respiratory target information for specifying a predetermined respiratory state for each respiratory target setting position that is at least a part of the reproduction position;
A data structure of content with respiratory distribution having: The data structure of claim 10, comprising:
Furthermore, it has a synchronization importance that is a coefficient corresponding to each of the playback positions,
A data structure characterized by that. A computer-readable recording medium storing content with a respiratory distribution having the data structure of claim 10 or 11.

Images