JP2012189618A - Respiration distribution applying device, method for applying respiration distribution, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique capable of controlling a viewer's feeling such as a sense of unity and a realistic sensation to a content by controlling a reproduction speed of a content to respiration of a viewer of a content.SOLUTION: A respiration distribution applying device extracts, from respiration information obtained by measuring a performance of or a performer playing a content progressing along a time axis, a respiration index for specifying a respiration state of the performer at a time point on the time axis along the progress of the content. The respiration distribution applying device obtains respiration target information corresponding to the respiration state of the performer at least at a partial time point on the time axis from the respiration index and outputs the respiration target information associated with content information representing the content at a respiration target setting position which is the time point on the time axis corresponding to the respiration target information.

Description

  The present invention relates to a content reproduction technique, and more particularly, to a technique for synchronizing a content reproduction position with a viewer's breathing.

  It has been reported that the viewer's breathing tempo is induced based on the tempo of content that progresses along the time axis such as music content (see, for example, Non-Patent Documents 1 and 2). . Utilizing the phenomenon of breathing into this content, for example, inventions and product developments that induce viewers' breathing based on the music tempo have been carried out. For example, in the apparatus disclosed in Non-Patent Document 3, the time length of the presentation sound is changed for the purpose of guiding or converging to a certain target respiratory tempo.

F. HAAS, S. Distenfeld and K. Axen, “Effects of perceived musical rhythm on respiratory pattern,” J. Appl Physiol, 1986, 61, pp. 1185-1191 Toshie Nakamura, “About“ between ”and breathing in music,” Acoustical Society of Japan Acoustical Society, 1994, MA94, 16 “RESPeRATE TO LOWER BLOOD PRESSURE”, [online], [searched February 25, 2011], Internet <http://www.resperate.com/us/discover/resperatedemo>

  On the other hand, from the phenomenon that breathing is drawn into the content described above, it is considered that the synchronization of the scene with the content and the viewer's breathing is related to the sense of unity and realism of the content. However, what has been studied in the past is only a method for setting the tempo of content such as a music tempo for the purpose of guiding or converging to a preset breathing tempo as a target. A method of synchronizing the content tempo with the breathing of the viewer of the content, not the induction or convergence of the respiratory tempo, has not been studied so far. In other words, the conventional technology does not assume the psychological influence on the viewer due to the relationship between the scene of the content and the viewer's breathing. Accordingly, it does not control the degree of synchronization (correlation) by changing the playback speed of the content.

  The present invention has been made in view of these points, and controls the playback speed of the content in accordance with the breathing of the content viewer, and controls the viewer's sense of unity and realism. The purpose is to provide a technology that can do this.

  Content information corresponding to each reproduction position along the time axis, and respiration target information for specifying a respiration state predetermined for each respiration target setting position corresponding to at least a part of the reproduction positions, Stores content with respiratory distribution in the storage unit, extracts respiratory indices for specifying the viewer's respiratory state from the respiratory information obtained by measuring the viewer, and corresponds to any respiratory target setting position The reproduction speed information is determined so that the breathing state specified by the breathing target information to be approximated to the viewer's breathing state at the time when the content information corresponding to the breathing target setting position is reproduced, and is specified by the reproduction speed information. Playback information for sequentially playing back each piece of content information corresponding to each playback position at the playback speed is output.

In the present invention, content with a respiratory distribution is generated as follows.
From the respiratory information obtained by measuring the performer who plays or performs the content that progresses along the time axis, extracts a respiratory index that identifies the breathing state of the performer at the time point on the time axis along the progress of the content, Respiratory target information corresponding to the performer's respiratory state at least at some time points on the time axis is obtained from the respiratory index, and the respiratory target setting is the time point on the time axis corresponding to the respiratory target information. The content information representing the content at the position is output in association with the content information.

  The playback speed is set so that the breathing state specified by the breathing target information corresponding to any breathing target setting position approaches the viewer's breathing state when the content information corresponding to the breathing target setting position is played back. Therefore, it is possible to control the playback speed of the content in conjunction with the breathing of the viewer of the content, and to control the viewer's sense of unity and presence with the content. In the present invention, it is possible to efficiently generate a content with a respiratory distribution for that purpose.

FIG. 1 is a block diagram for illustrating the functional configuration of the playback speed synchronization apparatus. FIG. 2 is a graph illustrating the respiration level output from the respiration measurement unit. FIG. 3 is a diagram for explaining an example of the predicted value of the expiration start time. FIG. 4 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the first embodiment. FIG. 5 is a flowchart for illustrating the playback speed synchronization method. FIG. 6 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the second embodiment. FIG. 7 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the third embodiment. FIG. 8A is a diagram for explaining an example of a respiratory index calculated by the respiratory index extraction unit of the third embodiment. FIG. 8B is a diagram illustrating the relationship between the breathing index, the breathing target information, and the phase difference between them. FIG. 9 is a block diagram for illustrating a functional configuration of a respiratory distribution imparting apparatus that creates content with respiratory distribution. FIG. 10 is a graph illustrating the respiration level output from the respiration measurement unit. FIG. 11 is a block diagram for illustrating a functional configuration of a respiration distribution imparting apparatus that creates content with respiration distribution. FIG. 12A is a graph illustrating a respiratory level obtained by measuring a plurality of performers. FIG. 12B is a diagram illustrating the breathing start times of a plurality of performers. FIG. 12C is a diagram illustrating a breath start sample point obtained by converting a breath start time to a sample point on the time axis. FIG. 12D is a diagram illustrating a probability density distribution of breath start sample points. FIG. 13A is a diagram illustrating a centroid vector obtained from a vector on a phase space corresponding to the phase of respiratory motion of a plurality of performers. FIG. 13B is a diagram illustrating a centroid vector obtained from a normalized vector obtained by normalizing a vector on a phase space corresponding to the phase of respiratory motion of a plurality of performers.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
〔Definition of terms〕
Terms are defined as follows:
Content: means audio information or video information for viewing purposes, such as music, audio or reading, or theater, movie or TV program or other moving images.
Content information: Information that constitutes content and is sequentially played back along the time axis.
Reproduction position: means the reproduction position of each piece of content information that is sequentially reproduced along the time axis, that is, the progress position on the time axis in content reproduction. More specifically, for example, the frame position, sample point, time code, song position pointer, etc. correspond to the playback position.

Respiration target setting position: means at least a part of the reproduction position.
Respiratory state: Means each state during a breathing exercise performed periodically. More specifically, for example, an exhalation start state that is a state at the time of starting an exhalation exercise, an exhalation state at each time point during the exhalation exercise, an expiration end state that is a state at the time of ending the exhalation exercise, an inspiration exercise An inhalation start state, which is a state at the time of starting, an inhalation state at each point in time during the inspiratory motion, an inhalation end state, which is a state at the end of the inspiratory motion, and the like correspond to the respiratory state.
Reference state: means a predetermined respiratory state. For example, an exhalation start state, an exhalation end state, an inspiration start state, an inspiration end state, and the like correspond to the reference state.
Respiratory reference position: means a position on the time axis where the respiratory state becomes a specific reference state.

Respiration information: Information obtained by measuring the breathing state of a viewer who appreciates content or a performer who plays or performs content. More specifically, it means, for example, the length around the chest or the abdomen, the respiratory airflow, the temperature difference between exhaled air and inhaled air.
Reproduction speed: means the reciprocal of the time required from reproducing the content information at a certain reproduction position A to reproducing the content information at the next reproduction position B. This is a concept that can be read as the playback tempo or clock interval.

[First Embodiment]
Next, a first embodiment of the present invention will be described.
<Configuration>
FIG. 1 is a block diagram for illustrating the functional configuration of the playback speed synchronization apparatus.
As illustrated in FIG. 1, the playback speed synchronization apparatus 1 of the first embodiment includes an input unit 11, a storage unit 12 that stores content 12 a with respiratory distribution, a respiratory measurement unit 13, and a respiratory index extraction unit 14. A playback speed calculation unit 15, a content playback speed control unit 16, a playback unit 17, and a control unit 19.

[Input unit 11]
The input unit 11 is a functional unit that receives input of the content 12a with respiratory distribution. Examples of the input unit 11 include an input port, an input interface, a reading device, and a receiving device.

[Contents 12a with respiratory distribution]
The content with respiration distribution 12a includes content information corresponding to each reproduction position along the time axis and a position corresponding to at least a part of the reproduction positions (for example, the reproduction position or a position having a specific relationship with the reproduction position). Etc.) is a data structure including respiration target information for specifying a predetermined respiration state for each respiration target setting position.

  In this example, the sample point is the playback position, the MIDI data indicating the pitch and the intensity of the sound is the content information, and the sample point (respiration target sample point) that is desirable as the time to start exhalation exercise is the respiratory target setting position The exhalation start state is set as a predetermined respiration state at the respiration target sample point, and information for specifying the exhalation start state at the respiration target sample point is used as the respiration target information. For example, the content with respiratory distribution 12a illustrated in FIG. 4 includes content information d (τ) that is MIDI data indicating the pitch and intensity corresponding to each sample point τ along the time axis, and expiratory motion. This is data having a data structure including respiration target information Bpe (μ) for specifying an expiration start state defined for each respiration target sample point, which is a desirable sample point as a start time. The sample point τ in this example is an integer greater than or equal to 0, and a larger value corresponds to a later time. The respiration target information Bpe (μ) in this example indicates a sample point τ (respiration target sample point) corresponding thereto. For example, the value of the respiration target information Bpe (μ) determined for the respiration target sample point τ = 100 is 100. μ is an index given for convenience of explanation, and is a continuous integer of 0 or more for identifying each respiration target information Bpe (μ). A larger value μ corresponds to later respiratory target information in time. In the content with respiratory distribution 12a illustrated in FIG. 4, the content information corresponding to each sample point τ to be reproduced is sequentially reproduced while the sample points τ to be reproduced are sequentially updated along the time axis. The update cycle of the sample point τ to be reproduced is called a sample update interval, and a standard set value of a predetermined sample update interval is set to S0.

[Storage unit 12]
The storage unit 12 is an information storage device such as a magnetic recording device, an optical disc, a magneto-optical recording medium, or a semiconductor memory.
[Respiration measurement unit 13]
The respiration measurement unit 13 is a well-known device that measures the respiration state of the content viewer 100 and outputs respiration information obtained thereby. In the example of this embodiment, information (respiration level) corresponding to the length around the chest and the abdomen is used as respiration information, and a device that detects respiration from a resistance change of a rubber tube wound around the chest or abdomen (for example, Nihon Kohden) TR-753T manufactured by AD and MLT1132 manufactured by ADInstruments are used as the respiratory measurement unit 13. The respiration measuring unit 13 in this example measures and outputs a respiration level V (t) at a certain set cycle T1. Note that t is an integer index corresponding to a discrete time, and “time t” means a time corresponding to the integer index t. For the sake of simplicity, the description will be made on the assumption that t advances one by one in the cycle T1. V (t) represents the respiration level at time t.

FIG. 2 is a graph illustrating the respiration level V (t) output from the respiration measurement unit.
In the example of FIG. 2, the respiration level V (t) becomes maximum at the exhalation start time (bpe (n-1), etc.) that is the time when exhalation starts, and the respiration level V (t) decreases as the exhalation state progresses The breathing level V (t) becomes minimal at the inhalation start time (bpi (n), etc.), which is the time when inspiration starts, and the breathing level V (t) increases as the inspiratory state progresses, and the next exhalation starts A state in which the respiration level V (t) is maximized again at time (bpe (n), etc.) is repeated periodically.

[Respiration index extraction unit 14]
The respiratory index extraction unit 14 is a processing unit configured by, for example, a predetermined program being read into a CPU (central processing unit). The breathing index extraction unit 14 extracts a breathing index for specifying the viewer's breathing state from the breathing information obtained by measuring the viewer, and outputs the breathing index. The breathing index extraction unit 14 of the example of this embodiment receives the breathing level V (t) (breathing information) output from the breathing measurement unit 13 and inputs the latest future of the viewer to be measured from the time t. The predicted value pbpe (n) of the expiration start time is output as a respiratory index. Here, n is an index given for convenience of explanation, and is an integer corresponding to the number of breaths of the viewer.

FIG. 3 is a diagram for explaining an example of the predicted value of the expiration start time.
The predicted exhalation start time pbpe (n) can be obtained, for example, by estimating the latest past respiratory cycle viewed from the current time t = t1 as the latest future respiratory cycle viewed from the time t = t1. . That is, the predicted value pbpe (n) of the expiration start time can be calculated as follows, for example.
pbpe (n) = bpe (n-1) + (bpe (n-1) -bpe (n-2))
= 2 ・ bpe (n-1) -bpe (n-2) (1)
Where bpe (n-1) is the most recent past exhalation start from time t calculated using respiration levels V (t1), V (t1-1), V (t1-2), ... Bpe (n-2) is the exhalation start time bpe (n-1) calculated using the respiration levels V (t1), V (t1-1), V (t1-2), ... ) Represents the most recent exhalation start time. More specifically, for example, the time corresponding to the maximum value of the past respiratory level closest to time t = t1 is bpe (n-1), and the past respiratory time closest to the exhalation start time bpe (n-1) is set. The time corresponding to the maximum value of the level is bpe (n-2) (see FIG. 3).

[Reproduction speed calculation unit 15]
The reproduction speed calculation unit 15 is, for example, a processing unit configured by reading a predetermined program into the CPU. The reproduction speed calculation unit 15 receives the respiration target information and the respiration index, and the respiration state specified by the respiration target information corresponding to one of the respiration target setting positions is the content information corresponding to the respiration target setting position. Set the playback speed when sequentially playing the content information corresponding to each playback position along the time axis so as to approach the viewer's breathing state at the time of playback, and specify the set playback speed Output playback speed information. In other words, the playback speed calculation unit 15 is configured to display the breathing state specified by the breathing target information corresponding to one of the breathing target setting positions and the viewer's point in time when the content information corresponding to the breathing target setting position is played back. The content playback speed is set so that the correlation with the breathing state is high. Note that the set playback speed is not a speed for inducing the viewer's breathing, but a speed for synchronizing the progress of content with the viewer's breathing.

FIG. 4 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the first embodiment.
The playback speed calculation unit 15 of this embodiment sets the playback speed of the content by determining the sample update interval. Further, the reproduction speed calculation unit 15 of this embodiment determines the sample update interval S (t) every time the respiration measurement unit 13 obtains the respiration level V (t), that is, the period T1, and uses this as the reproduction speed information. Output. Here, p (t) represents a sample point τ corresponding to the content information reproduced at time t. Hereinafter, the process of the reproduction speed calculation unit 15 will be exemplified with reference to FIG.

It is assumed that the reproduction up to the content information d (p (t1)) corresponding to the sample point τ = p (t1) is completed at the time t = t1. At this time, the nearest future respiratory target sample point is Bpe (m) (μ = m) from the sample point τ = p (t1) included in the content 12a with respiratory distribution, and the respiratory index at time t = t1 Assume that the predicted value (respiration index) of the expiration start time output from the extraction unit 14 is pbpe (n). In this case, the playback speed calculation unit 15 extracts from the predicted value pbpe (n) of the expiration start time that is the respiratory index output from the respiratory index extraction unit 14 and the content 12 a with respiratory target distribution stored in the storage unit 12. The breath target sample point Bpe (m) and the sample point τ = p (t1) are input, and the predicted value pbpe (n) of the expiration start time is used as content information d ( The sample update interval S (t1) is calculated and output as follows so that the reproduction time of τ) approaches.
S (t1) = (pbpe (n) -t1) × T1 / (Bpe (m) -p (t1)) (2)

  That is, the playback speed calculation unit 15 sets the sample update interval S (t1) such that the sample point to be played is updated from p (t1) to Bpe (m) from time t1 to time pbpe (n). The sample update interval S (t1) is output as reproduction speed information.

[Content playback speed control unit 16]
The content playback speed control unit 16 is, for example, a processing unit configured by reading a predetermined program into the CPU. The content playback speed control unit 16 receives the playback speed information and the content information, and outputs playback information for sequentially playing back each piece of content information corresponding to each playback position at the playback speed specified by the playback speed information. To do.

  The content playback speed control unit 16 of this embodiment is extracted from the sample update interval S (t1) that is the playback speed information output from the playback speed calculation unit 15 and the content 12a with a respiratory target distribution stored in the storage unit 12. Content information d (τ) is input, and the content information d (τ) corresponding to the sample point τ to be reproduced is reproduced while updating the sample point τ to be reproduced at the sample update interval S (t1). Reproduction information r (τ) (acoustic signal etc.) is sequentially output. For example, the content playback speed control unit 16 updates the content point d (τ) corresponding to the sample point τ to be reproduced while updating the sample point τ to be reproduced at the sample update interval S (t1). Are sequentially extracted, and reproduction information r (τ) for reproducing the extracted content information d (τ) is sequentially output.

[Playback unit 17]
The reproduction unit 17 is a known presentation device that includes, for example, an amplifier, a speaker, and an image display device. The playback unit 17 receives the playback information r (τ) output from the content playback speed control unit 16 and outputs content such as acoustic information specified by the playback information r (τ).

[Control unit 19]
The control unit 19 is, for example, a processing unit configured by reading a predetermined program into the CPU. The control unit 19 controls the entire processing of the reproduction speed synchronization apparatus 1.

<Method>
Next, the playback speed synchronization method of this embodiment will be exemplified.
FIG. 5 is a flowchart for illustrating the playback speed synchronization method.
First, the content 12a with respiratory distribution is input to the input unit 11 (step S11) and stored in the storage unit 12 (step S12).

  The breathing measurement unit 13 attached to the viewer 100 measures the breathing state of the viewer 100 at a cycle T1, and the breathing levels V (t1), V (t1-1), V ( t1-2),... are output (step S13). The breathing levels V (t1), V (t1-1), V (t1-2),... Are input to the breathing index extracting unit 14, and the breathing index extracting unit 14 sets the expiration start time according to the equation (1). The predicted value pbpe (n) (respiration index) is calculated, and the predicted value pbpe (n) of the exhalation start time is output (step S14). Next, the control part 19 determines whether the respiration level by the required time was measured (step S14-2). In the present embodiment, the control unit 19 determines whether or not the respiratory level up to the time when one expiration start time (bpe (1)) can be specified has been measured. Here, when it is determined that the respiratory level up to the required time has not been measured, the process returns to step S13.

  On the other hand, when it is determined that the respiratory level up to the required time has been measured, the playback speed calculation unit 15 stores the predicted value pbpe (n) of the expiration start time output from the respiratory index extraction unit 14 and the storage unit 12. Sample respiration target sample point Bpe (m) and sample point τ = p (t1) extracted from the respirated target distribution content 12a are input, and sample update interval S (t1) (reproduction speed information) according to equation (2) Is calculated and output (step S15).

  The content playback speed control unit 16 includes the sample update interval S (t1) output from the playback speed calculation unit 15, the content information d (τ) extracted from the content 12a with the respiratory target distribution stored in the storage unit 12, and Is input, and the reproduction information r (τ) for reproducing the content information d (τ) corresponding to the sample point τ to be reproduced is sequentially updated while updating the sample point τ to be reproduced at the sample update interval S (t1). Output (step S16).

  The playback unit 17 receives the playback information r (τ) output from the content playback speed control unit 16 and outputs the content specified by the playback information r (τ) (step S17).

Next, it is determined whether or not it is time t = t1 + 1 when the respiration measurement unit 13 measures a new respiration level V (t1 + 1) (step S18). Here, when it is determined that it is not the time t = t1 + 1 at which the new respiration level V (t1 + 1) is measured, the process returns to step S16. On the other hand, when it is determined that the time t = t1 + 1 at which the new respiration level V (t1 + 1) is measured, the control unit 19 then includes all the content information d ( It is determined whether or not the reproduction of [tau] has been completed (step S19).
Here, when it is determined that the reproduction of all the content information d (τ) has not been completed, t1 + 1 is set as a new t1 and the process returns to step S13. On the other hand, if it is determined that the reproduction of the content information d (τ) has been completed, the process ends.

[Second Embodiment]
The second embodiment is a modification of the first embodiment. The content with respiratory distribution of the second embodiment further includes a synchronization importance that is a coefficient corresponding to each reproduction position, and the reproduction speed calculation unit of the second embodiment further receives the synchronization importance and inputs each synchronization importance. For each reproduction position corresponding to the degree, a reproduction speed depending on the synchronization importance corresponding to the reproduction position is determined.
In the second and subsequent embodiments, the description will focus on matters that are different from the first embodiment, and descriptions of items that are common to the first embodiment will be omitted. The same reference numerals are used for the same processing units and processing steps, and the description is not repeated.

<Configuration>
As illustrated in FIG. 1, the playback speed synchronization apparatus 2 according to the second embodiment includes an input unit 21, a storage unit 22 that stores content 22 a with respiratory distribution, a respiratory measurement unit 13, and a respiratory index extraction unit 14. A playback speed calculation unit 25, a content playback speed control unit 16, a playback unit 17, and a control unit 19.

[Input unit 21, storage unit 22, content with respiratory distribution 22a]
The input unit 21 is a functional unit that receives an input of the content 22a with respiratory distribution, and the storage unit 22 stores the content 22a with respiratory distribution. The content 22a with respiratory distribution of the present embodiment includes content information corresponding to each reproduction position along the time axis and a position corresponding to at least a part of the reproduction positions (for example, the reproduction position or a specific relationship with the reproduction position). A data structure including respiration target information for specifying a predetermined respiration state for each respiration target setting position, and a synchronization importance that is a coefficient corresponding to each reproduction position. It is data. Here, the synchronization importance indicates the importance of the breathing target information corresponding to the reproduction position corresponding to the synchronization importance. That is, the greater the importance of synchronization, the greater the importance of synchronizing the breathing target information corresponding to the reproduction position corresponding thereto with the breathing of the viewer 100 when the content information corresponding to the reproduction position is reproduced. Take a large value. In the case of the second embodiment, it is desirable that the synchronization importance is set to a value between 0 and 1.

  For example, the content 22a with respiratory distribution illustrated in FIG. 6 includes content information d (τ) which is MIDI data indicating the pitch and the sound intensity corresponding to each sample point τ (reproduction position) along the time axis. In addition to the breathing target information Bpe (μ) for specifying the breathing start state defined for each breathing target sample point, which is a desirable sample point as the time point when the expiration movement is started, and further, at each sample point τ The data has a data structure including the synchronization importance α (τ), which is a corresponding coefficient.

[Reproduction speed calculation unit 25]
The reproduction speed calculation unit 25 is a processing unit configured, for example, by reading a predetermined program into the CPU. The reproduction speed calculation unit 25 receives the breathing target information, the synchronization importance, and the breathing index, and the breathing state specified by the breathing target information corresponding to any one of the breathing target setting positions corresponds to the breathing target setting position. For each playback position corresponding to each synchronization importance level, a playback speed that depends on the synchronization importance level corresponding to the playback position is set and set so as to approach the viewer's breathing state at the time when the content information is played back. Playback speed information for specifying the playback speed is output.

FIG. 6 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the second embodiment.
The reproduction speed calculation unit 25 outputs the respiratory target extracted from the breath target distribution with the predicted respiratory rate pbpe (n) output from the respiratory index extraction unit 14 and the respiratory target distribution content 22 a stored in the storage unit 22. The sample point Bpe (m), the synchronization importance α (p (t1)) and the sample point τ = p (t1) are input, and the synchronization importance α (p (t1)) of the sample point τ = p (t1) The sample update interval S (t1) is set so that the reproduction time of the content information d (τ) corresponding to the breath target sample point Bpe (m) approaches the predicted value pbpe (n) of the expiration start time. Calculate as follows.
S (t1) = α (p (t1)) {(((pbpe (n) -t1) × T1 / (Bpe (m) -p (t1)))-S0} + S0 (3)
Here, S0 is a standard setting value of a predetermined sample update interval, α (p (t1)) {((pbpe (n) -t1) × T1 / (Bpe (m) -p (t1)) ) -S0} is the amount of change in the sample update interval. That is, when the synchronization importance α (p (t1)) is 1, the playback speed calculation unit 25 sets the sample point to be played back from p (t1) to Bpe between time t1 and time pbpe (n). A sample update interval S (t1) that is updated up to (m) is calculated. On the other hand, when the synchronization importance α (p (t1)) is 0 or more and less than 1, the playback speed calculation unit 25 determines that the change amount of the sample update interval with respect to the standard setting value S0 is the synchronization importance α (p (t1)). A sample update interval S (t1) smaller than that in the case of 1 is calculated. In particular, when the synchronization importance α (p (t1)) is 0, S (t1) = S0.

<Method>
Next, the playback speed synchronization method of this embodiment will be illustrated with reference to FIG.
The difference from the first embodiment is that, instead of the processing of steps S11 and S12, the content 22a with respiratory distribution is input to the input unit 21 (step S21) and stored in the storage unit 22 (step S22). Instead of the processing of step S15, the reproduction speed calculation unit 25 uses the predicted value pbpe (n) of the expiration start time output from the respiratory index extraction unit 14 and the content 22a with a respiratory target distribution stored in the storage unit 22. The extracted respiration target sample point Bpe (m), synchronization importance α (p (t1)) and sample point τ = p (t1) are input, and the sample update interval S (t1) (reproduction speed) according to equation (3) Information) is calculated and output (step S25). Others are the same as the first embodiment.

[Third Embodiment]
This embodiment is a modification of the first and second embodiments. The breathing target information and the breathing index of the third embodiment are information (information for specifying the phase) corresponding to the phase of the periodic breathing motion, and the reproduction speed calculation unit of the third embodiment The difference between the phase specified by the respiratory target information corresponding to the respiratory target setting position and the phase specified by the respiratory index at the time when the content information corresponding to the respiratory target setting position is reproduced is reduced. The playback speed information for specifying the correct playback speed is output.

<Configuration>
As illustrated in FIG. 1, the playback speed synchronization device 3 of the third embodiment includes an input unit 31, a storage unit 32 that stores content 32 a with respiratory distribution, a respiratory measurement unit 13, and a respiratory index extraction unit 34. A playback speed calculation unit 35, a content playback speed control unit 16, a playback unit 17, and a control unit 19.

[Input unit 31, storage unit 32, content 32a with respiratory distribution]
The input unit 31 is a functional unit that receives input of content with respiratory distribution 32a, and the storage unit 32 stores content with respiratory distribution 32a. The content 32a with respiratory distribution of the present embodiment includes content information corresponding to each reproduction position along the time axis, and a position corresponding to at least a part of the reproduction positions (for example, the reproduction position or a specific relationship with the reproduction position). Respiration target information for specifying a predetermined respiration state for each respiration target setting position. The difference from the first and second embodiments is that the respiratory target information is information corresponding to the phase of periodic respiratory motion.

  For example, the content 32a with respiratory distribution illustrated in FIG. 7 includes content information d (τ) that is MIDI data indicating the pitch and the sound intensity corresponding to each sample point τ (playback position) along the time axis. , Information Φ (τ) (respiration target information), which is determined for all sample points τ (respiration target setting position), for specifying a desirable “period of respiratory motion” at each sample point τ; , Data having a data structure including synchronization importance α (τ). A specific example of the respiratory target information Φ (τ) of this embodiment will be described later.

[Respiration index extraction unit 34]
The respiratory index extraction unit 34 is a processing unit configured by, for example, a predetermined program being read into the CPU. The respiratory index extraction unit 34 extracts information corresponding to the phase of the periodic respiratory motion of the viewer as the respiratory index from the respiratory information obtained by measuring the viewer, and outputs the respiratory index.

FIG. 8A is a diagram for explaining an example of a respiratory index calculated by the respiratory index extraction unit of the third embodiment.
There is no particular limitation on what value is used as “information corresponding to the phase of the viewer's periodic respiratory motion”. For example, a vector in which the respiration level V (t) is the first dimension value and the delay value V (t-γ) is the second dimension value is “information corresponding to the phase of the viewer's periodic breathing motion. Or a polar coordinate in the space (phase space) of the Cartesian coordinate system with the respiratory level V (t) as the first dimension value and the delay value V (t-γ) as the second dimension value. The declination may be “information corresponding to the phase of the viewer's periodic respiratory motion”.

In the following, the polar angle declination in the space (phase space) of the Cartesian coordinate system with the respiratory level V (t) as the first dimension value and the delay value V (t-γ) as the second dimension value is “ This is used as information corresponding to the phase of the viewer's periodic respiratory motion (respiration index φ (t)). In this case, the processing corresponding to the time t by the respiratory index extraction unit 34 is, for example, as follows.
1. The respiration level V (t) at time t output from the respiration measurement unit 13 is set as the first dimension value of the phase space.
2. Let the respiration level V (t-γ) obtained by passing the respiration level V (t) through the time delay filter be the second-dimensional value of the phase space. Here, γ is a delay width (constant) of the time delay filter, and in the case of breathing, about 200 ms to 800 ms is desirable.
3. The deviation angle when the points (V (t), V (t−γ)) in the orthogonal coordinate system of the phase space are displayed in polar coordinates is obtained and output as a respiratory index φ (t) (see FIG. 8A).
When such a value is used as the respiratory index φ (t), the desired respiratory index φ (t) at each predetermined sample point τ is the respiratory target information Φ (τ) ( As shown in FIG. 7, it is set to the content 32a with respiratory distribution.

[Reproduction speed calculation unit 35]
The reproduction speed calculation unit 35 is, for example, a processing unit configured by reading a predetermined program into the CPU. The reproduction speed calculation unit 35 is specified by the phase specified by the respiration target information corresponding to one of the respiration target setting positions and the respiration index at the time when the content information corresponding to the respiration target setting position is reproduced. Reproduction speed information for specifying a reproduction speed such that the difference from the phase is small is output.

FIG. 7 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the third embodiment.
The playback speed calculation unit 35 of this embodiment sets the playback speed of the content by determining the sample update interval. In addition, the reproduction speed calculation unit 35 of this embodiment determines the sample update interval S (t) every time the respiration measurement unit 13 obtains the respiration level V (t), that is, the period T1, and uses this as the reproduction speed information. Output.

It is assumed that the reproduction up to the content information d (p (t1)) corresponding to the sample point τ = p (t1) is completed at the time t = t1. At this time, the respiration target information corresponding to the sample point τ = p (t1) included in the content 32a with respiration distribution is Φ (p (t1)), and is output from the respiration index extraction unit 34 at time t = t1. The respiration index (information corresponding to the phase of the viewer's periodic respiratory motion) is φ (t1). The reproduction speed calculation unit 35 receives the respiration index φ (t1) and the respiration target information Φ (p (t1)) as input, and the angle formed on the phase space in FIG. Ask.
R (t1) = φ (t1) -Φ (p (t1)) (4)
If | R (t1) |> π then L (t1) = R (t1) -Sgn (R (t1)) ・ 2π else L (t1) = R (t1) (5)
However, Sgn (δ) is a sign function, and the function value is Sgn (δ) =-1 when δ <0, Sgn (δ) = 0 when δ = 0, and δ> 0. Sometimes Sgn (δ) = 1. When L (t1)> 0, the viewer's breathing has progressed more than the breath indicated by the breathing target information at time t1, and when L (t1) <0, the viewer's breathing has been at the breathing target at time t1. It is later than the breath indicated by the information. FIG. 8B illustrates the relationship between the respiratory index φ (t1), the respiratory target information Φ (p (t1)), and L (t1). FIG. 8B is an example of L (t1) <0.

Then, the playback speed calculation unit 35 calculates the sample update interval S (t1) at time t1 as follows, and outputs this as playback speed information.
S (t1) = S0 / {α (p (t1)) ・ C ・ L (t1) +1} (6)
Here, S0 is a standard setting value of a predetermined sample update interval, and C is an arbitrary constant that satisfies C> 0. For example, if the constant C is determined so that α (p (t)) · C · L (t) +1> 0 for all possible α (τ) and L (t), the playback speed The calculation unit 25 calculates a sample update interval S (t1) larger than S0 when the viewer's breathing is ahead of the breathing indicated by the breathing target information (L (t1)> 0), and the viewer's breathing is calculated. Is synchronized with the breath indicated by the respiratory target information (L (t1) = 0), the sample update interval S (t1) equal to S0 is calculated, and the viewer's breath is delayed from the breath indicated by the respiratory target information If so (L (t1) <0), a sample update interval S (t1) smaller than S0 is calculated.

<Method>
Next, the playback speed synchronization method of this embodiment will be illustrated with reference to FIG.
The difference from the first embodiment is that instead of the processing of steps S11 and S12, the content 32a with respiratory distribution is input to the input unit 31 (step S31) and stored in the storage unit 32 (step S32). Instead of the processing in step S14, the respiratory index extraction unit 34 receives the respiratory level V (t) as an input and generates a respiratory index φ (t) that is information corresponding to the phase of the viewer's periodic respiratory motion. (Step S34), instead of step S14-2, the control unit 19 determines whether or not λ + 1 respiratory levels V (t) have been measured. If No, the process of step S13 is performed. In the case of Yes, the process proceeds to the following step S35 (step S34-2). Instead of step S15, the reproduction speed calculation unit 35 uses the respiration index φ (t1) and the respiration target information Φ (p (t1). )) As input, and according to equations (4)-(6) A sample update interval S (t1) is calculated and output as reproduction speed information (step S35). Others are the same as the first embodiment.

[Modification 1 of Third Embodiment]
In the third embodiment, an example is shown in which phase space representation is used in which the respiration level V (t) is taken in the first dimension and the delay value V (t-γ) is taken in the second dimension. However, other phase space expressions may be used in the third embodiment. For example, the respiratory level V (t) is taken as the first dimension, and the Hilbert transform value of V (t) (generally called an analytic signal) is taken as the second dimension. (For example, “K. Kotani, K. Takamasu, Y. Jimbo, Y. Yamamoto,“ Postural-induced phase shift of respiratory sinus arrhythmia and blood pressure variations: insight from respiratory-phase domain analysis, ”Am. J. Physiol. Heart. Circ. Physiol., Vol. 294, pp. H1481-H1489, 2008 ”). When the differential value W (t) of the respiratory level V (t) is obtained, the respiratory level V (t) is taken as the first dimension, and the differential value W (t) of the respiratory level V (t) is taken as the two-dimensional Good for the eyes. If the differential value W (t) of the respiratory level V (t) cannot be obtained, a pseudo differential value obtained by passing the respiratory level V (t) through a differential filter (for example, V (t) −V (t -1)) / T1) may be used in the second dimension (for example, a value corresponding to W (t) can be measured by using TR-712 manufactured by Nihon Kohden).

[Modification 2 of the third embodiment]
Moreover, the structure which produces | generates the content with a respiratory distribution which does not contain synchronous importance alpha (tau) may be sufficient. In this case, the same processing as that of the third embodiment in which the synchronization importance α (τ) is regarded as a predetermined value (for example, 1) may be performed.

[Fourth Embodiment]
In this embodiment, a method for automatically generating the content with respiratory distribution 12a (FIG. 4) exemplified in the first embodiment will be described. In this embodiment, the position on the time axis corresponding to the point in time when a specific breathing state of one performer who plays or plays the content occurs is used as the breathing target information, and is associated with the content information representing the content, with a breath distribution Content 12a is generated. In the following, description of matters common to any of the above-described embodiments is omitted.

FIG. 9 is a block diagram for illustrating a functional configuration of a respiratory distribution imparting apparatus that creates content with respiratory distribution.
As illustrated in FIG. 9, the respiration distribution imparting device 4 of the fourth embodiment includes a respiration measurement unit 41, a content acquisition unit 42, a storage unit 43, a respiration index extraction unit 44, and a respiration distribution creation unit 45. , An output unit 46 and a control unit 49.

[Control unit 49]
The control unit 49 is, for example, a processing unit configured by reading a predetermined program into the CPU. The control unit 49 controls the entire processing of the respiratory distribution applying device 4.

[Respiration measurement unit 41]
The respiration measurement unit 41 is a well-known device that measures the performer 400 who plays or performs content and outputs respiration information obtained thereby. In this embodiment, an apparatus having the same function as the above-described respiration measurement unit 13 is used as the respiration measurement unit 41. That is, the respiration measuring unit 41 in this example measures and outputs the respiration level V (t) at each time t at a set arbitrary period T1. In this embodiment, for convenience of calculation, the respiration level V (t) at each time t is measured at a period T1 with the content start time t = 0. However, the measurement of the respiration level V (t) may be started from a time point before the start time of the content, or may be started from a time point after the start time of the content.

[Content acquisition unit 42]
The content acquisition unit 42 is a known measurement device that measures an audio signal and a video signal representing content played or performed by the performer 400, and includes, for example, a microphone, a MIDI interface, a camera, a processing device, and the like. The content acquisition unit 42 outputs a material for creating content obtained from the measured audio signal or video signal, or content information representing the content itself. In this embodiment, an example in which the content acquisition unit 42 outputs content information d (p0 (t)) is shown. Playback is performed at time t when it is assumed that the content information d (τ) corresponding to the sample point τ to be reproduced is reproduced while updating the sample point τ to be reproduced at the sample update interval S0. A sample point corresponding to the content information d (τ) to be processed is expressed as τ = p0 (t). When the start time of the content is t = 0 and the corresponding sample point is τ = 0, the following relationship is satisfied.
p0 (t) = t × T1 ÷ S0 (7)

[Storage unit 43]
The storage unit 43 is an information storage device such as a magnetic recording device, an optical disc, a magneto-optical recording medium, or a semiconductor memory. The storage unit 43 records the content information d (p0 (t)) output from the content acquisition unit 42 and also records the respiration level V (t) (respiration information) output from the respiration measurement unit 41. These pieces of information are associated with time t. These pieces of information are appropriately read and used in the following processing.

[Respiration index extraction unit 44]
The breathing index extraction unit 44 is a processing unit configured by, for example, a predetermined program being read into the CPU. The breathing index extraction unit 44 extracts a breathing index that identifies the breathing state of the performer 400 at a position on the time axis along the progress of the content from the breathing information obtained by measuring the performer 400 who plays or performs the content. And output a respiratory index. The respiration index extraction unit 44 of the example of this embodiment receives the respiration level V (t) (respiration information) output from the respiration measurement unit 41, and uses the respiration start time bpe (n) of the performer 400 to be measured as a respiration. Output as an indicator. For example, the breathing index extraction unit 44 sets the time when the breathing level V (t) reaches the maximum value for each breathing exercise as the expiration start time bpe (n) and outputs them as a breathing index (see FIG. 2). Note that n is an index given for convenience of explanation, and is an integer corresponding to the number of breaths of the performer 400.

[Respiration distribution creation unit 45]
The respiration distribution creating unit 45 obtains respiration target information corresponding to the respiration state of the performer 400 at at least a part of the time axis from the respiration index, and the respiration target information is associated with the respiration target information. The content is output in association with the content information representing the content at the respiratory target setting position which is the upper position. The respiratory distribution creation unit 45 in this example receives the expiration start time bpe (n) output from the respiratory index extraction unit 44, generates respiratory target information Bpe (μ) therefrom, and generates the generated respiratory target information Bpe (μ). Is associated with the content information d (τ) representing the content at the respiration target setting position τ = Bpe (μ). μ is an index given for convenience of explanation, and is a continuous integer of 0 or more for identifying each respiration target information Bpe (μ). A larger value μ corresponds to later respiratory target information in time.

The processing of the respiratory distribution creation unit 45 is exemplified below.
The breath distribution creation unit 45 converts the input exhalation start time bpe (n) (n = 0, 1,...) Into the sample point τ = p0 (bpe (n)), and the exhalation start sample point bpe ′ ( n) (n = 0,1, ...) is generated. This conversion is performed as follows, for example.
bpe '(n) = bpe (n) × T1 ÷ S0 (8)

The respiration distribution creation unit 45 sets the exhalation start sample point bpe ′ (n) as respiration target information Bpe (μ) (μ = n) as follows.
Bpe (μ) = bpe '(μ) (μ = 0,1, ...) (9)
The respiration distribution creation unit 45 associates the respiration target information Bpe (μ) with the corresponding content information d (Bpe (μ)), and each respiration target information Bpe (μ) and the content information d (τ ) Is output.

[Output unit 46]
The output unit 46 is an output port, an output interface, or other output device. The output unit 46 receives the respiration target information Bpe (μ) and the content information d (τ) output from the respiration distribution creation unit 45. The output unit 46 outputs the content with respiratory distribution 12a (FIG. 4) that combines these while maintaining the correspondence.

[Fifth Embodiment]
In this embodiment, a method for automatically generating the content with respiratory distribution 32a (FIG. 7) exemplified in the third embodiment will be described. In this embodiment, information corresponding to the phase of breathing motion of one performer who plays or plays content is used as breathing target information, and the content 32a with breath distribution is generated by associating them with content information representing the content. In the following description, the same reference numerals as those described above are used for matters common to any of the above-described embodiments, and description thereof is omitted.

  As illustrated in FIG. 9, the respiration distribution imparting apparatus 5 of the fifth embodiment includes a respiration measurement unit 41, a content acquisition unit 42, a storage unit 43, a respiration index extraction unit 54, and a respiration distribution creation unit 55. , And an output unit 56 and a control unit 49.

[Respiration measurement unit 41, content acquisition unit 42, storage unit 43]
This is as described in the fourth embodiment.

[Respiration index extraction unit 54]
The respiratory index extraction unit 54 is a processing unit configured by, for example, a predetermined program being read into the CPU. The breathing index extraction unit 54 extracts a breathing index that specifies the breathing state of the performer at a position on the time axis along the progress of the content from the breathing information obtained by measuring the performer 400 who plays or performs the content. , Output respiratory index. The breathing index extraction unit 54 of the example of this embodiment receives the breathing level V (t) (breathing information) output from the breathing measurement unit 41 and breathes information corresponding to the phase of the periodic breathing motion of the performer 400. Output as index φ (t). For example, the respiration index extraction unit 54, in the same manner as the respiration index extraction unit 34 described above, calculates the declination when a point (V (t), V (t−γ)) in the orthogonal coordinate system of the phase space is displayed in polar coordinates. The respiratory index φ (t) is obtained and output (see FIG. 8A). Or you may output the information which specifies the phase determined like the modification 1 of 3rd Embodiment as a respiration index (phi) (t).

[Respiration distribution creation unit 55]
The respiratory distribution creation unit 55 is a processing unit configured by, for example, reading a predetermined program into the CPU. The respiration distribution creation unit 55 obtains respiration target information corresponding to the respiration state of the performer 400 at at least some positions on the time axis from the respiration index, and the respiration target information is related to the respiration target information. The content is output in association with the content information representing the content at the respiratory target setting position which is the upper position. The respiratory distribution creation unit 55 in this example receives the respiratory index φ (t) at each time t output from the respiratory index extraction unit 54, and generates respiratory target information Φ (τ) (τ = p0 (t)) therefrom. Then, the generated respiration target information Φ (τ) is output in association with the content information d (τ) representing the content at the respiration target setting position τ = p0 (t) corresponding thereto.

The processing of the respiratory distribution creation unit 55 will be exemplified below.
The respiration distribution creation unit 55 converts the respiration index φ ′ (τ) at each sample point τ = p0 (t) using the input respiration index φ (t) at each time t as follows.
φ '(τ) = φ (τ × S0 ÷ T1) (10)

  In the case of T1> S0, the respiration index φ ′ (τ) for all the sample points τ may not be generated from the input respiration index φ (t) at each time t using Equation (10). In such a case, the respiration index φ ′ (τ) for the sample point τ that cannot be obtained may be supplemented using the respiration index obtained using the equation (10). For example, if the respiration index φ ′ (τ−1) is obtained from Equation (10) but φ ′ (τ) is not obtained, φ ′ (τ) = φ ′ (τ−1) etc. The respiration index φ ′ (τ) may be supplemented.

Furthermore, the respiration distribution creation unit 55 determines a constant synchronization importance α (τ) for each sample point τ, and sets the respiration index φ ′ (τ) for the sample point τ as respiration target information Φ (τ) = φ ′ ( τ) (11)
And The respiration distribution creation unit 55 associates the respiration target information Φ (τ) and the synchronization importance α (τ) with the content information d (τ) corresponding thereto, and each respiration target information Φ (τ) and the synchronization importance α (Τ) and content information d (τ) are output.

[Output unit 56]
The output unit 56 receives the respiration target information Φ (τ), the synchronization importance α (τ), and the content information d (τ) output from the respiration distribution creation unit 55. The output unit 56 outputs the content 32a with respiration distribution (FIG. 7), which is a combination of these while maintaining these correspondences.

[Modification 1 of Fifth Embodiment]
In this embodiment, the respiratory distribution creation unit 55 outputs a constant synchronization importance α (τ), and the output unit 56 outputs the content with respiratory distribution 32a including the synchronization importance α (τ). However, when generating content with a respiratory distribution that does not include the synchronization importance α (τ) as in Modification 2 of the third embodiment, the respiratory distribution creation unit 55 outputs the synchronization importance α (τ). Instead, the output unit 56 may output a content with respiration distribution that combines each respiration target information Φ (τ) and the content information d (τ).

[Sixth Embodiment]
In this embodiment, a method for automatically generating the content 22a with respiration distribution (FIG. 6) exemplified in the second embodiment will be described. In this embodiment, breathing target information is generated in the same manner as in the fourth embodiment, and each synchronization importance that is a value corresponding to the inspiratory amount (respiration depth, amplitude magnitude) of each performer is respired. The content 22a with the respiratory distribution is generated by generating from the index and associating them with the content information. In the following description, the same reference numerals as those described above are used for matters common to any of the above-described embodiments, and description thereof is omitted.

  As illustrated in FIG. 9, the respiration distribution imparting device 6 of the sixth embodiment includes a respiration measurement unit 41, a content acquisition unit 42, a storage unit 43, a respiration index extraction unit 64, and a respiration distribution creation unit 65. , And an output unit 56 and a control unit 49.

[Respiration measurement unit 41, content acquisition unit 42, storage unit 43]
This is as described in the fourth embodiment.

[Respiration index extraction unit 64]
The breathing index extraction unit 64 is a processing unit configured by, for example, a predetermined program being read into the CPU. The breathing index extraction unit 64 extracts a breathing index that specifies the breathing state of the performer at a position on the time axis along the progress of the content from the breathing information obtained by measuring the performer who plays or performs the content, Output respiratory index. The respiration index extraction unit 64 of the example of this embodiment receives the respiration level V (t) (respiration information) output from the respiration measurement unit 41 as input, and the inhalation start time bpi (n) and expiration of the performer 400 to be measured. The start time bpe (n) is calculated as a respiratory index. For example, the breathing index extraction unit 44 sets the time when the breathing level V (t) becomes a minimum value for each breathing exercise as the inhalation start time bpi (n), and sets the time when the breathing level V (t) becomes a maximum as the expiration start time bpe (n). (See FIG. 10).

The respiration index extracting unit 64 calculates a difference value between the respiration level V (bpe (n)) corresponding to the exhalation start time bpe (n) and the respiration level V (bpi (n)) corresponding to the inspiration start time bpi (n). Is obtained as the respiration rate Vi (n) as follows.
Vi (n) = V (bpe (n))-V (bpi (n)) (12)
The breathing index extraction unit 64 outputs the expiration start time bpe (n) and the breathing volume Vi (n) as a breathing index.

[Respiration distribution creation unit 65]
The respiration distribution creation unit 65 obtains respiration target information corresponding to the respiration state of the performer 400 at at least some positions on the time axis from the respiration index, and corresponds the respiration target information to the content information at the respiration target setting position. In addition, each synchronization importance that is a value corresponding to each inspiration amount of the performer 400 is obtained from the respiration index, and content information at each reproduction position that is each position on the time axis corresponding to each respiration Are associated with each synchronization importance and output. The respiratory distribution creation unit 65 of this example receives the exhalation start time bpe (n) and the respiration rate Vi (n) output from the respiration index extraction unit 64, and from the exhalation start time bpe (n), the respiration target information Bpe (μ ), The respiratory target information Bpe (μ) is associated with the content information d (τ) at the respiratory target setting position τ = p0 (t) corresponding to the respiratory target information Bpe (μ), and the respiratory rate Vi ( The synchronization importance α (τ) is generated from n), and the synchronization importance α (τ) is output in association with the content information d (τ) at each sample point τ.

The processing of the respiratory distribution creation unit 65 is exemplified below.
An example of a procedure for generating the respiratory target information Bpe (μ) from the expiration start time bpe (n) is the same as that in the fourth embodiment (expressions (8) and (9)). An example of the procedure for generating the synchronization importance α (τ) from the respiration rate Vi (n) is as follows.
The respiration distribution creation unit 65 sets the synchronization importance α (Bpe (μ)) at the sample point indicated by the respiration target information Bpe (μ) as follows.
α (Bpe (n)) = b × Vi (n) (13)
However, b is an arbitrary proportional coefficient of b> 0.

The respiratory distribution creation unit 65 obtains the synchronization importance α (τ) at all the sample points τ by linear interpolation using the synchronization importance α (Bpe (μ)). The respiration distribution creation unit 65 obtains the synchronization importance α (τ) at the sample points τ = 0, 1, 2,..., Bpe (0) as follows, for example.
α (τ) = α (Bpe (0)) ÷ Bpe (0) × τ (14)
Further, the respiratory distribution creating unit 65, for example, the synchronization importance α (τ) at the sample points τ = Bpe (μ ₁ −1) +1, Bpe (μ ₁ −1) +2,..., Bpe (μ ₁ ) −1. Is obtained as follows. However, μ ₁ is an integer of 1 or more given for convenience in order to identify the respiratory target information.
α (τ) = {α (Bpe (μ ₁ ))-α (Bpe (μ ₁ -1))} ÷ {Bpe (μ ₁ ) -Bpe (μ ₁ -1)}
× (τ-Bpe (μ ₁ -1)) + α (Bpe (μ ₁ -1)) (15)

  The respiration distribution creation unit 65 associates the respiration target information Bpe (μ) with the corresponding content information d (Bpe (μ)), and associates the synchronization importance α (τ) with the corresponding content information d (τ). And output them.

[Output unit 66]
The output unit 66 receives the respiration target information Bpe (μ), the synchronization importance α (τ), and the content information d (τ) output from the respiration distribution creation unit 65. The output unit 66 outputs the content 22a with respiration distribution (FIG. 6), which is a combination of these while maintaining these correspondences.

[Seventh Embodiment]
In this embodiment, a method of automatically generating the content with respiratory distribution 12a (FIG. 4) exemplified in the first embodiment when there are a plurality of performers who perform ensembles or the like will be described. In this embodiment, respiration target information corresponding to a position on the time axis corresponding to a point in time when a specific respiration state (reference state) of a plurality of performers performing or performing the content occurs is determined, and the respiration target information is defined as the content The content with respiration distribution 12a is generated by associating the content information with the content information. In the following, description of matters common to any of the above-described embodiments is omitted.

FIG. 11 is a block diagram for illustrating a functional configuration of a respiration distribution imparting apparatus that creates content with respiration distribution.
As illustrated in FIG. 11, the respiration distribution imparting device 7 of the seventh embodiment includes a respiration measurement unit 71-0 to (I-1), a content acquisition unit 72-0 to (I-1), and a storage unit. 73, a respiratory index extraction unit 74, a respiratory distribution creation unit 75, an output unit 76, and a control unit 49.

[Respiration measuring unit 71-0 to (I-1)]
The respiration measuring units 71-0 to 71-1 (I-1) are well-known devices that respectively measure I performers 700-0 to 700-1 (I-1) who play or perform content and output respiration information obtained thereby. is there. I is an integer of 2 or more. Each of the respiration measuring units 71-0 to (I-1) has the same function as that of the respiration measuring unit 41 of the fourth embodiment, and in this embodiment as well as the respiration measuring unit 41, performers 700-0 to (I- An example of measuring and outputting the respiration level V (i, t) (i = 0,..., I-1) (respiration information) at each time t in the period T1 for each of 1). V (i, t) is a respiration level obtained by measuring the performer 700-i (see FIG. 12A).

[Content Acquisition Units 72-0 to (I-1)]
The content acquisition units 72-0 to (I-1) are well-known measuring devices that respectively measure an audio signal and a video signal representing content played or performed by the performers 700-0 to (I-1). Each of the content acquisition units 72-0 to (I-1) has the same function as that of the content acquisition unit 42 of the fourth embodiment, and in this embodiment as well as the content acquisition unit 42, the content acquisition units 72-0 to 72-0. (I-1) measures an audio signal or a video signal representing content played or performed by the performers 700-0 to (I-1), and content information d (i, p0 (t)) (i = 0). , ..., I-1) is output. d (i, p0 (t)) is content information representing content played or performed by the performer 700-i.

[Storage unit 73]
The storage unit 73 records the content information d (i, p0 (t)) (i = 0,..., I-1) output from the content acquisition units 72-0 to (I-1), respectively. Respiration levels V (i, t) (i = 0,..., I-1) (respiration information) respectively output from the respiration measuring units 71-0 to (I-1) are recorded. These information are related to i and t. These pieces of information are appropriately read and used in the following processing.

[Respiration index extraction unit 74]
The respiratory index extraction unit 74 is a processing unit configured by, for example, a predetermined program being read into the CPU. The breathing index extraction unit 74 uses the respiration information obtained by measuring the plurality of performers 700-0 to (I-1) who play or perform the content at the position on the time axis along the progress of the content. Respiratory indices that respectively identify the respiratory states of the performers 700-0 to (I-1) are extracted. Each of the respiration indexes of the present embodiment specifies a respiration reference position that is a position on the time axis at which the respiration state of the performer 700-i becomes a specific reference state. In the following, similarly to the breathing index extraction unit 44 of the fourth embodiment, the breathing index extraction unit 74 outputs the breathing level V (i, t) (i =) output from the breathing measurement units 71-0 to (I-1). 0,..., I-1) (breathing information) are input, and each exhalation start time bpe (i, n) (breathing reference position) is output as a breathing index (see FIG. 12B). bpe (i, n) represents the expiration start time corresponding to the performer 700-i.

[Respiration distribution generator 75]
The respiration distribution creation unit 75 obtains respiration target information corresponding to the respiration states of the plurality of performers 700-0 to (I-1) at at least some positions on the time axis from the respiration index, and the respiration target information Is output in association with the content information representing the content at the respiration target setting position, which is the position on the time axis corresponding to the respiration target information. The respiratory distribution creation unit 75 of the present embodiment corresponds to the respiratory target information representing the position on the time axis corresponding to the peak of the probability density function obtained using the value corresponding to the respiratory reference position specified by the respiratory index as a sample. The content information representing the content at the breathing target setting position that is the position on the time axis is output in association with the content information. In the following, the respiratory target information Bpe (μ) representing the sample point corresponding to the peak of the probability density function obtained using bpe ′ (i, n) corresponding to the exhalation start time bpe (i, n) as a sample, An example of outputting in association with the content information d (τ) at the setting position τ = Bpe (μ) will be described.

The respiratory distribution creation unit 75 uses the input exhalation start time bpe (i, n) (i = 0, ..., I-1, n = 0,1, ...) as a sample point τ = p0 (bpe (i, n)) is generated into the exhalation start sample point bpe '(i, n) (i = 0, ..., I-1, n = 0,1, ...) (see FIG. 12C). ). This conversion is performed as follows, for example.
bpe '(i, n) = bpe (i, n) × T1 ÷ S0 (16)

ただし、Iは呼吸計測された演者７００−０〜（Ｉ−１）の人数、N(i)は演者７００−ｉ（i=0,...,I-1）が演奏中又は演じ中に呼吸した回数を表し、k()はカーネル関数（kernel function）を表す。 Next, the respiratory distribution creation unit 75 calculates the probability density of the exhalation start sample point bpe '(i, n) (i = 0, ..., I-1, n = 0,1, ...) as a sample. The function Pbpe (τ) is obtained. Here, the sampling point bpe '(i, n) (i = 0, ..., I-1, n = 0,1, ...) is considered as a sample, and the kernel density estimation method (reference document “CM Bishop, pattern recognition and machine learning (above, see Springer, 2007, section 2.5.1)). In this case, the probability density function Pbpe (τ) (probability density distribution) at the sample point τ = t × T1 ÷ S0 corresponding to the time when time t × T1 has elapsed from the start time t = 0 of the content is as follows, for example: become.

However, I is the number of performers 700-0 to (I-1) whose respiration is measured, and N (i) is the performer 700-i (i = 0, ..., I-1) is performing or performing. Represents the number of breaths, and k () represents a kernel function.

ただし、hは標準偏差を表し、Ｈはガウス関数の対称軸となる平均を表す定数である。例えば平均Ｈを０とし、標準偏差hとして500msに相当する値を例示できる。 The kernel function k () may be a function generally used as a kernel density estimation method, and for example, a Gaussian function can be used. When a Gaussian function is used as the kernel function k (), the probability density function Pbpe (τ) is, for example, as follows.

However, h represents a standard deviation, and H is a constant representing an average that is a symmetry axis of a Gaussian function. For example, a value corresponding to 500 ms can be exemplified as an average H being 0 and a standard deviation h.

The respiration distribution creation unit 75 sets at least a part of the sample points τ corresponding to the peak of the probability density function Pbpe (τ) as respiration target information Bpe (μ). For example, the respiration distribution creation unit 75, among the peaks of the probability density function Pbpe (τ), sample points corresponding to peaks exceeding a predetermined threshold Th (Th is a value satisfying Th ≧ 0, for example, Th = I × 0.7). Let τ be the respiration target information Bpe (μ). For example, since the peak A in FIG. 12D is less than the threshold value Th, the sample point τ corresponding to the peak A is not used as the respiratory target information Bpe (μ). However, two or more pieces of respiration target information Bpe (μ) are not set within a predetermined window width (for example, a section corresponding to 2 seconds). When there are a plurality of peaks exceeding the threshold value Th within the window width, only the peak with the largest value (probability) is used as the respiratory target information Bpe (μ) (see FIG. 12D). For example, although the peak of B in FIG. 12D exceeds the threshold value Th, a peak having a larger value exists within the window width, and therefore the sample point τ corresponding to the peak of B is not used as the respiration target information Bpe (μ).
The respiration distribution creating unit 75 associates the respiration target information Bpe (μ) with the corresponding content information d (Bpe (μ)), and the respiration target information Bpe (μ) and the content information d (τ of each sample point τ). ) Is output.

[Output unit 76]
The output unit 76 receives the respiration target information Bpe (μ) and the content information d (τ) output from the respiration distribution creation unit 75. The output unit 76 outputs the content with respiratory distribution 12a (FIG. 4) that combines these while maintaining the correspondence.

[Modification of the seventh embodiment]
In the modification of the seventh embodiment, a method of automatically generating the content 22a with the respiratory distribution (FIG. 6) exemplified in the second embodiment when there are a plurality of performers will be described. In the modification of the seventh embodiment, each respiration index specifies a respiration reference position, which is a position on the time axis at which each performer's respiration state becomes a specific reference state. The respiration distribution creation unit 75 of this modification example obtains each synchronization importance corresponding to the function value at the peak of the probability density function at the respiration reference position from the respiration index, and on the time axis corresponding to each synchronization importance. Each synchronization importance is output in association with the content information representing the content at each playback position.

Only the differences from the seventh embodiment will be described below. Other matters are the same as those in the seventh embodiment. In the modification of the seventh embodiment, the respiratory distribution creation unit 75 determines the respiratory target information Bpe (μ) as in the seventh embodiment, and further, the synchronization importance α at the sample point indicated by the respiratory target information Bpe (μ) (Bpe (μ)) is determined as follows.
α (Bpe (n)) = b0 × Pbpe (Bpe (μ)) (19)
However, b0 is an arbitrary proportional coefficient of b0> 0.

  Further, in the modified example of the seventh embodiment, the respiratory distribution creation unit 75 obtains the synchronization importance α (τ) at each sample point τ by the linear interpolation shown in the equations (14) and (15) of the sixth embodiment. Ask. The respiration distribution creation unit 75 associates the respiration target information Bpe (μ) with the corresponding content information d (Bpe (μ)), and associates the synchronization importance α (τ) with the corresponding content information d (τ). And output them.

  The output unit 76 receives the respiration target information Bpe (μ), the synchronization importance α (τ), and the content information d (τ) output from the respiration distribution creation unit 75. The output unit 76 outputs the content 22a with respiration distribution (FIG. 6) combining these while maintaining these correspondences.

[Eighth Embodiment]
In the present embodiment, a method of automatically generating the content with respiratory distribution 32a (FIG. 7) exemplified in the third embodiment when there are a plurality of performers will be described. In this embodiment, each respiration index is information corresponding to a phase corresponding to each performer's respiration motion. In this embodiment, information corresponding to the phase of the centroid vector obtained from the vectors on the phase space corresponding to the phases of the respiratory motions of a plurality of performers is used as the respiratory target information and is associated with the content information. Further, each synchronization importance corresponding to the sum of the distance between the center of gravity vector obtained from each vector on the phase space corresponding to the phase of the respiratory motion of each of the plurality of performers and each vector is obtained from the respiratory index, Each synchronization importance is associated with content information at each reproduction position at each time point on the time axis corresponding to the synchronization importance. Thereby, the content 32a with respiration distribution is generated. In the following description, the same reference numerals as those described above are used for matters common to any of the above-described embodiments, and description thereof is omitted.

  As illustrated in FIG. 11, the respiration distribution imparting device 8 according to the eighth embodiment includes a respiration measurement unit 71-0 to (I-1), a content acquisition unit 72-0 to (I-1), and a storage unit. 73, a respiratory index extraction unit 84, a respiratory distribution creation unit 85, an output unit 86, and a control unit 79.

[Respiration measurement units 71-0 to (I-1), content acquisition units 72-0 to (I-1), storage unit 73]
This is as described in the seventh embodiment.

[Respiration index extraction unit 84]
The breathing index extraction unit 84 is a processing unit configured, for example, by reading a predetermined program into the CPU. The respiration index extracting unit 84 uses the respiration information obtained by measuring each of the plurality of performers 700-0 to (I-1) playing or performing the content, and the performer at a position on the time axis along the progress of the content. A respiration index that specifies each of the respiration states 700-0 to (I-1) is extracted, and the respiration index is output. The respiration index extraction unit 84 of the example of this embodiment receives the respiration level V (i, t) (respiration information) output from the respiration measurement units 71-0 to (I-1) and inputs performers 700-0 to ( Information corresponding to the phase of the periodic respiratory motion of I-1) is output as a respiratory index. For example, the respiration index extracting unit 84 performs the point (V (i, t), V (i, t-γ)) of the above-described orthogonal coordinate system of the phase space, in other words, the vector (V (i, t) on the phase space. ), W (i, t)) = (V (i, t), V (i, t-γ)) is obtained and output as a respiratory index (see FIG. 8A). Alternatively, as in the first modification of the third embodiment, the first dimension and the second dimension of the vector (V (i, t), W (i, t)) on the phase space are determined, and the vector (V (i , t), W (i, t)) may be output as a respiratory index.

[Respiration distribution creation unit 85]
The respiratory distribution creation unit 85 is a vector (V (i, t), W (i, t)) (breathing on the phase space corresponding to the phase of the respiratory motion of each of the performers 700-0 to (I-1). Respiration target information, which is information corresponding to the phase of the centroid vector obtained from the (index), is generated. In addition, the respiration distribution creating unit 85 obtains the center of gravity vector obtained from each vector (V (i, t), W (i, t)) and each vector (V (i, t), W (i, t)). Each synchronization importance having a relation of decreasing monotonically in a broad sense (not increasing with respect to the increase in the total distance) with respect to the increase in the total distance with the. These are output in association with the content information as described above.

The processing of the respiratory distribution creation unit 85 is exemplified below.
The respiratory distribution creating unit 85 uses each vector (V (i, t), W (i, t)) and uses the vector (V ′ (i, τ) at each sample point τ = p0 (t) as follows. ), W ′ (i, τ)).
(V '(i, τ), W' (i, τ)) = (V (i, τ × S0 ÷ T1), W (i, τ × S0 ÷ T1)) (20)

  If S0 ÷ T1 is not an integer, the vector (V (i, t), W (i, t)) for each sample point τ using the expression (20) from each input vector (V (i, t), W (i, t)). V ′ (i, τ), W ′ (i, τ)) may not be generated. In such a case, the vector (V ′ (i, τ), W ′ (i, τ)) for the sample point τ that cannot be obtained can be complemented using the vector obtained using the equation (20). Good. For example, the vector (V ′ (i, τ−1), W ′ (i, τ−1)) is obtained from the equation (20), but (V ′ (i, τ), W ′ (i, τ)) If (V ′ (i, τ), W ′ (i, τ)) = (V ′ (i, τ−1), W ′ (i, τ−1)) etc. (V ′ (i, τ), W ′ (i, τ)) may be complemented.

The respiratory distribution creation unit 85 obtains the center of gravity (G1 (τ), G2 (τ)) of each vector (V ′ (i, τ), W ′ (i, τ)) as follows (see FIG. 13A). .

The center of gravity (G1 (τ), G2 (τ)) represented in the orthogonal coordinate system is converted into a polar coordinate system, and the declination (phase) is used as respiration target information. For example, the respiration target information Φ (τ) for each sample point τ is determined as follows.
Φ (τ) = arctan (G2 (τ) ÷ G1 (τ)) (23)
However, arctan () represents the inverse function of the tangent function (four-quadrant inverse tangent function).

Further, the respiration distribution creating unit 85 generates a vector (V ′ (i, τ), W ′ (i, τ)) (i = i) corresponding to each performer 700-i from the center of gravity (G1 (τ), G2 (τ)). Find the sum of the distances to (0, ..., I-1), and let this be D (τ). For example, the respiratory distribution creation unit 85 obtains the sum D (τ) at each sample point τ as follows.

The respiratory distribution creating unit 85 has a synchronization importance α () at each sample point τ that is in a monotonically decreasing relationship (a relationship that does not increase with an increase in the sum D (τ)) with respect to the increase in the sum D (τ). τ) is determined. This is because the vector points (V ′ (i, τ), W ′ (i, τ)) (i = 0,..., I) corresponding to each performer 700-i are synchronized as sample points τ are similar to each other. Based on high importance. For example, when D (τ) is not 0, the respiratory distribution creation unit 85 sets the value inversely proportional to D (τ) as the synchronization importance α (τ) as follows.
α (τ) = b1 ÷ D (τ) (25)
However, b1 is an arbitrary constant with b1> 0.
On the other hand, when D (τ) = 0, the respiratory distribution creation unit 65 sets a predetermined maximum value that can be set as the synchronization importance α (τ).

  The respiration distribution creating unit 85 associates the respiration target information Φ (τ) and the synchronization importance α (τ) with the content information d (τ) corresponding to them, and each respiration target information Φ (τ) and the synchronization importance α (Τ) and content information d (τ) are output.

[Output unit 86]
The output unit 86 receives the respiration target information Φ (τ), the synchronization importance α (τ), and the content information d (τ) output from the respiration distribution creation unit 85. The output unit 86 outputs the content 32a with respiration distribution (FIG. 7) that combines these while maintaining these correspondences.

[Modification 1 of Eighth Embodiment]
In the eighth embodiment, the respiratory distribution creation unit 85 generates and outputs a constant synchronization importance α (τ), and the output unit 86 outputs the content 32a with a respiratory distribution including the synchronization importance α (τ). However, when generating a content with a respiratory distribution that does not include the synchronization importance α (τ) as in Modification 2 of the third embodiment, the respiratory distribution creation unit 85 generates the synchronization importance α (τ). Instead of outputting, the output unit 86 may output a content with respiration distribution obtained by combining each respiration target information Φ (τ) and the content information d (τ).

ただしω(i)(i=0,...,I)は重みを表す０以上の定数である。その他（G1(τ),G2(τ)）が（G1’(τ),G2’(τ)）に置き換わる以外の構成・処理は第８実施形態と同様である。 [Modification 2 of Eighth Embodiment]
When the respiratory distribution creating unit 85 calculates the center of gravity of each vector (V ′ (i, τ), W ′ (i, τ)), each vector (V ′ (i, τ), W ′ (i, τ)) ) May be assigned weights ω (i) (i = 0,..., I) corresponding to the performer 700-i (for example, the contribution of vocals is increased). In this case, the centroid vectors (G1 ′ (τ), G2 ′ (τ)) (weighted centroids) are as follows.

However, ω (i) (i = 0,..., I) is a constant greater than or equal to 0 representing the weight. Other configurations and processes are the same as in the eighth embodiment except that (G1 (τ), G2 (τ)) is replaced with (G1 ′ (τ), G2 ′ (τ)).

[Modification 3 of Eighth Embodiment]
Each vector (V ′ (i, τ), W ′ (i, τ)) on the phase space corresponding to the phase of respiratory motion of a plurality of performers 700-i (i = 0,..., I) The centroid vector (G1 ″ (τ), G2 ″ (τ)) may be obtained from each normalized vector obtained by normalizing the magnitude. In this form, it can be paraphrased as a value of the orthogonal coordinate system on the phase space (V ′ (i, τ), W ′ (i, τ)) is mapped to a point on the unit circle of the orthogonal coordinate system, The centroid (centroid vector (G1 ″ (τ), G2 ″ (τ))) of these mapped values is obtained. Thereby, since the magnitude | size of each vector (V '(i, (tau)), W' (i, tau)) can be normalized, the influence which the magnitude | size has on respiratory target information (PHI) (tau) can be reduced. it can. As a result, the phase of the respiratory motion of the performer 700-i (i = 0,..., I) is more accurately reflected in the respiratory target information Φ (τ).

ただし、φ’(i,τ)は各（V’(i,τ)，W’(i,τ)）を極座標表示した場合の偏角（図８，図１３Ｂ参照）を表す。φ’(i,τ)は（V’(i,τ)，W’(i,τ)）から得られてもよいし、（V(i,t)，W(i,t)）を極座標表示した場合の偏角φ(i,τ)（図８参照）を以下のように変換して得られてもよい。
φ’(i,τ)=φ(i,τ×S0÷T1) (30)
また、呼吸分布作成部８５に入力される呼吸指標は第８実施形態のようにベクトル（V(i,t)，W(i,t)）であってもよいし、呼吸指標抽出部で（V(i,t)，W(i,t)）から生成された偏角φ(i,τ)であってもよい。この相違点と（G1(τ),G2(τ)）が（G1’’(τ),G2’’(τ)）に置き換わる以外の構成・処理は第８実施形態と同様でよい。 The gravity center vectors (G1 ″ (τ), G2 ″ (τ)) in this case are as follows (see FIG. 13B).

However, φ ′ (i, τ) represents a declination angle (see FIGS. 8 and 13B) when each (V ′ (i, τ), W ′ (i, τ)) is displayed in polar coordinates. φ ′ (i, τ) may be obtained from (V ′ (i, τ), W ′ (i, τ)), or (V (i, t), W (i, t)) as polar coordinates The deflection angle φ (i, τ) (see FIG. 8) when displayed may be obtained by converting as follows.
φ '(i, τ) = φ (i, τ × S0 ÷ T1) (30)
The respiratory index input to the respiratory distribution creation unit 85 may be a vector (V (i, t), W (i, t)) as in the eighth embodiment, or the respiratory index extraction unit ( The deviation angle φ (i, τ) generated from V (i, t), W (i, t)) may be used. The configuration and processing other than this difference and (G1 (τ), G2 (τ)) are replaced with (G1 ″ (τ), G2 ″ (τ)) may be the same as in the eighth embodiment.

[Other variations]
The present invention is not limited to the above-described embodiment.
For example, instead of φ (t) or φ (i, t) used in the third embodiment or the third modification of the eighth embodiment, the next identical respiratory state (for example, the expiration start state) Φ (t), which is obtained by multiplying the ratio of the time from the time when the certain breathing state occurs to the time t to the time from when the breathing state starts until the next exhalation start state) by 2 × π (π is radians) Or φ (i, t). For example, φ (t) and φ (i, t) may be obtained as follows.
θ (t) = (2 × π) × (t-bpe (n-1)) ÷ (bpe (n) -bpe (n-1)) + Θ (31)
θ (i, t) = (2 × π) × (i, t-bpe (n-1)) ÷ (i, bpe (n) -bpe (n-1)) + Θ (32)
However, Θ is a constant for shift correction. What changed such (phi) (t) and (phi) (i, t) to the value corresponding to sample point (tau) may be used.

  Further, in each of the above-described embodiments and the modifications thereof, the content with the respiratory target distribution in which the respiratory target information and the synchronization importance are associated with the sample points is illustrated. However, if the breathing target information and the synchronization importance are associated with any reproduction position, the breathing target information and the synchronization importance are not necessarily associated with the sample point. For example, the respiratory target information and synchronization importance may be distributed and recorded in the content with the respiratory target distribution at a frequency equal to (1 / natural number) times the sampling frequency of the content, or may be recorded at arbitrary intervals. May be. When recording at an arbitrary interval, for example, the start point information for specifying the start point of the content information and the respiration target information for the start point information and the information for specifying the relative position of the synchronization importance are stored in the content with the respiration target distribution. You just have to. Further, the respiratory target information and the synchronization importance need not be discrete data, and may be recorded in an analog manner. Further, the breathing target information and the synchronization importance need not be defined for the entire content, but may be defined for only a part thereof.

  Further, in each of the above-described embodiments and modifications thereof, the sample update interval is illustrated as a specific example of the reproduction speed information output from the reproduction speed calculation unit. However, this does not limit the present invention, and a signal that can adjust the reproduction time (speed) such as tempo information, frame position, and clock frequency may be used as the reproduction speed information.

  In each of the above-described embodiments and modifications thereof, the respiratory level is exemplified as a specific example of the respiratory information output from the respiratory measurement unit. However, for example, the differential value of the respiratory level may be used as the respiratory information. The differential value of the respiratory level is obtained, for example, by detecting the respiratory airflow.

  Further, in each of the above-described embodiments and modifications thereof, MIDI data indicating the pitch and the intensity of sound is shown as a specific example of the content information. However, content data may be other data that specifies audio information or video information for viewing purposes, such as music, sound, moving images such as movies and television programs. In addition, the content playback speed control unit does not change the pitch or sound quality if sound, even if the playback speed changes, and playback time control processing that includes processing such as suppressing video disturbance due to frame advance or fast forward if video. It is desirable to do.

  In the second embodiment, it has been shown that a synchronization importance level of 0 or more and 1 or less is preferable. However, this does not limit the present invention, and the synchronization importance may be less than 0 or greater than 1. Thereby, the variation of the reproduction | regeneration method of a content can be increased, and the choice of how to enjoy can be increased. For example, by setting the synchronization importance level to less than 0, it is possible to reproduce content that is uncomfortable for the viewer, and the range of artistic expression is expanded. Also, in all the embodiments and modifications thereof, the playback speed calculation unit may use a value obtained by inverting the sign of the synchronization importance level of the content with the respiratory target distribution as the synchronization importance level for calculating the playback speed. Good. This makes it possible to reproduce content with a sense of incongruity. Moreover, the structure which can select whether the sign of the synchronization importance of the content with a breathing target distribution is reversed or not may be used. In the sixth embodiment, an example is shown in which the importance of synchronization increases as the inspiration amount (respiration depth and amplitude) of the performer increases. Conversely, the inspiration of each respiration of the performer has been shown. A configuration may be adopted in which the importance of synchronization decreases as the amount increases. Further, in the eighth embodiment, synchronization that monotonously decreases in a broad sense with respect to an increase in the sum of the distance between the center of gravity vector obtained from each vector on the phase space corresponding to each of the respiratory motion phases of the plurality of performers and each vector. Although an example of obtaining importance is shown, conversely, a synchronization importance that increases monotonously in a broad sense with respect to an increase in the sum of distances may be obtained.

  In Embodiment 1-3 and its modifications, the respiration index extraction unit generates a respiration index each time the respiration measurement unit outputs respiration information, and the playback speed calculation unit determines the sample update interval. These processes may be performed at other timings. For example, a breathing index or a sample update interval may be generated at a cycle that is an integral multiple (twice or more) of the cycle T1 at which the breathing measurement unit generates breathing information. A breathing index or a sample update interval may be set for each target setting position.

  In addition, breathing information does not necessarily have to be measured at the same time as content recording (it does not have to be breathing information when the performer is performing, etc .; May be obtained). The same applies when there are multiple performers. Further, like a music track, content information, breathing target information, and synchronization importance may be recorded separately and integrated later.

In addition, each block in the illustrated block diagram is a conceptually divided processing section, and each block does not need to exist as an independent device. Moreover, each block does not need to be configured as one device, and may be distributed in a plurality of devices.
In addition, the various processes described above are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Needless to say, other modifications are possible without departing from the spirit of the present invention.

[Features of each embodiment]
The effects obtained by each embodiment are listed.
In the first to third embodiments, respiration target information is set for a respiration target setting position that is an arbitrary reproduction position of content with a respiration target distribution, and the respiration target information corresponding to one of the respiration target setting positions is used. The content reproduction speed is controlled so that the identified breathing state approaches the viewer's breathing state at the time when the content information corresponding to the breathing target setting position is reproduced. Therefore, the correlation between the respiratory state specified by the respiratory target information and the viewer's respiratory state at the desired respiratory target setting position can be increased. As a result, satisfaction such as a sense of unity and high presence in content appreciation can be enhanced.

  According to the fourth to eighth embodiments and their modifications, the content with breath distribution used in the first to third embodiments for the purpose of synchronizing the breathing states of the performer and the viewer automatically and easily. Can be generated.

  In the sixth embodiment, when the performer is breathing a lot, it is assumed that it is important to synchronize the breathing state of the performer and the viewer, It was decided to set. Since this assumption is predicted to be appropriate, in the sixth embodiment, content with a respiratory distribution including the respiratory importance suitable for use in the second and third embodiments can be generated.

  It is thought that reproduction that matches the viewer's breath with the breath of multiple performers is more important. In the eighth and ninth embodiments, the center of a virtual breathing transition state corresponding to a plurality of performers is defined, and breathing is performed using an index representing how much the performer's breathing is aligned with respect to the virtual center. Find target information and synchronization importance. Thereby, the content with a respiratory distribution suitable for use in the first to third embodiments can be generated.

  In the second modification of the eighth embodiment, content with a respiratory distribution that strongly reflects the respiration of performers with high importance (for example, a leading role or vocal) can be created in consideration of the importance of a plurality of performers who play or perform the content.

  In the third modification of the eighth embodiment, since the center of gravity is obtained after normalizing values on the phase space corresponding to the phases of the respiratory movements of a plurality of performers to a unit circle or the like, only the phase that does not depend on the amplitude of the breathing is obtained. The center of gravity that reflects the influence of the performer can be obtained, and the influence due to the difference in vital capacity between performers can be removed.

[Program, data structure, recording medium]
When each of the above-described configurations is realized by a computer, processing contents of functions that each device should have are described by a program. The processing functions are realized on the computer by executing the program on the computer.
Further, the program describing the processing contents and the content with the respiratory target distribution having the data structure described above can be recorded on a computer-readable recording medium. As the computer-readable recording medium, for example, any recording medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory may be used.
The distribution of the program and the content with the respiratory target distribution is performed by selling, transferring, or lending a portable recording medium such as a DVD or a CD-ROM in which the program or the content with the respiratory target distribution is recorded. Further, the program and the content with respiratory target distribution are stored in the storage device of the server computer, and the program and the content with respiratory target distribution are distributed by transferring them from the server computer to other computers via the network. It is good.
In each of the above-described embodiments, the present apparatus is configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware. .

1-3 Reproduction speed synchronization device 4-8 Respiration distribution applying device

Claims (10)

Breathing that extracts a breathing index that identifies the breathing state of the performer at a position on the time axis along the progress of the content from the breathing information obtained by measuring a performer who plays or performs the content that progresses along the time axis An index extraction unit;
Respiration target information corresponding to the breathing state of the performer at at least a part of the time axis is obtained from the respiration index, and the respiration target information is obtained at the position on the time axis corresponding to the respiration target information. A respiratory distribution generation unit that outputs the content information representing the content at a certain respiratory target setting position in association with the respiratory information;
Respiratory distribution imparting device. The respiratory distribution imparting device according to claim 1,
The respiration distribution creation unit obtains each synchronization importance, which is a value corresponding to each inhalation amount of each respiration of the performer, from each respiration index, and each position on the time axis corresponding to each respiration. Outputting each synchronization importance in association with content information representing the content at the reproduction position,
A respiratory distribution imparting device characterized by the above. The respiratory distribution imparting device according to claim 1 or 2,
The breathing index extraction unit is configured to determine a breathing state of the plurality of performers at a position on a time axis along the progress of the content from each breathing information obtained by measuring a plurality of performers performing or performing the content. Extracting the respiratory index to identify each;
The respiratory distribution creation unit obtains respiratory target information corresponding to the respiratory states of the plurality of performers at at least some positions on the time axis from the respiratory index, and uses the respiratory target information as the respiratory target information. Corresponding to the content information representing the content at the breathing target setting position that is the corresponding position on the time axis is output,
A respiratory distribution imparting device characterized by the above. The respiratory distribution imparting device according to claim 3,
Each of the breathing indices specifies a breathing reference position that is a position on the time axis at which the breathing state of the performer becomes a particular reference state;
The respiration target information represents a position on the time axis corresponding to a peak of a probability density function of a respiration reference position obtained by using a value corresponding to the respiration reference position specified by the respiration index as a sample.
A respiratory distribution imparting device characterized by the above. The respiratory distribution imparting device according to claim 3 or 4,
Each of the breathing indices specifies a breathing reference position that is a position on the time axis at which the breathing state of the performer becomes a particular reference state;
The respiration distribution assigning device obtains each synchronization importance corresponding to a function value at a peak of the probability density function at the respiration reference position from the respiration index, and each of the time axis corresponding to each synchronization importance A synchronization importance level creating unit that outputs the content level information representing the content at each playback position in association with each synchronization importance level;
A respiratory distribution imparting device characterized by the above. The respiratory distribution imparting device according to claim 3,
Each of the respiratory indicators is information corresponding to a phase corresponding to the performer's respiratory motion,
The respiratory target information is information corresponding to a phase of a centroid vector obtained from a vector on a phase space corresponding to a phase of respiratory motion of each of the plurality of performers.
A respiratory distribution imparting device characterized by the above. The respiratory distribution imparting device according to claim 6,
The barycentric vector is obtained from each normalized vector obtained by normalizing the magnitude of each vector on the phase space corresponding to the phase of respiratory motion of the plurality of performers.
A respiratory distribution imparting device characterized by the above. The respiratory distribution imparting device according to claim 3, 6 or 7,
Each of the respiratory indices is information corresponding to a phase corresponding to each of the performer's respiratory movements,
The respiratory distribution creating unit assigns each synchronization importance level corresponding to the sum of the distances between the center of gravity vector obtained from each vector on the phase space corresponding to the phase of the respiratory motion of each of the plurality of performers and each of the vectors. Obtained from the index, and outputs each synchronization importance corresponding to the content information representing the content at each playback position at each time point on the time axis corresponding to each synchronization importance,
A respiratory distribution imparting device characterized by the above. From the respiratory information obtained by measuring performers who play or perform content that progresses along the time axis, a respiratory index that identifies the breathing state of the performer corresponding to the time point on the time axis along the progress of the content is extracted A breathing index extraction step,
Respiratory target information that identifies the respiratory state of the performer corresponding to the respiratory target setting position that is at least a part of the time axis is obtained from the respiratory index, and the respiratory target information corresponds to the respiratory target setting position A breathing distribution creating step for outputting in association with content information representing the content at the time of
A method for imparting respiratory distribution. The program for making a computer perform the process of each part of the respiratory distribution provision apparatus in any one of Claim 1 to 8.

Images