JP2013219585A - Device and method for controlling reproduced content and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a reproduced content control device which can add or delete a content by adjusting it to breathing of an appreciator.SOLUTION: A breathing index extraction section extracts a breathing index for specifying a breathing state of an appreciator from breathing information obtained by measuring an appreciator to output it. A track control section outputs track control information when a breathing index is in a prescribed range to time of a trigger point by inputting the breathing index, content information corresponding to respective reproduction positions following time bases separated into one or more tracks, which are stored in a storage section, the trigger point showing the prescribed reproduction position to the respective tracks, and track control information for specifying a control method of the track corresponding to the trigger point. A track reproduction control section controls reproduction of content information stored in the storage section in response to the track control information which the track control section outputs.

Description

  The present invention relates to a content reproduction technique, and more particularly, to a reproduction content control apparatus, method, and program for controlling content provided based on viewer's breathing information.

  Patent Document 1 discloses a technique for controlling the playback speed of content in accordance with the viewer's breathing and controlling the viewer's sense of unity and presence with the content. In this method, the content reproduction speed is set so that the correlation between the preset breathing state and the actually measured viewer's breathing state is high (see paragraph [0034] of Patent Document 1).

JP 2011-59419 A

  In the method disclosed in Patent Document 1, only the content playback speed is controlled, and content elements are added or reduced during the playback of the content at a timing that does not destroy the scene configuration of the content. There was a problem that could not be done.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide a playback content control apparatus, a method and a program for enabling content addition and deletion in accordance with the breathing of the viewer. .

  The reproduction content control apparatus of the present invention includes a storage unit, a breathing index extraction unit, a track control unit, and a track reproduction control unit. The storage unit includes content information corresponding to each reproduction position along the time axis separated into one or more tracks, one or more trigger points indicating a certain reproduction position for each track, and the trigger points And content information with a trigger including track control information for specifying a track control method corresponding to the. The breathing index extraction unit extracts and outputs a breathing index for specifying the viewer's breathing state from the breathing information obtained by measuring the viewer. The track control unit receives the breathing index, the trigger point, and the track control information, and outputs the track control information when the breathing index is within a predetermined breathing state and a predetermined range when the trigger point is reproduced. . The reproduction control unit receives the content information stored in the storage unit and the track control information output from the track control unit, and performs reproduction control of the content information based on the track control information.

  According to the playback content control device of the present invention, when the viewer rides on the rhythm and breathes the content information, for example, the content information that superimposes vocals on the accompaniment or increases the volume based on the track control information Can be added or deleted. As a result, it is possible to more strongly control the viewer's sense of unity and presence with respect to the content information.

The figure which shows the function structural example of the reproduction | regeneration content control apparatus 100 of this invention. The figure which shows the operation | movement flow of the reproduction content control apparatus 100. The figure which illustrates respiration information V (t) outputted from respiration measurement part 20. The figure for demonstrating the predicted value pbpe (n) of the expiration start time. FIG. 6 is a diagram illustrating an example of the operation of a track control unit 40. The figure which shows the function structural example of respiration index extraction part 30 '. It is a figure explaining the respiratory index (phi) (t) which is the information for specifying the phase of periodic respiratory movement, A is a figure for demonstrating the example of the respiratory index which the respiratory index extraction part 30 'calculates. is there. B is a diagram illustrating the relationship between the respiratory index φ (t1), the respiratory target information φ (p (t1)), and L (t1). The figure which illustrates the content with a trigger which gave the trigger factor to each trigger point. The figure which shows the example which set three trigger factors and track control information to the trigger point Trig1 (m1) as a set. The figure which shows the function structural example of the reproduction | regeneration content control apparatus 200 of this invention. The figure which shows the operation | movement flow of the reproduction content control apparatus 200. FIG. 10 is a diagram for explaining the operation of a reproduction speed calculation unit 80 according to the second embodiment. The figure which shows the case where respiration target information (PHI) (*) is made into a trigger factor.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The same reference numerals are given to the same components in a plurality of drawings, and the description will not be repeated. Prior to the description of the embodiments, terms used in the description are defined.

〔Definition of terms〕
Content: Sound information and video information for viewing purposes, such as various music, voice, movies, movies and television programs.

  Content information: Information that constitutes content and is sequentially played back along the time axis.

  Reproduction position: means the reproduction position of each piece of content information that is sequentially reproduced along the time axis, that is, the progress position on the time axis in content reproduction. More specifically, for example, the frame position, sample point, time code, song position pointer, etc. correspond to the playback position.

  Blank information: means information that is not to be viewed in the first section that is temporally prior to the content information that is to be viewed. Examples of blank information include the silent state of the section before the music performance starts, the pause section between the music pieces, and the black screen or sandstorm screen (sandstorm screen) before the playback of movie content such as a movie is started. ).

  Null information: means empty information. For example, when the content information is null information, it means that there is no content information.

  Respiratory state: Means each state during a breathing exercise performed periodically. More specifically, for example, an exhalation start state that is a state at the time of starting exhalation exercise, an exhalation state at each time point during the exhalation exercise, an expiration end state that is a state at the end of the exhalation exercise, The breathing state includes an expiration start state that is a state at the start time, an inspiration state at each time point during the inspiration exercise, an inhalation end state that is a state at the end of the inspiration exercise, and the like.

  Respiration information: Information obtained by measuring the breathing state of content viewers. More specifically, it means, for example, the length around the chest or the abdomen, the respiratory airflow, the temperature difference between exhaled air and inhaled air.

  Respiration index: Information specifying the viewer's breathing state from the respiratory information obtained by measuring the viewer.

  Reproduction speed: This means the reciprocal of the time required to reproduce the content information at the next reproduction position B after reproducing the content information at a certain reproduction position A. This is a concept that can be read as the playback tempo or clock interval.

  Track: A collection of content, music, part, sound, background sound, video, color (for example, RGB), etc. for each element.

  Trigger point: means at least a part of reproduction positions predetermined for each track.

  Track control information: Control information that is set with a trigger point and is triggered when the track is triggered, and includes, for example, on, off, volume up / down, and the like.

  Trigger factor: Information on a reference that determines whether to output track control information at a trigger point, which is determined in accordance with the trigger point.

  FIG. 1 shows a functional configuration example of the playback content control apparatus 100 according to the first embodiment. The operation flow is shown in FIG. The reproduction content control apparatus 100 includes a respiration measurement unit 20, a respiration index extraction unit 30, a storage unit 10, a track control unit 40, a track reproduction control unit 50, a reproduction unit 60, and a control unit 70. To do. The part excluding the respiration measurement unit 20 and the reproduction unit 60 can be realized by reading a predetermined program into a computer including, for example, a ROM, a RAM, a CPU, and the like, and executing the program by the CPU.

  The storage unit 10 uses the sample point τ as a playback position, content information which is MIDI (Musical Instrument Digital Interface) data separated into a plurality of tracks (for example, 16 channels) indicating the pitch and sound intensity, and each track. Triggered content including one or more corresponding trigger points and track control information (on / off) for controlling each track is stored. The content with a trigger is input to the storage unit 10 from the outside in advance.

  The respiration measurement unit 20 measures the respiration state of the viewer 95 who appreciates the content, and outputs respiration information obtained thereby (step S20). In this example, information corresponding to the length around the chest and the abdomen is used as a breathing level (breathing information), and a device that detects breathing from a resistance change of a rubber tube wound around the chest or abdomen (for example, manufactured by Nihon Kohden) The TR-753T or MLT1132) manufactured by ADInstruments is used as the respiratory measurement unit 20. In this example, the respiration level V (t) is measured and output at an arbitrary set cycle T1. Note that t is an integer index corresponding to a discrete time, and “time t” means a time corresponding to the integer index t.

  FIG. 3 illustrates the respiration level V (t) output from the respiration measurement unit 20. The horizontal axis is time t, and the vertical axis is the respiration level V (t). The breathing level V (t) becomes maximum at the expiration start time (bpe (n−1) or the like) that is the time when expiration starts, and the breathing level V (t) decreases as the expiration state proceeds, and inspiration starts. The breathing level V (t) becomes minimum at the inhalation start time (bpi (n) or the like) that is the time when the breathing time progresses, and the breathing level V (t) increases as the inspiratory state progresses. And the like, the state in which the respiration level V (t) is maximized again is repeated periodically.

  The breathing index extraction unit 30 extracts and outputs a breathing index for specifying the viewer's breathing state from the breathing information obtained by measuring the viewer (step S30). The respiration index extraction unit 30 receives the respiration level V (t) output from the respiration measurement unit 20 as an input, for example, a predicted value pbpe (n) of the latest future exhalation start time viewed from the time t of the viewer 95 Is output as a breathing index. Here, n is a number given for convenience of explanation, and is an integer corresponding to the number of breaths of the viewer 95.

  FIG. 4 illustrates the predicted value pbpe (n) of the expiration start time. The horizontal axis is time t, and the vertical axis is the respiration level V (t). The predicted value pbpe (n) of the expiration start time can be obtained by estimating from the latest past respiratory cycles bpe (n-1) and bpe (n-2) viewed from the current time t = t1, for example. it can. The predicted value pbpe (n) of the expiration start time can be calculated as follows, for example.

  Here, bpe (n-1) is the latest past exhalation start time viewed from time t calculated using respiration levels V (t1), V (t1-1), V (t1-2),. Bpe (n-2) represents the latest past expiration start time viewed from the expiration start time bpe (n-1). The time pbpe (n) corresponding to the local maximum value of the most recent future breathing information viewed from time t = t1 is obtained by the equation (1) from the two most recent exhalation start times, and the time pbpe (n) Is output as a breathing index.

  The track control unit 40 receives the breathing index and the track control information, and outputs the track control information when the time of the breathing index is within a predetermined range with respect to the time of the trigger point (step S40). Within the predetermined range is a time width in which a person feels that the start of expiration and the control of the track are synchronized, for example, a time of about ± 100 ms.

  FIG. 5 shows an example of the operation of the track control unit 40. In FIG. 5, the horizontal direction is time t, the first line is, for example, the sample point τ of MIDI information, the second line is the MIDI information of track 1, the third line is the MIDI information of track 2, and the fourth line is the track. The first trigger point and track control information, the fifth line shows the trigger point and track control information for track 2, and the sixth line shows the breathing index pbpe (n). Here, the sample point τ is, for example, a MIDI tick updated at intervals of the standard setting value S0, and is an integer of 0 or more. A larger value corresponds to a later time. For example, the number of tracks is about 16 channels, and is a musical instrument / channel. Here, an example of two channels is shown. For example, it is assumed that track 1 is an accompaniment and track 2 is a vocal.

  The track control unit 40 outputs “on” that is the track control information of the trigger point Trig1 (0) of the track 1 defined at the sample point τ = 0 to the track reproduction control unit 50 as the track control information of the track 1. Here, Trig1 (m1) represents the m1st trigger point of track 1. m1 is an index and is an integer of 0 or more. For example, it is assumed that the track control information of the trigger point at the sample point τ = 0 is output to the track reproduction control unit 50 unconditionally.

  The track playback control unit 50 outputs the MIDI information of track 1 from the sample point τ = 0 to the playback unit 60 (step S50). In this embodiment, if the control information of the track is off, null information or blank information is output to the playback unit 60, and if it is on, playback information is generated from the MIDI information included in the track and is sent to the playback unit 60. Output.

  The reproduction unit 60 is a well-known presentation device including, for example, an amplifier, a speaker, an image display device, and the like, and sequentially outputs content (step S60). The track reproduction control unit 50 and the reproduction unit 60 repeat the same processing until the current time reaches the next trigger point. For example, in the section from Trig 1 (0) to the next trigger point in FIG. 5, the reproduction information created from the MIDI information of track 1 and the blank information of track 2 are output. The control unit 70 controls the operation of each unit.

  When the current time reaches the trigger point Trig2 (0) set to the track 2, the track control unit 40 sets the breathing index pbpe (n) within a time range of ± Ams before and after (for example, A = 100 ms) with respect to the current time. Is evaluated (step S42). When the respiratory index pbpe (n) is generated, the track control information (on) of the trigger point Trig2 (0) is output to the track reproduction control unit 50 (Yes in step S42). Since the track control information of the trigger point Trig2 (0) is on, the track reproduction control unit 50 sequentially reads the MIDI information (vocal) of the track 2 at the timing of the trigger point Trig2 (0) and superimposes the vocal on the accompaniment. To the playback unit 60. The playback unit 60 outputs the generated playback information.

  When the respiratory index pbpe (n) does not occur within the time range of ± Ams before and after the current time as a reference, the track control information of the trigger point Trig2 (0) is not output to the track reproduction control unit 50 (No in step S42). .

  In FIG. 5, when the track control information of the trigger point Trig2 (0) is off, the track reproduction control unit 50 does not output the MIDI information of the track 2 to the reproduction unit 60, or outputs null information instead. The example shown in FIG. 5 is an example in which vocal is inserted at Trig2 (0). However, when the output of MIDI information is stopped (deleted) at a sample point after the trigger point Trig2 (0), the trigger point The track control information is set to off.

  As described above, according to the playback content control apparatus 100, it is possible to control the content in accordance with the breathing rhythm of the viewer 95. For example, based on the track control information, the vocal can be superimposed on the accompaniment, Other musical sounds can be added or deleted.

  It is known that viewers have more experience with content, and that breathing is drawn into content scenes as they become more immersed and concentrated in the content (references: “Sato, Ohsuga, Moriya,“ Increase in synchronization of respiration by repeatedly listening to the same piece of music, ”IEEE ISCIR2010, pp. 1035-1038)), according to the playback content control apparatus 100 of the present invention, a sense of unity and realism for the content information of the viewer, etc. The respiration measurement unit 20 and the reproduction unit 60 that cannot be configured only by a computer may be provided outside the reproduction content control apparatus 100. In that case, the respiration index The extraction unit 30, the storage unit 10, the track control unit 40, and the track reproduction control unit are composed of one computer, and are external devices of the computer A respiratory measurement unit 20 via a connection part (port) and the playback unit 60 is configured to outside.

[Modification 1]
Note that the breathing index extraction unit 30 may output the expiration start time bpe (n) obtained directly from the breathing level V (t) to the track control unit 40. When the breathing state of the viewer 95 changes rapidly, there may be an error in the prediction of the maximum value of the most recent future breathing level from the past breathing state. In such a case, it is better to use the expiration start time bpe (n) obtained directly from the respiration level V (t).

  Conversely, when the breathing state of the viewer 95 is in a stable state, a plurality of past exhalation start times bpe (n) are averaged, and a predicted value pbpe (pbpe ( n) may be used. That is, the respiratory index extraction unit 30 may be configured to adaptively change the respiratory index according to the stability of the viewer 95 in the respiratory state.

[Modification 2]
Further, the time pbpe (n) corresponding to the local maximum value of the most recent breathing information in the future may be replaced with a breathing index φ (t) that is information for specifying the phase of the periodic breathing motion of the viewer 95. Good. In that case, the breathing index extraction unit 30 ′ is configured by a delay filter 31 and an orthogonal coordinate conversion means 32 as shown in FIG.

  The respiration level V (t) at time t is input to the Cartesian coordinate transformation means 32 as the first dimension value of the phase space. In addition, the respiration level V (t) at time t is input to the delay filter 31 and, after the delay time γ, is input to the orthogonal coordinate conversion means 32 as the second dimension value of the phase space. The delay time γ is preferably about 200 ms to 800 ms in the case of respiration.

  The Cartesian coordinate conversion means 32 obtains and outputs a declination angle when a point (V (t), V (t−γ)) in the Cartesian coordinate system of the phase space is displayed as polar coordinates as a respiratory index φ (t) ( FIG. 7A).

  As described above, when the respiratory index φ (t) is handled as a phase, a trigger factor that is information for specifying the phase of the respiratory motion corresponding to each trigger point of the triggered content stored in the storage unit 10 is set. It is also possible to have it.

  FIG. 8 illustrates a content with a trigger in which a trigger factor is given to each trigger point in the example of three tracks. Trig1Φ (•) in the figure is a trigger factor. (•) is a number indicating the order of trigger factors, and the phase value actually enters Trig1Φ (•).

  When the trigger point has a trigger factor, the track control unit 40 'measures the distance between the trigger factor and the breathing state for each track, and if the distance is shorter than the set range (ψ), it is set as the trigger factor. It operates to output existing track control information.

  For example, when the time t1 reaches the time at which the trigger point is set, the track control unit 40 ′ obtains the phase angle difference L ′ between the trigger factor and the phase of the respiratory motion by Expression (2).

  R ′ is a variable indicating an intermediate result. If this phase angle satisfies L ′ <ψ, the track control information (on) corresponding to the trigger point Trig1 (m1-1) is output to the track reproduction control unit 50. Here, ψ may be a range in which a person feels that his / her breathing is synchronized with the breathing state set as the trigger factor, and is set to 0.1 radians, for example. The operations of the other functional units are the same as those in the first embodiment.

[Modification 3]
Although an example in which one track control information is set for one trigger point has been described, a plurality of trigger factors and track control information may be set for one trigger point as a set.

  FIG. 9 shows an example in which the trigger point Trig1 (m1) is set with a combination of three trigger factors and track control information. The phase angle L ′ between the respiratory index φ (t) output from the respiratory index extraction unit 30 ′ and each trigger factor is obtained, and the track control is performed when the phase angle L ′ is minimum and L ′ <ψ is satisfied. The unit 40 'outputs track control information. For example, control information for volume increase (UP) of Trig1Φ ′ (m1) is selected and output.

  In this way, by setting a plurality of trigger factors and track control information as a set for one trigger point, content control can be performed more finely.

  The playback content control apparatus 100 described above can change content information such as starting vocal or increasing the volume, for example, depending on the breathing state of the viewer 95 at the trigger point. In addition to this function, a playback content control apparatus 200 is also considered in which a function for changing the playback speed of the content is added so that the progress of the content is synchronized with the breathing of the viewer 95.

  FIG. 10 shows a functional configuration example of the playback content control apparatus 200 according to the second embodiment. The operation flow is shown in FIG. The reproduction content control apparatus 200 includes a respiration measurement unit 20, a respiration index extraction unit 30, a storage unit 10 ', a track control unit 40, a track reproduction control unit 50', a reproduction unit 60, and a control unit 70 '. A playback speed calculation unit 80 and a content playback speed control unit 90. The playback content control apparatus 200 receives the respiration target information Bpe (μ) that represents a sample point that is desirable as a point in time when the storage unit 10 ′ starts an exhalation exercise with respect to the storage unit 10 with respect to the above-described playback content control apparatus 100. It is different in that it is content information with a trigger to be included and a playback speed calculation unit 80 and a playback content speed control unit 90 are provided. The reproduction content control apparatus 200 can also be realized by reading a predetermined program into a computer composed of, for example, a ROM, a RAM, and a CPU, and executing the program by the CPU.

[Respiration target information]
The respiration target information Bpe (μ) means a desirable respiration state when realized at a sample point (respiration target setting position) of certain content information. For example, when it is determined in advance that only the expiration start point is used as the respiratory target information, Bpe (μ) indicates a position (respiration target setting position) on the sample point τ that is desirable as a point in time when the expiration movement starts. For example, if it is desirable to start expiration at the breathing target sample point τ = 100, the value of the breathing target information Bpe (μ) is 100. μ is an index given for convenience of explanation, and is a continuous integer of 0 or more for identifying each respiration target information Bpe (μ). A larger value corresponds to later respiratory target information in time.

  FIG. 12 illustrates content information with a trigger including respiration target information Bpe (μ). The point that the content information corresponding to each sample point τ to be reproduced is sequentially reproduced is the same as the content information with trigger of the first embodiment. The update cycle of the sample point τ to be reproduced is referred to as a sample update interval, and a standard set value of a predetermined sample update interval is S0.

[Reproduction speed calculation unit 80]
The reproduction speed calculation unit 80 receives the respiration target information Bpe (m) and the respiration index pbpe (n), and the respiration state specified by the respiration target information corresponding to any respiration target setting position is the respiration target. Set the playback speed for sequentially playing back each piece of content information corresponding to each playback position along the time axis so as to approach the breathing state of the viewer 95 when the content information corresponding to the set position is played back Then, reproduction speed information for specifying the set reproduction speed is output (step S80, FIG. 11). In other words, the reproduction speed calculation unit 80 is configured so that the viewer 95 at the time when the respiration state specified by the respiration target information corresponding to one of the respiration target setting positions and the content information corresponding to the respiration target setting position are reproduced. The reproduction speed of the content information is set so that the correlation with the breathing state becomes high. Note that the set playback speed is not a speed for inducing the viewer's 95 breathing, but a speed for synchronizing the progress of content with the viewer's 95 breathing.

  With reference to FIG. 12, the operation of the reproduction speed calculation unit 80 of the second embodiment will be described.

  The playback speed calculation unit 80 sets the playback speed of the content by determining the sample update interval. Further, every time the respiration measuring unit 20 obtains the respiration level V (t), the replay speed calculation unit 80 determines the sample update interval S (t) at the cycle T1, and outputs this as replay speed information. Here, p (t) represents a sample point τ corresponding to the content information reproduced at time t. The synchronization importance α (τ) will be described later.

  It is assumed that the reproduction up to the content information d (p (t1)) corresponding to the sample point τ = p (t1) is completed at the time t = t1. At this time, the most recent future respiratory target sample point is Bpe (m) (μ = m) as seen from the sample point τ = p (t1) included in the content with respiratory distribution, and the respiratory index is extracted at time t = t1. Assume that the predicted value (respiration index) of the expiration start time output from the unit 30 is pbpe (n).

  In this case, the playback speed calculation unit 80 extracts from the predicted value pbpe (n) of the expiration start time, which is the respiratory index output from the respiratory index extraction unit 30, and the content with the respiratory target distribution stored in the storage unit 10 ′. The respiration target sample point Bpe (m) and the sample point τ = p (t1) are input, and the predicted value pbpe (n) of the expiration start time is used as content information d ( The sample update interval S (t1) is calculated by the following equation so as to approach the reproduction time of τ) and output.

  The playback speed calculation unit 80 calculates a sample update interval S (t1) such that the sample point to be played is updated from p (t1) to Bpe (m) from time t1 to time pbpe (n). The sample update interval S (t1) is output as reproduction speed information.

  The track reproduction control unit 50 ′ describes only the difference from the track reproduction control unit 50. The content information is corrected from the track control information regarding each track, and the corrected content information d (τ) is output to the content reproduction speed control unit 90. For example, in this embodiment, if the track control information of a certain track is off, null information is output, and if it is only on, the input original MIDI information is output to the content playback speed control unit 90 as it is.

  The content playback speed control unit 90 receives the sample update interval S (t1), which is playback speed information, and the content information d (τ) output from the track playback control unit 50 ′, and receives the sample update interval S (t1). In step S90, reproduction information r (τ) (acoustic signal or the like) for reproducing the content information d (τ) corresponding to the sample point τ to be reproduced is sequentially output while updating the sample point τ to be reproduced. . For example, the content reproduction speed control unit 90 reproduces the content information d (τ) corresponding to the sample point τ to be reproduced while updating the sample point τ to be reproduced at the sample update interval S (t1). r (τ) is sequentially output.

  The reproducing unit 60 outputs content information specified by the reproduction information r (τ) (step S60).

  According to the playback content control apparatus 200, since the playback speed of the content is controlled so as to approach the viewer 95's breathing index, there is an effect of further increasing the degree of immersion of the viewer 95 with respect to the content.

[Modification 4]
A modified example in which the content information with trigger described in the second embodiment is further provided with a synchronization importance α (τ), which is a coefficient corresponding to the respiration target setting position Bpe (μ), will be described. The storage unit that stores the triggered content information including the synchronization importance α (τ) is referred to as a storage unit 10 ″ (FIG. 10). The synchronization importance α (τ) is the importance of the respiratory target information corresponding to the reproduction position. This value represents a degree, and takes a larger value as the importance of synchronizing the respiration target information corresponding to the reproduction position and the respiration of the viewer 95 at the time when the content information is reproduced is larger. (Τ) is preferably set to a value of 0 or more and 1 or less, for example.

  When the synchronization importance α (τ) is included, the reproduction speed calculation unit 80 ′ stores the predicted value pbpe (n) of the expiration start time that is the respiratory index output from the respiratory index extraction unit 30 and the storage unit 10 ″. Sampled breathing target sample point Bpe (m), synchronization importance α (p (t1)) and sample point τ = p (t1) extracted from the triggered content, and the sample point τ = p (t1) The reproduction time of the content information d (τ) corresponding to the respiration target sample point Bpe (m) approaches the predicted value pbpe (n) of the expiration start time while considering the synchronization importance α (p (t1)). Then, the sample update interval S (t1) is calculated as follows.

  Here, S0 is a predetermined standard setting value of the sample update interval, and the first term on the right side is a change amount of the sample update interval. That is, when the synchronization importance α (p (t1)) is 1, the playback speed calculation unit 80 ′ sets the sample point to be played back from p (t1) from time t1 to time pbpe (n). A sample update interval S (t1) that is updated up to Bpe (m) is calculated. On the other hand, when the synchronization importance α (p (t1)) is 0 or more and less than 1, the playback speed calculation unit 80 ′ indicates that the amount of change of the sample update interval with respect to the standard setting value S0 is the synchronization importance α (p (t1)). A sample update interval S (t1) smaller than the case of 1 is calculated. In particular, when the synchronization importance α (p (t1)) is 0, S (t1) = S0.

  In this way, the content playback speed may be changed according to the value of the synchronization importance α (τ). The operation of other parts is the same as that of the playback content control apparatus 200 described above.

[Modification 5]
As described above, it is possible to combine the technique of Patent Document 1 with the present invention. Furthermore, it is good also considering the respiration target information in 3rd embodiment of patent document 1 as a trigger factor which is the information for pinpointing the phase of the above-mentioned respiration motion. That is, the trigger factor of the trigger point is the respiratory target information set at the same sample position.

  For example, as shown in FIG. 13, when the trigger point is Trig1 (m1), the trigger factor corresponding to this trigger point is the respiratory target information Φ (Trig1 (m1)) at the sample point position of Trig1 (m1). To do. That is, Trig1Φ (m1) = Φ (Trig1 (m1)).

  Thus, even if the respiratory target information is used as a trigger factor that is information for specifying the phase of respiratory motion, it is possible to control the content track. Since the person's breathing state is controlled to approach, track control is frequently performed.

  As described above, according to the playback content control apparatus 100 of the present invention, when a viewer is drawn into a scene of content (when breathing), adding / deleting a musical tone, increasing / decreasing the volume, etc. Can increase the degree of immersion in the viewer's content. In addition, since the content elements (tracks) change according to the timing of the content, there is no sudden increase in music in the middle of a music phrase, and the continuity of the content is not lost. For example, in loop music, a musical sound is added when a viewer follows the rhythm and breathes. If breathing does not match, it is possible to reduce the musical sound and emphasize the main rhythm.

  Further, according to the playback content control apparatus 200 described in the second embodiment, the playback of the content is performed so that the breath and the scene of the content are synchronized. Therefore, it is easy to draw the viewer's feeling into the content, and the sense of immersion in the content. And the effect of increasing the concentration degree more effectively.

  In addition, the method of setting the breathing index output from the breathing index extraction unit 30 described as the first modification of the first embodiment as the expiration start time directly obtained from the breathing level V (t) is the reproduction content control device 200 ( It can also be applied to Example 2). Further, the idea of setting a plurality of track control information at one trigger point described in the modification 3 can also be applied to the reproduction content control apparatus 200 (Example 2).

  Further, in the above-described embodiment, the explanation has been made with an example in which the expiration start time is used as a predetermined trigger factor. However, the trigger factor is an inspiration start, and the inhalation amount exceeds a threshold value (when a large inhalation is taken) Even if they are replaced with the above, the same effects as described above can be obtained. Thus, the present invention is not limited to the above-described embodiments.

Further, the processes described in the above method and apparatus are not only executed in time series according to the order of description, but also may be executed in parallel or individually as required by the processing capability of the apparatus that executes the processes. Good.

  Further, when the processing means in the above apparatus is realized by a computer, the processing contents of functions that each apparatus should have are described by a program. Then, by executing this program on the computer, the processing means in each apparatus is realized on the computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. As the computer-readable recording medium, any recording medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory may be used. Specifically, for example, as a magnetic recording device, a hard disk device, a flexible disk, a magnetic tape or the like, and as an optical disk, a DVD (Digital Versatile Disc), a DVD-RAM (Random Access Memory), a CD-ROM (Compact Disc Read Only). Memory), CD-R (Recordable) / RW (ReWritable), etc., magneto-optical recording medium, MO (Magneto Optical disc), etc., semiconductor memory, EEP-ROM (Electronically Erasable and Programmable-Read Only Memory), etc. Can be used.

  The program is distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Further, the program may be distributed by storing the program in a recording device of a server computer and transferring the program from the server computer to another computer via a network.

  Each means may be configured by executing a predetermined program on a computer, or at least a part of these processing contents may be realized by hardware.

Claims (10)

Content information corresponding to each playback position along the time axis separated into one or more tracks, one or more trigger points indicating a certain playback position for each track, and a track corresponding to the trigger point A storage unit for storing content information with a trigger including track control information for specifying a control method of
A breathing index extraction unit for extracting and outputting a breathing index for identifying the breathing state of the viewer from the breathing information obtained by measuring the viewer;
When the respiratory index, the trigger point, and the track control information are input, and the respiratory index is within a predetermined range with a predetermined respiratory state at the time of reproducing the trigger point, the track control information is A track controller to output,
A track reproduction control unit for performing reproduction control of the content information based on the track control information, with the content information stored in the storage unit and the track control information output from the track control unit as inputs;
A playback content control apparatus comprising: Content information corresponding to each playback position along the time axis separated into one or more tracks, one or more trigger points indicating a certain playback position for each track, and a track corresponding to the trigger point A storage for storing triggered content information including track control information for identifying the control method and breathing target information representing a desired breathing state of the viewer at the time of reproducing the playback position at least at a part of the playback position And
A breathing index extraction unit for extracting and outputting a breathing index for specifying the viewer's breathing state from the breathing information obtained by measuring the viewer;
When the breathing index, the trigger point, and the track control information are input, the track control information is output when the breathing index is within a predetermined range with the breathing state determined when the trigger point is reproduced. A track control unit,
A track reproduction control unit that receives the content information stored in the storage unit and the track control information output from the track control unit, and performs output control of the content information based on the track control information;
Using the breathing index and the breathing target information as input, set the playback speed when sequentially playing the content information along the time axis so that the viewer's breathing state approaches any of the breathing target information A playback speed calculation unit that outputs playback speed information for specifying the playback speed;
A content playback speed control unit that receives the playback speed information and the content information output from the track playback control unit and outputs playback information for sequentially playing back the content information at a playback speed specified by the playback speed; ,
A playback content control apparatus comprising: In the reproduction content control apparatus according to claim 1 or 2,
The storage unit includes, as a trigger factor, a breathing state used when determining whether to output track control information at the time of reproducing the trigger point for each trigger point,
The track control unit outputs the track control information when the breathing index is within a predetermined range with the trigger factor when the trigger point is reproduced.
A playback content control apparatus characterized by the above. The playback content control apparatus according to any one of claims 1 to 3,
The respiratory index is a predicted value of the latest future expiration start time obtained from respiratory information obtained by measuring the viewer.
A playback content control apparatus characterized by the above. The playback content control apparatus according to any one of claims 1 to 4,
The respiration index, the trigger factor, and the respiration target information are information for specifying the phase of periodic respiration motion.
A playback content control apparatus characterized by the above. The playback content control apparatus according to any one of claims 1 to 5,
In the storage unit, plural (two or more) track control information and trigger factors are set in the trigger point,
The track control unit outputs track control information that is within a predetermined range with respect to the trigger factor when the respiratory index reproduces the trigger point, and the respiratory index is closest to the trigger factor.
A playback content control apparatus characterized by the above. The playback content control apparatus according to any one of claims 1 to 6,
The track control unit determines that a breathing index and a predetermined breathing state or a trigger factor are within a predetermined range based on a difference between a trigger point and a time indicated by the breathing index output.
A playback content control apparatus characterized by the above. Content information corresponding to each reproduction position along the time axis separated into one or more tracks stored in the storage unit, one or more trigger points indicating a certain reproduction position for each track, and A playback content control method using content information with a trigger including track control information for specifying a control method of a track corresponding to a trigger point,
A respiratory index extraction process for extracting and outputting a respiratory index for identifying the viewer's respiratory state from the respiratory information obtained by measuring the viewer;
When the respiratory index, the trigger point, and the track control information are input, and the respiratory index is within a predetermined range with a predetermined respiratory state at the time of reproducing the trigger point, the track control information is Output track control process,
A track playback control process for performing playback control of the content information based on the track control information, using the content information stored in the storage unit and the track control information output by the track control process as inputs;
A playback content control method comprising: Content information corresponding to each reproduction position along the time axis separated into one or more tracks stored in the storage unit, one or more trigger points indicating a certain reproduction position for each track, and With trigger including track control information that specifies the control method of the track corresponding to the trigger point, and respiration target information that represents the desired breathing state of the viewer at the time of reproducing the reproduction position at least at a part of the reproduction position A playback content control method using content information,
A breathing index extraction process for extracting and outputting a breathing index for identifying the breathing state of the viewer from the breathing information obtained by measuring the viewer;
A track control process in which the breathing index and the track control information are input, and the track control information is output when the breathing index is within a predetermined range and a predetermined breathing state when the trigger point is reproduced. When,
A track reproduction control process in which the content information stored in the storage unit and the track control information are input, and output control of the content information is performed based on the track control information;
Using the breathing index and the breathing target information as input, set the playback speed when sequentially playing the content information along the time axis so that the viewer's breathing state approaches any of the breathing target information A playback speed calculation process for outputting playback speed information for specifying the playback speed;
A content playback speed control process for receiving the playback speed information and the content information output from the track playback control unit and outputting playback information for sequentially playing back the content information at a playback speed specified by the playback speed; ,
A playback content control method comprising:   A program for causing a computer to function as the playback content control apparatus according to any one of claims 1 to 7.

Images