JP5097149B2 - Content data playback device - Google Patents

Description

  The present invention relates to a content data playback apparatus that gives a high sense of presence to video / audio viewers by operating peripheral devices (for example, lighting devices) in accordance with normal playback or digest playback of video / audio.

  In recent years, there has been proposed a method of giving video / audio viewers a high sense of realism by operating various peripheral devices such as lighting devices, electric fans, air conditioners, etc. in the viewing space in conjunction with the reproduction of video / audio contents. Yes. For example, Patent Literature 1 discloses an illumination control method that provides a high sense of realism by controlling illumination in conjunction with an image of an image display device.

On the other hand, the viewing style of users has been diversified due to the increase in capacity of content storage devices using hard disk drives, etc., and the spread of server-type content broadcasting services, and one of them is part of video / audio. There is a digest reproduction that reproduces only the above scene (for example, an important scene such as a raised scene) and grasps an outline of video / audio in a short time (for example, see Patent Documents 2 to 4).
In such a digest reproduction, it is considered that peripheral devices such as a lighting device are controlled to give viewers a high sense of reality.

JP 2000-173783 A JP-A-10-150629 JP-A-11-205704 Japanese Patent Laid-Open No. 2000-23062

However, when the peripheral device is controlled using the same control value as that during normal playback for a scene to be digest-reproduced, the effect (additional effect) provided by the peripheral device may give viewers discomfort. For example, in digest playback in which only some scenes are connected, depending on the connection between scenes, the lighting effect may be a flash that is not intended by the content creator, which may cause discomfort to the viewer.
In order to avoid the influence due to the additional effect at the time of digest reproduction, a method of determining a control value for digest reproduction can be considered. However, this method requires a large amount of labor for the content creator.

  The present invention is intended to solve the above-described problems, has a small burden on the content creator, and operates peripheral devices not only during normal playback of video / audio but also during digest playback. Provided is a content data reproducing apparatus that gives viewers a high sense of realism without giving unpleasant discomfort unintended by the content creator.

In order to solve the above-described problem, the first technical means of the present invention records content including video and / or audio and an additional effect control value for controlling a viewing environment corresponding to the content, and at least the content is recorded. The scene is divided along the playback time axis, and the additional effect control value is recorded separately for each range where the control value continues at a constant value along the playback time axis, indicating the correction form of the control value during digest playback. A content data playback device for playing back content data in which correction form information is recorded for each scene , comprising at least the control value extraction means and a digest playback scene extraction means, and in conjunction with playback during normal playback, and controlling devices for controlling the viewing environment based on the recorded control value, at the time of digest playback, extracted digest reproduction scene Extracts were recorded corresponding to the reproduction time axis corresponding said control value, on the basis of the correction mode information, the fade-in / fade-out to relieve the rate of change of the control value for the reproduction time axis, and the normal reproduction The apparatus is characterized by performing ON control using the same control value or OFF control not performing control based on the control value on the device .

According to a second technical means, in the first technical means, the digest reproduction scene extraction means extracts the digest reproduction scene based on the importance of the recorded video and / or audio data for each of the divided scenes. It is characterized by doing.

A third technical means is characterized in that, in the second technical means, the playback speed of the scene is determined based on the importance of the digest playback scene.

According to a fourth technical means, in the first technical means, the digest reproduction scene extracting means reproduces the content data in which digest scene information indicating a scene to be digest reproduced is recorded, based on the digest scene information. The digest reproduction scene is extracted.

According to a fifth technical means, in any one of the first to fourth technical means, the content data in which the scene division of the content and the additional classification of the control value coincide with each other is reproduced. It is.

  According to the present invention, not only during normal playback of video / audio, but also during digest playback, by operating peripheral devices, the viewer can be highly realistic without causing discomfort unintended by the content producer. A feeling can be given. In addition, the burden on the content creator is small.

It is a block diagram which shows the structural example of the content data reproduction apparatus of the 1st Embodiment of this invention. It is a figure which shows an example of an audio / video content. It is a figure which shows an example of the additional effect control data with correction | amendment form information. It is a figure which shows an example of digest reproduction information. It is a figure which shows an example of the relationship between the AV scene at the time of normal reproduction | regeneration and digest reproduction | regeneration, and illumination. It is a figure which shows the example of a change of the control value between the AV scenes reproduced | regenerated continuously at the time of digest reproduction | regeneration. It is a figure for demonstrating the example of a control process of the illuminating device by the content data reproduction apparatus of FIG. 1 in highly realistic reproduction. It is a block diagram which shows the structural example of the content data reproduction apparatus of the 2nd Embodiment of this invention. It is a figure which shows the other example of an audio / video content. FIG. 10 is a diagram showing an AV scene that is digest-reproduced in the audio / video content of FIG. 9. It is a figure which shows an example of additional effect control data. It is a figure which shows the other example of the relationship between the AV scene at the time of digest reproduction | regeneration, and illumination. It is a figure which shows an example of the correction | amendment form of the control value of an illuminating device. It is a figure which shows the other example of the correction | amendment form of the control value of an illuminating device. It is a figure for demonstrating the example of a control process of the illuminating device by the content data reproduction apparatus of FIG. 8 in high presence reproduction. It is a figure which shows the example of a correspondence of the importance of AV scene, and the reproduction speed of the said AV scene.

  The content data reproducing apparatus of the present invention will be described below with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration example of the content data reproducing apparatus according to the first embodiment of the present invention.
The content data reproducing device 1 in the example shown in the figure is connected to an audio output device X that outputs audio based on audio data and a video display device Y that displays video based on video data, and further, an illumination device Z as a peripheral device. Connected with. The content data playback device 1 controls and operates the lighting device Z in accordance with normal playback of audio and video content or digest playback in units of AV scenes divided along the playback time axis. It is possible to give a high sense of presence to the user. In the following, controlling the lighting device Z so as to give a high sense of realism in accordance with the reproduction of audio and video content as described above is referred to as high realism reproduction.

  The content data playback apparatus 1 includes a data acquisition unit 10, a data separation unit 11, a playback control unit 12, a user instruction acquisition unit 13, an audio decoding unit 14, a video decoding unit 15, an additional effect setting unit 16, an audio data output unit 17, It consists of a video data output unit 18 and a device control unit 19.

The data acquisition unit 10 acquires content data necessary for high-realistic reproduction. The content data of this example includes encoded audio data and encoded video data, additional effect control data with correction form information, which will be described later, and digest reproduction information.
Each of the encoded audio data and the encoded video data is divided into AV scenes along the reproduction time axis as illustrated in FIG. 2 described later.
Further, the additional effect control data with correction form information is used for controlling the lighting device Z. As illustrated in FIG. 3 to be described later, the additional effect control data includes a control value for each control scene that is divided along the reproduction time axis in a range in which the control value of the lighting device Z during normal reproduction continues at a constant value. Information (control value during normal reproduction, control start time at the control value, control time length at the control value) is described. The correction form information is given for each control scene, that is, for each control value, and indicates a control value correction form when the scene is digest-reproduced.
The digest playback information indicates AV scene information to be digest played back as illustrated in FIG. 4 described later.

  The content data including these pieces of information is sent to the data separation unit 11 and separated into encoded video data, encoded audio data, additional effect control data with correction form information, and digest reproduction information. Each separated data is sent to the reproduction control unit 12.

  The reproduction control unit 12 performs high-realistic reproduction control. There are two types of high-realistic reproduction: normal reproduction and digest reproduction. The reproduction control unit 12 determines which method the high-realistic reproduction is performed by the user (the user instruction acquisition unit 13 acquires) Determine according to the instructions of the viewer. The user's instruction is given through an input device such as a remote controller, for example. The control by the reproduction control unit 12 and the digest reproduction scene extraction unit 12a and the control value extraction unit 12b will be described later.

  The audio decoding unit 14 and the video decoding unit 15 decode the encoded audio data and the encoded video data output from the reproduction control unit 12, respectively. The audio data and video data obtained by decoding are output to the audio reproduction device X and the video display device Y via the audio data output unit 17 and the video data output unit 18, respectively.

  The additional effect setting unit 16 sets the control (that is, the additional effect) of the lighting device Z based on information (control value information or the like) related to the additional effect control received from the reproduction control unit 12. For example, setting of the control target (setting of which color illumination is controlled when the lighting device consists of three colors of red, blue, and green), control value setting, and digest playback Set whether to perform such control. The set information (setting information) is output to the device control unit 19.

  The device control unit 19 controls the lighting device Z in accordance with the setting information. For example, the lighting device Z is controlled by generating and sending a command for controlling the lighting device Z according to the setting information. Thereby, the color and brightness | luminance of the illumination of the illuminating device Z can be changed. Note that the illumination device may have different illumination capabilities depending on the type or the like, and therefore, it is desirable that the illumination device has a function capable of notifying the device control unit 19 of its own illumination capability.

  In the content data playback apparatus 1 including the above-described units, during normal playback, the control value indicated in the additional effect control data acquired from the data separation unit 11 is used as it is in conjunction with playback of audio / video content. The lighting device Z is controlled.

On the other hand, at the time of digest playback, the digest playback scene extraction means 12a of the playback controller 12 extracts AV scenes to be digest played back. This extraction can be performed based on the digest reproduction information, for example. Then, the control value recorded corresponding to the time axis of the extracted AV scene is extracted by the control value extracting means 12b, and the extracted control value is corrected so as not to cause unpleasant lighting by using the control value. Then, the lighting device Z is controlled. Control value correction forms include fade-in, fade-out, and the like. Which form is used for correction can be determined based on correction form information in the additional effect control data, for example.
By performing the above-described control of the lighting device in accordance with the digest reproduction of the audio / video content, it is possible to give the viewer a high sense of realism without giving the viewer a discomfort unintended by the content creator.

In the following, an example of content data and an example of operation when the content data is reproduced with high presence will be described.
In the content data of this example, the video / audio content is composed of six AV scenes (S1 to S6) as shown in FIG. 2, for example, [scene start time at normal playback, normal of AV scenes S1 and S2 It is assumed that the time length of the scene at the time of reproduction is [00:00, 0:01:00] and [0:01:00, 0:00:30].

  In addition, control value information is given to the additional effect control data included in the content data for each control scene. The control value information is information indicating the control value of the lighting device Z during normal reproduction, and the control start time and control time length according to the control value during normal reproduction. In the example of FIG. 3, the control value information is indicated by data fields of “start time”, “time length”, and “value (R, G, B)”. For example, the control value R is 0, and the control value G 200, the control value B is 0, the start time of the control scene L1 is 0:00, and the time length is 00:01:00.

  The relationship between each AV scene and illumination when the lighting device Z is controlled based on the additional effect control data (that is, control value information) in FIG. 3 in accordance with the normal playback of the video / audio content in the example of FIG. 5 (A). In this example, each AV scene is identical to each control scene (that is, the start time and time length during normal playback of the AV scene Sn and the control scene Ln (n = 1 to 6) are equal), The illumination for the AV scene S1 is green, and the illumination for the AV scene S2 is light green.

  The correction form information acquired together with the additional effect control data is indicated by a data field of “digest control” in the example of FIG. For example, the control scene L1 (0:07:00 to 0: 09: 00: 00) whose illumination is yellow (R = 255, G = 255, B = 0) is given “fade-in” as the correction form information. ing.

  The correction form information given for each control scene includes “fade in”, “fade out”, “ON”, “OFF”, and the like. “Fade-in” means that the control value is faded in at the time of digest playback, that is, when the previous control scene is switched to the corresponding control scene, the previous control is performed in the first part of the corresponding control scene. This indicates that control is performed such that the control value at the normal playback of the scene gradually changes from the control value at the normal playback of the scene. “Fade out” means that the control value is faded out during digest playback, that is, the control value does not change abruptly when moving from the corresponding control scene to the next control scene. This indicates that the control is performed so as to gradually shift to the control value at the time of normal reproduction of the next control scene. “ON” indicates that the same correction value as that during normal reproduction is used during digest reproduction, that is, the control value is not corrected. “OFF” indicates that the control value is corrected to zero so that the additional effect is not reproduced during digest reproduction (that is, the illumination device Z is turned off).

  FIG. 4 is an example of digest playback information indicating an AV scene to be digest played, which is included in the content data. The digest playback information in the example in the figure includes AV scene S1 (00:00:00 to 00:01:00), AV scene S3 (00: 0: 30 to 00:03:30), and AV scene S4 (00:03). : 30 to 00:06:30) and AV scene S6 (00:07:30 to 00:10:30), each scene is to be played back during digest playback.

  In the present embodiment, the additional effect control data with correction form information and the digest reproduction information are created by the content creator and added to the audio / video content as content data.

  Assume that the lighting device Z is controlled based on the additional effect control data with correction form information of FIG. 3 in accordance with the digest reproduction of the video / audio content of FIG. 2 based on the digest reproduction information of FIG. In this example, each AV scene matches each control scene, and the correction form information of the control scenes L1, L3, and L4 corresponding to the AV scenes S1, S3, and S4 to be digest-reproduced is “ON”. The correction form information of the control scene L6 corresponding to the AV scene S6 is “fade in”.

  Therefore, the relationship between each AV scene to be digest-reproduced in this example and the illumination is as shown in FIG. 5B. In the AV scene S1, the illumination is green in the digest playback as in the normal playback. In the subsequent AV scene S3 and AV scene S4, the lighting is light blue and white as in normal playback, but in the AV scene S6, the correction value is faded in at the beginning, and the white illumination To change to yellow during normal playback. Therefore, when switching from the AV scene S4 to the AV scene S6, the color of the lighting does not suddenly change from white to yellow, and the user does not feel uncomfortable.

  Here, an example of fade-in control will be described. A fade-in process is performed when digest playback is performed for a control scene for which fade-in is specified in the correction form information as in the control scene L6 of FIG. The fade-in control is a control in which the control value at the time of normal reproduction in the immediately preceding control scene is changed stepwise from the control value at the time of normal reproduction of the designated control scene.

FIG. 6 illustrates changes in control values between the AV scenes S4 and S6 of FIG. 4 that are continuously played back during digest playback. In this change, since there is no change in the R value and the G value among the control values, only the B value is illustrated. The vertical axis represents the control value (B value), and the horizontal axis represents the playback time.
When the correction form information of the control scene L6 corresponding to the AV scene S6 indicates not the fade-in control but the normal control, as shown in FIG. 6A, the control value in the AV scene S4 (that is, the control scene L4) lighting of B but were 255, at time t ₀ (i.e., simultaneously with the switching of the control scenes), changes to 0 a normal control value at the time of reproduction of the AV scene S6 (i.e. control the scene L6).

On the other hand, when the correction mode information for controlling the scene L6 corresponding to the AV scene S6 is shows the fade-in control, as shown in FIG. 6 (B), the control value, immediately at time t ₀ when switching the AV scene, AV scene S6 (i.e. control the scene L4) does not change the control value of the stepwise change until time t _1. The control value being changed may be changed smoothly. For example, the following calculation method can be considered.

When the control value at time t ₀ is B ₁ , the control value at the end is B ₂ , and the fade-in control time (change time) is tx, the control value at time tn (<tx) is
B ₁ * tn + B ₂ * (t ₀ −tn) / tx
It can be expressed as The illumination of other colors (R, G) can be given in the same manner. Note that the fade-in control time (change time) tx may be determined from the gradation expression capability of the lighting device Z or may be determined from the time length during digest playback of the corresponding control scene. For example, if the time length for the digest playback is 1 minute 30 seconds, and the setting is changed over 10% of the time length, the fade-in control time is about 9 seconds.

Although the fade-in control has been described here, the same applies to the fade-out control. Unlike the example of FIG. 3, when the correction form information of the control scene L4 corresponding to the AV scene S4 indicates fade-out control, and the correction form information of the control scene L6 corresponding to the AV scene S6 indicates normal control, FIG. (C), the control value is varied stepwise during the period from the time t ₂ before the predetermined time from the time t ₀ of switching the AV scene until the time t _0. The predetermined time (fade-out control time) may be determined from the gradation expression capability as in the case of fade-in, or may be determined from the time length during digest reproduction of the control scene corresponding to the AV scene S4.

Next, an example of control processing of the lighting device Z by the content data reproduction device 1 in FIG. 1 in high-realistic reproduction will be described with reference to the flowchart in FIG.
First, the data acquisition unit 10 acquires content data to be reproduced (step S1). The acquired content data is output to the data separator 11. Subsequently, the data separation unit 11 separates the content data into encoded video data and encoded audio data, additional effect control data with correction form information, and digest reproduction information (step S2). The separated data is output to the reproduction control unit 12.

The playback control unit 12 acquires a user instruction regarding the playback method from the user instruction acquisition unit 13 (step S3), and determines whether digest playback is instructed (step S4).
If it is not the digest reproduction (in the case of NO), that is, in the case of normal reproduction, in step S5, control value information of each control scene is acquired in order to control the lighting device Z by normal reproduction, and the additional effect setting unit 16 Then, the additional effect setting unit 16 performs various settings such as setting which color lighting device of RGB to be controlled based on the control value information. This setting information is output to the device control unit 19. The device control unit 19 generates a control command for the lighting device Z based on the setting information (step S6).
Then, the playback control unit 12 outputs a control command from the device control unit 19 in accordance with the playback of the AV content, and performs high-realistic playback by normal playback (step S7).

  On the other hand, if it is determined in step S4 that digest playback is to be performed (in the case of YES), the playback control unit 12 selects an AV scene to be played back based on the digest playback information by the digest playback scene extraction unit 12a (step S8). . Then, based on the information of the AV scene to be reproduced for the selected digest, the control value recorded on the time axis corresponding to the AV scene to be reproduced and the change to the control value from the additional effect control data with correction form information The time, the time length of the control with the control value, and the correction form information about the control value are acquired (step S8). For example, for the AV scene 6 in FIG. 3, the control value information and the correction form information of the control scene L6 corresponding to the AV scene 6 are acquired. These pieces of information are output to the additional effect setting unit 16.

Subsequently, the additional effect setting unit 16 sets the control value and correction mode (additional effect playback method) of the lighting device Z in each AV scene to be digest-reproduced based on the acquired control value and correction mode information. (Step S10). This setting information is output to the device control unit 19. The device control unit 19 generates a control command for the lighting device Z based on the setting information (step S6).
Then, the playback control unit 12 outputs a control command from the device control unit 19 in accordance with the playback of the AV content, and performs high-realistic playback by digest playback (step S7).

As described above, in addition to the control value at the time of normal playback of the lighting device, the control mode information indicating the correction mode at the time of digest playback of the control value at the time of normal playback is added to the content data. Even if the control value information is not attached to the content data, high-realistic reproduction can be performed by digest reproduction.
In addition, even if it is assumed that an additional effect that causes discomfort occurs when the AV scene is switched during digest playback, the correction form information is set so that the control value is corrected for fade-in, fade-out, and off. If it is added appropriately, high-realistic reproduction can be performed by digest reproduction without causing discomfort to the viewer.

  In the above-described example, the scene classification of the video / audio content and the addition classification of the control value of the lighting device match, but the present invention can also be applied to a case where they do not match.

[Second Embodiment]
In the second embodiment, the digest reproduction information and the correction form information are added to the content data by the content producer or distributor. However, in the present embodiment, these pieces of information are included in the content data. If not.

  FIG. 8 is a block diagram showing a configuration example of the content data reproducing apparatus according to the second embodiment of the present invention. In the following, regarding the content data playback apparatus of the present embodiment, the same reference numerals are assigned to the same parts as those of the content data playback apparatus of FIG. 1, and description thereof is omitted as appropriate.

The main difference between the content data playback apparatus of FIG. 8 and that of FIG. 1 is related to the data acquisition unit 20, playback control unit 21, and additional effect setting unit 22.
The content data reproducing device 2 in the example shown in the figure acquires content data by the data acquisition unit 20 in the same manner as the content data reproducing device 1 in FIG. However, unlike the example of FIG. 1, this content data includes only encoded audio data and encoded video data, and additional effect control data, and does not include digest reproduction information and correction form information.

  The playback control unit 21 includes a digest playback scene extraction unit 21b including an importance level calculation unit 21a and a control value extraction unit 21c as units related to digest playback.

  The importance level calculation means 21a calculates the importance level for each AV scene based on the audio / video content included in the content data. For example, first, the feature of each AV scene is extracted by analyzing the content to be reproduced, and the importance is calculated. The “feature” includes AV scene switching information, edge information, motion vector information, and the like that can be extracted from the encoded video data, and can be extracted from the audio information, such as audio level information, silent section information, speech information, and caption information. There is telop information that can be extracted from. Further, the program name, performer, and program content information from the EPG are the above “features”.

  As an importance calculation method, for example, a method of extracting information on scene position from AV scene switching information or motion vector information of video information and calculating importance according to the audio level of each AV scene can be applied. .

The digest playback scene extraction unit 21b extracts an AV scene to be digest played based on the calculated importance.
For example, it is assumed that the video / audio content to be reproduced is composed of six AV scenes (A to F) as shown in FIG. In this case, the importance calculation means 21a calculates the importance for each of the AV scenes A to F. When the calculation result is as shown in FIG. 9B, when performing digest playback using a scene with an importance level of 3 or higher, the digest playback scene extracting means 21b displays the results in FIGS. 10A and 10B. As shown, AV scenes B, D, and F are extracted as AV scenes for digest playback.
The extracted AV scene information for digest playback is output to the control value extraction means 21c.

  The control value extraction means 21c is configured to control the recorded control value corresponding to the time axis of the extracted AV scene to be reproduced, the scheduled control start time with the control value on the normal playback time axis, and the control value. Extract the time length of control at. The information extracted by the control value extraction unit 21 c is output to the additional effect setting unit 22.

  For example, the AV scene to be digest-played is as shown in FIGS. 10A and 10B, and the additional effect control data is as shown in FIGS. 11A and 11B. Suppose. In this case, the relationship between the additional effect control data and the content data is as shown in FIG. In this example, the control value extraction unit 21c, for each of the AV scenes B, D, and F to be digest-reproduced, is recorded in accordance with the control value recorded in accordance with the time axis of the AV scene, and the control is scheduled to start with the control value. The time and the time length of control with the control value are extracted, and additional effect control data at the time of digest reproduction is created. The extraction result in this example is as shown in FIG. For example, for AV scene B, two control values are extracted. Among these, control values of R = 0, G = 255, and B = 255 are set to 0:01:30 as the scheduled start time of control with the control value on the normal reproduction time axis, and control with the control value is performed. Is extracted as 0: 0: 05.

When performing digest reproduction, the control value determining means 22a of the additional effect setting unit 22 determines whether or not the control time at the time of the control value is smaller than a predetermined value (threshold value) for each extracted control value. It is determined whether to correct the control value. The reason why the control value for which the control time is short is set as the correction target is that when the control time is short, the illumination becomes flash and there is a risk of discomfort. For example, if the threshold value is 10 seconds, the control values of R = 0, G = 255, B = 255 corresponding to the second half of the AV scene B are to be corrected.
At this time, when the scene b-2 is started, the extracted control value is invalidated and not applied to the scene b-2.

During the invalid period, as shown in FIG. 13, the control value given to the immediately preceding extraction scene (extraction scene b1) is changed stepwise to the control value of the immediately following extraction scene (extraction scene d1). It is recommended to correct the control value. Further, as shown in FIG. 14, control is performed so that the control value of the extraction scene (extraction scene b-2) whose correction value is to be corrected is the same as the control value of the immediately preceding extraction scene (extraction scene b-1). The value may be corrected. Of course, for the extracted scene whose control value is to be corrected, the control value may be corrected so as to be the same as the control value of the immediately following extracted scene.
In addition, correction may be performed so that the control value fades in or fades out for an extraction scene whose control value is a correction target.

Next, an example of control processing of the lighting device Z by the content data playback device 2 in FIG. 8 in high-realistic playback will be described with reference to the flowchart in FIG.
First, the data acquisition unit 10 acquires content data to be reproduced (step S21). The acquired content data is output to the data separator 11. Subsequently, the data separation unit 11 separates the content data into encoded video data, encoded audio data, and additional effect control data (step S22). The separated data is output to the reproduction control unit 21.

The playback control unit 21 acquires a user instruction regarding the playback method from the user instruction acquisition unit 13 (step S23), and determines whether digest playback is instructed (step S24).
If it is not digest reproduction (in the case of NO), that is, in the case of normal reproduction, the processing of steps S25 to S27 is performed. Since this process is the same as the process of steps S5 to S7 in FIG.

  On the other hand, when it is determined in step S24 that digest playback is to be performed (in the case of YES), the playback control unit 21 analyzes the audio / video content by the importance level calculation unit 21a, and based on the analysis result, digest playback scene extraction unit The AV scene to be digest-reproduced at 21b is selected and determined (step S28). Then, the control value extracting means 21c, based on the information of the selected AV scene to be reproduced for digest, from the additional effect control data, the control value recorded corresponding to the time axis corresponding to the AV scene to be reproduced, the control value And the time length of control with the control value is acquired (step S29). These pieces of information are output to the additional effect setting unit 22.

  The additional effect setting unit 22 sets the control value and correction mode (additional effect reproduction method) of the illumination device Z in each AV scene to be digest-reproduced based on the extraction result of the control value extraction means 21c (step S30). . At this time, with respect to a control value in which the control time length with the extracted control value is smaller than a predetermined value, the control value is invalidated and not applied. During the invalid period, the content data reproducing apparatus 2 (which may be a user) performs corrections determined. Information set by the additional effect setting unit 22 (setting information is output to the device control unit 19.

  The device control unit 19 generates a control command for the lighting device Z based on the setting information (step S26). Then, the playback control unit 21 outputs a control command from the device control unit 19 in accordance with the playback of the AV content, and performs high-realistic playback by digest playback (step S27).

  As described above, even if the content data does not include the digest playback information and the correction form information, the content data is based on the content of the video / audio content and the control time information at the set control value during the digest playback. By controlling the lighting device, it is possible to give a high sense of realism without giving the viewer unpleasant feeling.

[Third Embodiment]
In the present embodiment, digest playback is performed by changing the playback speed according to the importance of the AV scene.
FIG. 16 shows a correspondence example between the importance level of the AV scene and the playback speed. As shown in FIG. 16, the higher the importance level, the closer to the normal playback speed, and the lower the importance level, the higher speed playback allows the user to check the entire content and the contents of the important part. Can be grasped. Note that not all AV scenes need to be played back, and AV scenes with low importance may not be played back.

  In the case of this digest playback, the illumination of a scene that is played back at high speed may become a flash. Therefore, in order to avoid this, as in the case of the second embodiment, the control time length during the digest playback is long. A control value smaller than the predetermined value is corrected. As the correction method, as in the second embodiment, correction to make the control value zero, fade-in and fade-out to the control value of the preceding and subsequent control scenes, and the like can be considered.

In the above description, the lighting device has been described as an example of the device (peripheral device) for controlling the viewing environment, but the peripheral device controlled by the present invention is not limited to this. For example, any device that enhances the sense of reality of audio / video content may be used, such as a fan that produces a wind effect, an air conditioner that produces a temperature and wind effect, and a vibration device that produces a vibration effect. In the above description, only one lighting device is described, but a plurality of lighting devices may be connected. Of course, different devices (for example, lighting and a fan) may be connected. In addition, when the peripheral device is not a lighting device, a control value suitable for the lighting device is used. For example, in the case of a device that generates vibrations, db (digibel), and in the case of a fan, a wind power value, or a control value represented by m / s (milliseconds) or kt (knots) indicating wind speed is used. it can. In addition, the control value of the lighting device is not limited to the RGB value in the above example, and may be a value that can be specified by luminance (cd / m ² ) or illuminance (lx).

  In addition, content data used in the present invention is stored in advance on a recording device (not shown) (a recorder equipped with a hard disk, a device having a large-capacity recording medium such as a Blu-Ray Disc or a DVD, a compact flash (registered trademark), an SD card. For example, a device having a small-sized semiconductor recording medium such as, or may be distributed in the form of broadcast or network communication. Further, additional effect control data (including those with correction form information) and digest playback information may be multiplexed with audio / video content, or the relationship with audio / video content can be understood, and audio / video content can be understood. As long as it can be acquired together, the format may be different from the audio / video content (for example, another file).

  In the embodiment in which the importance of each AV scene needs to be calculated, the calculation method is not limited to the above-described example. For example, for each shot constituting the scene disclosed in WO00 / 40011, the operator Items relating to video characteristics to be scored are provided, and the importance of each scene is calculated based on the points scored in the above items of shots constituting the scene, or disclosed in Japanese Patent Application Laid-Open No. 2007-282268, A method for calculating the importance of a scene (segment) of a video signal and an audio signal based on a motion vector, a color histogram, an audio frequency, a characteristic, and a volume can be applied.

DESCRIPTION OF SYMBOLS 1, 2 ... Content data reproduction apparatus 10, 20 ... Data acquisition part, 11 ... Data separation part, 12, 21 ... Reproduction control part, 12a, 21b ... Digest reproduction scene extraction means, 12b, 21c ... Control value extraction means, DESCRIPTION OF SYMBOLS 13 ... User instruction | indication acquisition part, 14 ... Audio | voice decoding part, 15 ... Video decoding part, 16, 22 ... Additional effect setting part, 17 ... Audio | voice data output part, 18 ... Video data output part, 19 ... Apparatus control part, 21a. ..Importance calculation means, 22a... Control value determination means.

Claims (5)

Content including video and / or audio, and an additional effect control value for controlling the viewing environment corresponding to the content are recorded, at least the content is scene-segmented along a playback time axis, and the additional effect control value is Content data for reproducing content data in which correction value information indicating a correction mode of the control value at the time of digest reproduction is recorded for each scene, which is separately recorded for each range where control values are continuous at a constant value along the reproduction time axis A playback device ,
Comprising at least the control value extracting means and the digest reproduction scene extracting means,
In conjunction with playback during normal playback, control the device that controls the viewing environment based on the recorded control value,
At the time of digest playback, the control value recorded corresponding to the playback time axis corresponding to the extracted digest playback scene is extracted, and the rate of change of the control value with respect to the playback time axis is reduced based on the correction form information A content data playback apparatus that performs fade-in / fade-out, ON control using the same control value as in normal playback, or OFF control that does not perform control based on the control value . 2. The content data according to claim 1, wherein the digest playback scene extraction unit extracts the digest playback scene based on importance of recorded video and / or audio data for each of the divided scenes. Playback device. 3. The content data playback apparatus according to claim 2 , wherein a playback speed of the scene is determined based on the importance of the digest playback scene. The digest playback scene extracting means, claim and extracts in the reproduction of the content data digest scene information indicating a scene of the digest reproduction is recorded, the digest reproduction scene based on the digest scene information 1 content data reproducing apparatus according to. Content playback apparatus according to any one of claims 1-4, characterized in that for reproducing the content data addition section of the scene classification and the control value of the content is consistent.

Images