JP2003324402A - Apparatus, method and program for producing contents linked with external equipment, and apparatus, method and program for reproducing contents linked with external equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for transmitting a broadcast program linked with external equipment, by which a high realistic sensation is produced by operating the external equipment connected to a network on a contents reproducing side to be linked with video, audio and the like by notifying the contents reproducing side of sensitivity information to be made correspond to the video, the audio and the like. <P>SOLUTION: An external equipment linked contents transmission system 3 is composed of a contents transmitting apparatus 1 provided with an external equipment linked contents producing apparatus 10 and a transmitting means 4, a contents receiving apparatus 2 provided with a receiving means 5 and an external equipment linked contents reproducing apparatus 20, and a plurality of external equipments (presentation terminals 60) connected with the contents receiving apparatus 2 by a home network 7, and the sensitivity information representing a level of perception or sensation is transmitted to the contents receiving apparatus 2 to operate the presentation terminal 60 corresponding to the sensitivity information. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a case in which sensitivity information is generated in association with video and / or audio contents, or the sensitivity information is embodied and presented by an external device when reproducing the contents accompanied by the sensitivity information. Technology used in.

[0002]

2. Description of the Related Art Conventionally, broadcasting of television, radio, etc. has been broadcast for television receivers, radio receivers, etc., and viewers have a content (hereinafter referred to as video, audio, still image, text information, etc.). The content was simply referred to as) content was viewed via a television receiver, radio receiver, etc. In addition, the contents are provided through a recording medium such as a CD-ROM or a DVD-RAM, and the viewer plays back and listens to video, audio, etc. by the playback device.

Further, conventionally, household devices have been connected to a LAN.
A home bus system (HBS: Home Bus System) that can be connected to and controlled by, is proposed, for example, an interface of IEEE 1394 standard,
There is a technique for controlling a lighting device, an air conditioner device, and the like in a home.

In such an environment in which devices in the home are connected and operated, the broadcast program is provided with peripheral device operation command information for operating peripheral devices (external devices) on the receiver side according to the contents of the broadcast program. In addition, research on a new broadcasting system that operates peripheral devices according to the content of the broadcast program is also being conducted.

For example, "Broadcast program transmitting / receiving system, broadcast apparatus and receiving apparatus used therein, broadcast program transmitting / receiving method, recording medium reproducing system, recording medium reproducing apparatus and recording medium used therein (Japanese Patent Laid-Open No. 2001-2001) -333
No. 030) ”(hereinafter referred to as prior art), a technique for operating lighting devices, air conditioners, and the like, which are peripheral devices on the receiver side, is disclosed according to the content of a broadcast program.

[0006]

However, in the above-mentioned conventional technology, since only video and audio are transmitted as content in general broadcasting of television, radio, etc., the content of the receiver is only video and audio. It is not possible to reproduce the contents of the above, and to reproduce the reality of each scene in the broadcast program, for example, the atmosphere of the scene in human emotions such as bright and dark, and the surrounding environment in that scene such as temperature and air volume. I couldn't.

The above-mentioned prior art is disclosed as a technology for reproducing this sense of reality. In this prior art,
In order to reproduce that sense of reality, the content creator had to set in advance which external device to operate and to what extent. However, on the content production side, it is not known what external device is connected as the external device on the side that reproduces the content, so there is a problem that it is not possible to reproduce the realistic sensation intended by the content creator. .

The present invention has been made in view of the above problems, and the content reproduction side is notified by associating the sensitivity information representing the degree of perception or the sense with the video and the audio, and thereby the content is reproduced. External device interlocking content generation device, method and program thereof, capable of producing a highly realistic sensation by interlocking the operation of the external device on the reproduction side with video and audio, external device interlocking content reproduction device, method and The purpose is to provide the program.

[0009]

SUMMARY OF THE INVENTION The present invention was devised to achieve the above-mentioned object. First, the external device-interlocked content generation apparatus according to claim 1 is capable of reproducing video and / or audio. By operating an external device that can be controlled by the playback device based on the sensitivity information that expresses the degree of perception or sensation corresponding to the video / audio content, the external device-linked content that presents by replacing the degree of the sensitivity information is displayed. An external device interlocking type content generation device for generating, a sensitivity information input means for inputting sensitivity information, a video / audio content, and an associating means for associating the sensitivity information with each other based on the reproduction time of the video / audio content, It is configured to include.

According to such a configuration, the external device interlocking type content generation apparatus inputs the affective information indicating the degree of perception or the sense by the affective information inputting means, and the associating means with the video / audio content and the affective information. Based on the playback time of the video / audio content.

Sensitivity information is abstract information that expresses the degree of perception or sensation. In addition to physical quantities such as temperature and humidity, the degree of human senses such as "hot", "cold", and "scary" can be expressed. It is information that represents the mood or situation of each scene in an abstract manner, such as "representation", "pleasant", "sad", or "harsh", and information indicating its strength or weakness.

Further, the associating means may be a means for multiplexing the video / audio contents and the sensitivity information. As a result, one streamed content linked to an external device is generated. The video / audio content and the kansei information associated with the video / audio content by time may be distributed via different routes. Here, the video / audio content may be either video-only content, audio-only content, or content including video and audio.

The external device-interlocked content generation device according to claim 2 is the external device-interlocked content generation device according to claim 1, wherein the external device-interlocked content generation device includes a transmission means for transmitting the external device-interlocked content, and at least a pulse. The biological information receiving means for receiving the biological information of the viewer including one or more of blood pressure and electroencephalogram is provided, and the emotional information input means changes the emotional information based on the biological information.

According to this structure, the external device interlocking type content generation device receives the biometric information such as the pulse, blood pressure, and electroencephalogram of the viewer who has watched the external device interlocking type content by the biometric information receiving means, and the sensitivity information. By the input means,
The sensitivity information is changed based on the biometric information. As a result, the sensitivity information suitable for the mood and physical condition of the viewer at that time is updated in real time and transmitted as external device interlocking content.

Further, the external device interlocking type content generating apparatus according to claim 3 is the external device interlocking type content generating device according to claim 1, wherein the external device interlocking type content generating device transmits the external device interlocking type content and the sensitivity information. A change instruction receiving unit that receives a change instruction for changing the affective information is provided, and the affective information input unit changes the affective information based on the change instruction for the affective information.

According to such a configuration, in the external device interlocking type content generation device, the change instruction receiving means receives the affective information change instruction from the viewer who has viewed the external device interlocking type content, and the sensitivity information inputting means causes The affective information is changed based on the affective information change instruction. As a result, the sensitivity information suitable for the viewer's sensitivity is updated in real time and transmitted as external device-linked content.

According to another aspect of the present invention, there is provided an external device-linked content generation method, which is controlled by a reproduction device based on sensibility information indicating the degree of perception or sense corresponding to video / audio content of video / audio. An external device-interlocked content generation method for generating external device-interlocked content that is presented by substituting the degree of the affective information by operating a possible external device, and a kansei information input step of inputting kansei information, The video / audio content and the sensitivity information are associated with each other based on the reproduction time of the video / audio content.

According to such a method, the external device interlocking type content generation method inputs the affective information indicating the degree of perception or the sense in the affective information input step, and the associate step inputs the video / audio content and the affective information. Based on the playback time of the video / audio content. Further, this associating step may be one in which the video / audio content and the sensitivity information are multiplexed.

Further, the external device interlocking type content program according to claim 5 is a video and / or audio video
By operating an external device that can be controlled by the playback device based on the sensitivity information that represents the degree of perception or sensation corresponding to the audio content, external device-linked content that substitutes the degree of the sensitivity information and is presented is generated. In order to use the computer to input the sensitivity information,
The audio content and the kansei information are made to function by the associating means for associating the audio content and the sensitivity information based on the reproduction time of the video / audio content.

According to this structure, the external device interlocking type content program inputs the affective information representing the degree of perception or the sense by the affective information input means, and the associating means inputs the video / audio content and the affective information. ,
Associate based on the playback time of video / audio content. Further, this associating means may be one that multiplexes the video / audio content and the sensitivity information.

According to another aspect of the present invention, the external device-linked content reproduction apparatus reproduces the image / audio content of video and / or audio, the sensitivity information indicating the degree of perception or the sense, and the environment of the sensitivity information. Enter the reproduction time and
An external device-linked content reproduction device that reproduces the environment of affective information by interlocking the external device with the reproduction of video / audio content, wherein the affective information is associated with the operation of one or more external devices. The conversion table holding means for holding the conversion table, the video / audio content playing means for playing the video / audio content, and the external device associated with the conversion table holding means based on the affective information and the reproduction time are operated. External device operation control means for
It is configured to include.

According to such a configuration, the external device interlocking type content reproducing apparatus reproduces the video / audio content of the video and / or audio by the video / audio content reproducing means, and reproduces the reproduction time by the external device operation control means. Based on this, the external device corresponding to the sensitivity information is operated in synchronization with the reproduction of the video / audio contents. At this time, the external device operation control unit operates the external device in an unspecified reproduction environment by referring to the conversion table that stores the correspondence relationship between the sensitivity information and the external device to be operated corresponding to the sensitivity information. .

Further, the external device interlocking type content reproducing device according to claim 7 is the external device interlocking type content reproducing device according to claim 6, wherein the profile accumulation for accumulating a personal profile which is personal information peculiar to a viewer is accumulated. The external device operation control means changes the operation of the external device based on the personal profile stored in the profile storage means.

According to this structure, in the external device interlocking type content reproducing apparatus, the external device operation control means refers to the personal profile accumulated in the profile accumulating means, whereby the age of the individual viewer of the external device , Or the amount of movement is changed based on gender, nationality, hobbies and preferences. As a result, the external device-linked content playback device can display the viewer's individual profile (attribute).
Based on, the sensibility information is presented by an external device suitable for the viewer.

The external device interlocking type content reproducing device according to claim 8 is the external device interlocking type content reproducing device according to claim 6 or 7, wherein the video / audio content viewed by the viewer is viewed. It is characterized in that it comprises a viewing history storage means for storing history, and the external device operation control means changes the operation of the external device based on the viewing history stored in the viewing history storage means.

According to this structure, in the external device interlocking type content reproducing apparatus, the external device operation control means refers to the viewing history such as the program genre and the viewing time stored in the viewing history storage means, so that the viewing The external device to be operated or the amount of operation of the external device is changed based on the current personal taste of each person.

Furthermore, the external device interlocking type content reproducing device according to claim 9 is the external device interlocking type content reproducing device according to any one of claims 6 to 8, wherein at least one of pulse, blood pressure, and electroencephalogram is present. It is characterized by comprising biometrics information acquisition means for acquiring the biometrics information of the included viewer, and the external device operation control means changes the operation of the external device based on the biometrics information acquired by the biometrics information acquisition means. .

According to this structure, in the external device interlocking type content reproducing apparatus, the external device operation control means is based on the biological information such as the pulse, blood pressure, and electroencephalogram of the viewer acquired by the biological information acquisition means for the external device. Or change the amount of movement. This allows the external device-linked content reproduction device to judge the influence on the viewer when the sensibility information is presented by the operation of the external device, thereby facilitating or suppressing the operation of the external device. can do.

The external device interlocking type content reproducing apparatus according to claim 10 is the external device interlocking type content reproducing apparatus according to claim 9, wherein the external device interlocking type content receiving device receives the external device interlocking type content and the biometric information. Biometric information transmitting means for transmitting to an external device-linked content generation device.

According to such a configuration, the external device interlocking type content reproduction apparatus generates the external device interlocking type content generation device using the biometric information transmitting device to obtain the biometric information such as the viewer's pulse, blood pressure, and electroencephalogram acquired by the biometric information acquiring device. Send to device. Thereby, for example, the external device-linked content generation device can change the sensitivity information in real time based on the mood and physical condition of the viewer at that time.

Further, the external device interlocking type content reproducing apparatus according to claim 11 is the external device interlocking type content reproducing apparatus according to any one of claims 6 to 9, wherein the receiving means receives the external device interlocking type content. And a change instruction input means for inputting a sensitivity information change instruction for changing the sensitivity information, and a change instruction transmitting means for transmitting the sensitivity information change instruction to the external device-interlocked content generation device. And

According to this structure, the external device interlocking type content reproduction device transmits the sensitivity information change instruction input by the change instruction inputting means to the external device interlocking type content generating device by the change instruction transmitting means. Thereby, for example, the affective information transmitted by the external device-linked content generation device can be updated in real time to the affective information suitable for the affectiveness of the viewer.

According to the twelfth aspect of the present invention, the external device-linked content reproduction method reproduces the video / audio content of video and / or audio, the sensitivity information indicating the degree of perception or the sense, and the environment of the sensitivity information. Enter the reproduction time and
An external device-linked content reproduction method for reproducing the environment of affective information by interlocking an external device with the reproduction of video / audio content, the video / audio content reproduction step of reproducing the video / audio content, and the sensitivity information. An external device operation step of operating the external device associated with the conversion table holding unit that holds the conversion table in which the sensitivity information is associated with the operation of one or a plurality of external devices based on the reproduction time. I decided to include it.

According to such a method, the external device-linked content reproduction method reproduces the video and / or audio video / audio content in the video / audio content reproduction step, and reproduces the reproduction time at the external device operation control step. Based on this, the external device corresponding to the sensitivity information is operated in synchronization with the reproduction of the video / audio contents. At this time, the external device operation control step operates the external device by referring to the conversion table that stores the correspondence relationship between the sensitivity information and the external device that operates in accordance with the sensitivity information.

Further, the external device-linked content reproduction program according to the thirteenth aspect reproduces the video / audio content of video and / or audio, the kansei information indicating the degree of perception or the sense, and the environment of the kansei information. Input the reproduction time and synchronize the external device with the reproduction of the video / audio content to reproduce the environment of the sensitivity information. An external device operation control means for operating the external device associated with the conversion table holding means for holding the conversion table in which the sensitivity information is associated with the operation of one or a plurality of external devices based on the reproduction time and It is configured to function.

According to this structure, the external device interlocking type content reproduction program reproduces the video and / or audio video / audio content by the video / audio content reproduction means, and reproduces the reproduction time by the external equipment operation control means. Based on the video and audio content playback,
The external device corresponding to the sensitivity information is operated. At this time,
The external device operation control means operates the external device by referring to the conversion table that stores the correspondence relationship between the sensitivity information and the external device to be operated corresponding to the sensitivity information.

[0037]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. (Structure of external device-linked content transmission system) Fig. 1
FIG. 1 is a block diagram showing a schematic configuration of an external device linked content transmission system. As shown in FIG. 1, the external device interlocking type content transmission system 3 includes a content transmitting device 1 including an external device interlocking type content generation device 10 which is a device on the side of transmitting external device interlocking type content, and a transmitting unit 4. A content receiving device 2 including a receiving means 5 which is a device on the side of receiving external device interlocking content and an external device interlocking content reproducing device 20, and a plurality of content receiving devices 2 connected to the content receiving device 2 via a home network 7. It is configured with an external device (presentation terminal 60). The transmitting means 4 may be incorporated in the external device-linked content generation device 10. The receiving means 5 may be incorporated in the external device-linked content reproduction device 20.

The external equipment interlocking type content transmission system 3 receives a video (video signal) from the content transmitting apparatus 1.
And audio (audio signal) are associated with sensitivity information indicating the degree of perception or sensation and transmitted as external device-linked content, and the content receiving device 2 reproduces and outputs video and audio from the external device-linked content. In addition, the degree of perception or sensation indicated by the kansei information is presented instead of the operation of the external device (presentation terminal 60) in association with the video and audio.

Here, the sensitivity information will be described with reference to FIG. This sensitivity information is not information that directly controls the external device on the playback side, but represents the human senses such as "hot", "cold", and "scary" in addition to physical quantities such as temperature and humidity. It is information that abstractly represents the mood or situation of each scene, such as "enjoyable", "sadly", or "harsh", and information indicating its strength or weakness.

For example, as shown in FIG. 7, the wind speed (m /
In the case of expressing s) as the sensitivity information, the wind speed is directly specified by an external device (for example, an air conditioner device) and the wind speed
Instead of expressing it as “s”, it is leveled according to the magnitude of the wind speed and is abstracted as “Wind force 5”, “Wind force 4”, ..., “Wind force 0”, the sensitivity information example EX1, “strong wind”, “somewhat” Sensitivity information example E abstracted as "strong wind", ..., "No wind"
Expressed as X2.

By expressing the wind speed abstractly in this way, it is not necessary to reproduce the wind speed by the air conditioner on the reproducing side, and it can be realized by another external device (for example, a fan). That is, since the environment on the reproduction side differs depending on the environment of the viewer, it is possible to generate the external device interlocking content that does not depend on the external device on the reproduction side by making the affective information abstract representation in this way. Become.

Next, the relationship between the sensitivity information and the operation of the external device will be described. For example, as illustrated in FIG. 7, in the case of the sensitivity information example EX2 in which the sensitivity information indicates “strong wind” to “no wind”, “strong” as the external device (presentation terminal 60),
When only fans that operate at four levels of "medium" and "weak" and "stop" are connected to the home network 7, the sensitivity information type "wind" corresponds to the external device "fan". Attached, the level of sensitivity information "strong wind",
“Slightly strong wind” is associated with “strong”, “medium wind” is associated with “medium”, “light breeze”, “light breeze” is associated with “weak”, and “no wind” is associated with “stop”. Also, for example, "bright"
Sensitivity information indicating the atmosphere of the place such as “dark” may be associated with the brightness of the “lighting device”. In this way, the sensitivity information is associated with the external device (presentation terminal 60) connected to the home network 7 and its operation. This correspondence relationship is held by the external device-linked content reproduction device 20 as a conversion table.

Returning to FIG. 1, the configuration of the external device interlocking transmission system 3 will be described. The external device interlocking content generation device 10 generates an external device interlocking content in which a video signal, an audio signal, and emotional information are associated with a time at which the emotional information is reproduced.

The transmitting means 4 is for transmitting the external device interlocking content generated by the external device interlocking content generation device 10 via a broadcast wave or a network. The receiving means 5 receives the external device interlocking type content transmitted via the broadcast wave or the network and outputs it to the external device interlocking type content reproducing device 20.

External device-linked content reproduction apparatus 20
Plays and outputs video and audio from external device interlocking contents, and in conjunction with the video and audio,
The perception or the degree of sensation indicated by the sensitivity information is presented by substituting the operation of an external device (presentation terminal 60), for example, an air conditioner device, a lighting device, or the like. The presentation terminal 60 operates based on an operation control signal output from the external device-linked content reproduction device 20. There may be a plurality of presenting terminals 60 as long as they are devices that can be connected to the home network 7.

The home network 7 is a network laid in the home of the viewer and is used for connecting devices in the home. This home network 7 is, for example, an IE
It may be in the form of a home bus system (HBS: Home Bus System) using an interface of the EE1394 standard. Hereinafter, the external device-linked content generation device 10 and the external device-linked content reproduction device 20 will be described in detail.

(Structure of External Device-Linked Content Generation Device) First, the structure of the external device-linked content generation device will be described with reference to FIG. FIG. 2 is a block diagram showing the overall configuration of the external device-linked content generation device 10 according to the present invention. Note that FIG. 2 shows an example of the content transmission device 1 in which the transmission means 4 is added to the external device-interlocked content generation device 10 and the broadcaster distributes the content. As shown in FIG. 2, the external device interlocking content generation apparatus 10 includes a sensitivity information / reproduction time input means 11, an external environment detection means 12, and a sensitivity information conversion means 1.
3, sensitivity information encoding means 14, and video encoding means 15
And a voice encoding means 16 and a multiplexing means 17.

This external device interlocking type content generation apparatus 1
0 is for generating the external device interlocking content in which the sensitivity information indicating the degree of perception or the sense is added to the video signal and the audio signal. The external device-linked content is played back by the playback device to operate the home device (external device) on the playback side in conjunction with video and audio.

Sensitivity information / reproduction time input means 11 (sensibility information input means and reproduction time input means) inputs program progress information which is a timetable of a broadcast program (content) from the outside, and the sensitivity information and its sensitivity information. The reproduction time for reproducing is extracted. The affective information and the reproduction time extracted here are output to the affective information encoding means 14.

As shown in FIG. 8, the program progress information includes a start time ST and an end time ET for each scene of content,
It is a time table which shows the program progress containing the affective information (sensitivity information example EX3, affective information EX4) in the scene. For example, from the start time ST "00:00:00" to the end time ET "00:00:20" is the scene of the "opening" of the program, and the producer of the program gives "freshness" to the scene. It is intended to be expressed, and "flower garden" is used in the video. Then, in this scene, "scented flower" (sensitivity information example EX
3) or “soft breeze” (sensitivity information example EX4) is set.

The external environment detecting means 12 uses the external environment such as wind speed, temperature, humidity and odor at the time of shooting for inputting the video signal and the audio signal as a physical quantity in order to generate and transmit the external device interlocking type content in real time. It is something to detect. The external environment detection means 12 detects wind direction, wind speed, temperature, humidity, odor, and the like as physical quantities based on an anemoscope, anemometer, thermometer, hygrometer, odor sensor, and the like, which are not shown. The physical quantity detected here is the sensitivity information conversion means 1
3 is output. By this external environment detection means 12,
In the state of being associated with the content in real time,
You can enter the external environment on the spot.

The sensitivity information conversion means 13 is for converting the physical quantity input from the external environment detection means 12 into sensitivity information. The affective information converted by the affective information converting means 13 is output to the affective information encoding means 14. The sensitivity information conversion means 13 converts the physical quantity into sensitivity information based on a correspondence table (not shown) in which the input physical quantity and sensitivity information are associated in advance. For example, when the physical quantity input from the external environment detection means 12 is “wind speed 10 m” and the correspondence table has the correspondence relationship as shown in FIG. 7, the sensitivity information conversion means 13 uses “wind power 4” as the sensitivity information. Alternatively, it is converted into "moderately strong wind", more specifically, information with a level.

The affective information encoding means 14 generates encoded affective information by encoding the affective information input from the affective information / reproduction time input means 11 or the affective information converting means 13 as numerical information. The affective information encoding means 14 encodes the type and level of the affective information by individually associating them with numerical values. This encoded encoded affective information is the multiplexing means 1
It is output to 7. When the affective information / reproduction time inputting means 11 inputs the affective information, the affective information encoding means 14 also outputs the reproducible time to be notified at the same time to the multiplexing means 17.

The video encoding means 15 encodes the input video signal and outputs it as an encoded video signal. The voice encoding means 16 encodes the input voice signal and outputs it as a coded voice signal. The video encoding means 15 and the audio encoding means 16
Is, for example, MPEG2 (Moving Picture).
The video signal and the audio signal are coded into the coded video signal and the coded audio signal by performing the compression coding by the eExperts Group 2).

The multiplexing means 17 (association means) has the encoded affective information encoded by the affective information encoding means 14, the encoded video signal encoded by the video encoding means 15, and the audio encoding means 16. And the encoded audio signal encoded by
It is associated with time information generated from a timer (not shown) and multiplexed as external device interlocking content. For example, the time information is embedded in the encoded data of MPEG2 as a time code, and the encoded affective information is MPE.
User data (UD: User) specified in G2
Multiplexing is performed by writing in the data area. When the reproduction time is input at the same time as the encoded affective information from the affective information encoding means 14, the encoded affective information, the encoded video signal, and the encoded audio signal are associated with the time information at the timing of the reproduction time. To be

The multiplexing means 17 multiplexes the coded sensitivity information, the coded video signal and the coded audio signal as, for example, an MPEG2 transport stream (TS), and the multiplexed external device via the transmitting means 4. The linked content (MPEG2 transport stream) is transmitted as a broadcast wave, or is transmitted to a receiving device via a network such as the Internet.

The configuration of the external device-interlocked content generation apparatus 10 according to the present invention has been described above based on the embodiment, but the present invention is not limited to this.
For example, the multiplexing unit 17 multiplexes the coded sensitivity information, the coded video signal, and the coded audio signal as an MPEG2 program stream (PS), and is written in a digital recording medium such as a CD-ROM or the like, which is interlocked with an external device. The content may be output to the outside. Further, the encoded affective information and the reproduction time of the affective information encoded by the affective information encoding means 14 are provided on a different route from the video / audio content including the video signal and the audio signal, for example,
It may be transmitted via a network.

From the external device-linked content reproducing apparatus 20 (FIG. 3), the viewer's pulse, blood pressure, body temperature, and electroencephalogram are received via receiving means (biological information receiving means, change instruction receiving means) not shown. A biometric information signal (signal B) indicating biometric information such as the above or a change instruction signal (signal B) for changing the affective information from the viewer is received, and the affective information / reproduction time input means 11 changes the affective information. It may be in the form. For example, the physical condition of the viewer (such as having a cold) is determined based on the viewer's body temperature, and the sensitivity information "cold" is not output, or the sensitivity information "cold" is changed to "cool". It is also possible.

Further, the video encoding means 15 and the audio encoding means 16 are provided from the external device interlocking type content generation apparatus 10.
May be separated, and the coded video signal and the coded audio signal which have been coded in advance may be input and multiplexed by the multiplexing means 17.

The external device interlocking type content generation apparatus 10 can also realize each unit in the computer as each functional program, and combine each functional program to operate as the external device interlocking type content generating program. Is also possible.

(Operation of External Device-Linked Content Generation Device) Next, the operation of the external device-linked content generation device 10 will be described with reference to FIGS. 2 and 10. Figure 1
0 is a flowchart showing the operation of the content transmission device 1 including the external device-linked content generation device 10.

First, the content creator inputs the sensitivity information from the program progress information (timetable) or detects the external environment by using the changeover switch (not shown) of the external device-interlocking content generation apparatus 10. Whether or not to perform is switched, and the input source of the sensitivity information is determined by the switch (step S10). Here, when the input source of the affective information is “program progress information”, the affective information / reproduction time input means 11 reproduces the affective information and the affective information from the program progress information (reproduction time (start time, end time). ) Is extracted (step S11: sensitivity information input step and reproduction time input step), and the process proceeds to step S14.

On the other hand, in step S10, when the input source of the sensitivity information is the "external environment", the external environment detecting means 12 detects the external environment such as temperature and humidity,
The physical quantity is acquired (step S12). Then, the sensitivity information converting means 13 converts the physical quantity into sensitivity information (step S13).

The sensitivity information output in steps S11 and S13 is encoded by the sensitivity information encoding means 14 into encoded sensitivity information of numerical information (step S14). Then, the time at which the coded sensitivity information, the coded video signal that codes the video signal, and the coded audio signal that codes the audio signal are generated from a timer (not shown) by the multiplexing means 17. In association with information, it is multiplexed as external device linked content (step S
15: association step, multiplexing step). And
This external device-linked content is transmitted by the transmission means 4.
It is transmitted as a broadcast wave or is transmitted to a receiving device via a network (step S16: transmitting step).

By the above steps, the content (external device interlocking type content) in which the sensitivity information indicating the degree of perception or the sense is associated with the video and audio can be generated and transmitted to the receiving device. As a result, it becomes possible to convey information such as the sense of presence and mood for each scene intended by the content creator.

(Structure of External Device-Linked Content Playback Device) Next, the structure of an external device-linked content playback device for playing back external device-linked content will be described with reference to FIGS. FIG. 3 is a block diagram showing the overall configuration of the external device-linked content reproduction device 20 according to the present invention. Further, FIG. 4 is a block diagram showing an internal configuration of the sensitivity information converting means 24 of the external device-linked content reproduction device 20. Further, FIG. 5 is a block diagram showing an internal configuration of the integrated control means 28 of the external device-linked content reproduction apparatus 20.

Note that, in FIG. 3, the receiving means 5 is added to the external device interlocking type content reproducing device 20 to receive and reproduce the external device interlocking type content transmitted via the broadcast wave or the network. 2 shows an example. Further, in FIG. 3, the external device-linked content playback device 20 in the home network 7, the external device (presentation terminal 60) that is operated when playing the external device-linked content, the input terminal 70, and the biometric information acquisition. Terminal 8
0 shows a home network environment 8 to which 0 and 0 are connected.

As shown in FIG. 3, the external device interlocking type content reproducing apparatus 20 includes a separating means 21, a video / audio decoding means 22, a time generating means 23, and a sensitivity information converting means 2.
4, video / audio presentation control means 25, and time control means 2
6, sensitivity information presentation control means 27, and integrated control means 28
The configuration includes and. The video / audio content reproducing means described in the claims is composed of the video / audio decoding means 22 and the video / audio presentation control means 25, and the external device operation control means is the sensitivity information conversion means 24 and the sensitivity information presentation. And the control means 27.

This external device-linked content reproduction apparatus 2
0 is for reproducing the external device interlocking content in which the sensitivity information indicating the degree of perception or the sense is added to the video signal and the audio signal.

The separating means 21 encodes the external device interlocking content (signal A) received via the receiving means 5 from a broadcast wave or a network such as the Internet, into an encoded video signal, an encoded audio signal, time information and a code. It is to be separated into sensitized information (signal C). The coded video signal and the coded audio signal are output to the video / audio decoding means 22, the time information is output to the time information generating means 23, and the coded affective information (signal C) is output to the affective information converting means 24. To be done.

The video / audio decoding means 22 inputs the coded video signal (coded video signal) and the audio signal (coded audio signal), and outputs each coded signal as the video signal and audio. It is decoded as a signal. The video and audio signals decoded here are output to the video / audio presentation control means 25.

The time generation means 23 outputs a time signal synchronized with a timer (not shown) based on the time information. This time signal is output to the time control means 26. The affective information converting means 24 converts the encoded affective information (signal C) into an operation control signal (signal E) for operating each external device (presentation terminal 60). This operation control signal is output to the sensitivity information presentation control means 27. Here, referring to FIG. 4 (see FIGS. 3 and 5 as appropriate),
The internal configuration of the sensitivity information conversion means 24 will be described in detail.

The viewing history analyzing means 24a analyzes the history of the content viewed by the viewer notified from the viewing history updating means 28d of the integrated control means 28, and stores the history in the viewer history storage means 24b as the viewing history. To do. Here, the viewing history is, for example, the program genre of the broadcast program selected by the viewer (sports, movies, news, etc.)
And viewing time. The viewing history accumulated here is referred to by the sensitivity information control means 24f via the selection conversion control means 24e. Viewer history storage means 24
Reference numeral b is for accumulating the viewing history, and is constituted by a recording medium such as a non-volatile memory.

The personal profile generation control means 24c
A personal profile is generated based on the attribute information of the individual notified from the personal profile updating means 28e of the integrated control means 28, and is accumulated in the personal profile accumulating means 24d or the personal profile accumulated in the personal profile accumulating means 24d. Is to be updated. The individual attribute information is information unique to each viewer, and indicates, for example, the viewer's age, sex, nationality, hobbies and preferences. Moreover, the personal profile indicates the entire attribute information of the individual.

The personal profile generation control means 24c may be configured to automatically reflect the hobbies and preferences of the viewer in the personal profile by referring to the viewing history. For example, if you have a long listening time for a classical music program in your viewing history, your personal profile might say "Favorite music:
It is also possible to set like "classic". Further, when there are a plurality of viewers, a common personal profile (common profile) is created by logical product (AND) of the personal profiles of the viewers, and the sensitivity information is converted using the common profile. It doesn't matter.

The personal profile accumulating means 24d is for accumulating personal profiles and is composed of a recording medium such as a non-volatile memory. Selective conversion control means 24
e is a selection instruction signal (signal D) notified from the viewing history / personal profile selection means 28f of the integrated control means 28.
On the basis of the viewing history storage means 24b and the personal profile stored in the personal profile storage means 24d, the information referred to by the sensitivity information control means 24f is selected and output. Is.

The affective information control means 24f receives the encoded affective information (signal C) input from the separating means 21 on the basis of the conversion table held in the conversion table holding means 24g as an external device (presentation terminal). 60) is converted into an operation control signal for operating. This operation control signal is output to the control information suppression promoting means 24h.

The sensitivity information control means 24f converts the encoded sensitivity information (signal C) into an operation control signal by referring to the viewing history and the information of the personal profile input from the selection conversion control means 24e. For example, when the viewing time of a classical music program is long in the viewing history, when a feeling of "refreshing" is presented as the encoded sensitivity information using an external device, a piano that automatically plays is connected to the home network 7. In that case, it is also possible to play a "refreshing classical music" with the piano to show freshness. In addition, for example, when "favorite color: red" is set in the personal profile, when the sensation of "enjoying" is presented as the encoded sensibility information using an external device, the lighting device that outputs red color is used in the home. When connected to the network 7, it is possible to present a pleasant atmosphere to the viewer by turning on the lighting device.

The conversion table holding means 24g includes the encoded affective information (signal C) obtained by encoding the affective information, and an external device (presentation terminal 60) that operates in response to the encoded affective information.
It holds a conversion table showing the correspondence relationship of, and is composed of a recording medium such as a non-volatile memory.

In this conversion table, it is not necessary to associate the operation of one external device with one piece of encoded affective information, and one piece of encoded affective information, for example, “fear”, is used for “illumination” or “external device”. It is also possible to present a sense of dread by making "chair with vibrator" etc. correspond and blinking "lighting" or increasing the vibration of "chair with vibrator".

The control information suppression promoting means 24h operates based on the suppression instruction signal or the promotion instruction signal (signal D) notified from the biometric information acquiring means 28g of the integrated control means 28, and is operated by the sensitivity information control means 24f. The control signal is suppressed or promoted and output to the sensitivity information presentation control means 27 as a new operation control signal (signal E). The suppression instruction signal or the promotion instruction signal may be changed by the viewer directly from the input terminal 70 via the integrated control means 28. Returning to FIG. 3, the description will be continued. Note that FIG. 4 will be appropriately referred to for the internal configuration of the sensitivity information converting means 24.

The video / audio presentation control means 25 outputs the video signal and audio signal decoded by the video / audio decoding means 22 to an external device (presentation terminal 60). For example, the video signal is output to the monitor and the audio signal is output to the speaker. The video signal and the audio signal are output based on the presentation timing signal notified from the time control means 26.

The time control means 26 synchronizes the presentation timing with the video / audio presentation control means 25 and the sensitivity information presentation control means 27 based on the time signal input from the time generation means 23. It is for generating a signal. The affective information presentation control means 27 outputs the operation control signal (signal E) for operating the external equipment converted by the affective information converting means 24 to the external equipment (the presentation terminal 60).
Is output to. The operation control signal (signal E) is output based on the presentation timing signal notified from the time control means 26.

The integrated control means 28 controls the entire external device interlocking type content reproduction apparatus 20, and as shown in FIG. 5, the reproduction content designation means 28a, the connected equipment confirmation means 28b, the conversion table updating means c, and the viewing. The history update means 28d, the personal profile update means 28e, the viewing history / personal profile selection means 28f, and the biometric information acquisition means 28g are provided.

The reproduction content designation means 28a notifies the reception means 5 of an instruction to obtain the designated content in order to obtain the content designated by the viewer from the input terminal 70. For example, when the viewer notifies the receiving means 5 of the channel of the broadcast program from the input terminal 70, the receiving terminal 5 demodulates the content which is the broadcast program and outputs the demodulated content to the separating means 21.

The connected device confirmation means 28b is an external device (presentation terminal 60 or the like) connected to the home network 7.
Is to confirm. This connected device confirmation means 28b
Issues a recognition confirmation command (signal F) to the home network 7 at regular time intervals, and a terminal type indicating the type from an external device connected to the home network 7 or a control system of the external device, for example, If it is an air conditioner, it controls the "temperature", and acquires the "temperature designated range" of the temperature controllable range as a parameter. The external device that returns a response to the recognition confirmation command (signal F) is determined to be a controllable external device.

The connected device confirmation means 28b stores the conversion table stored in the conversion table storage means 24g of the sensitivity information conversion means 24 based on the external equipment connected to the home network 7 and judged to be controllable. Update.

The conversion table updating means 28c updates the conversion table held in the conversion table holding means 24g of the sensitivity information converting means 24 by the viewer operating the input terminal 70. For example, the presenting terminal 60 connected to the home network 7 may be used to specify a non-operating one or change the operating range (for example, the set temperature range of the air conditioner, the volume range of the speaker, etc.). is there.

The viewing history updating means 28d notifies the sensitivity information converting means 24 of the history of the contents viewed by the viewer, and updates the viewing history stored in the viewing history accumulating means 24b of the sensitivity information converting means 24. Is.

The personal profile updating means 28e notifies the sensitivity information converting means 24 of the individual attribute information of the viewer input by the viewer from the input terminal 70, and the sensitivity information converting means 2
4 is for generating or updating the personal profile stored in the personal profile storing means 24d.

Viewing history / personal profile selecting means 28
f is the viewing history storage means 24 when the affective information converting means 24 converts the encoded affective information (signal C) into an operation control signal (signal E) for operating an external device (presentation terminal 60).
The selection conversion control means 24e is notified of a selection instruction signal (signal D) indicating whether to refer to the viewing history stored in b or the personal profile stored in the personal profile storage means 24d. This selection is performed by the viewer's instruction from the input terminal 70.

The biometric information acquisition means 28g is presented to the control information suppression promoting means 24h of the sensitivity information conversion means 24 on the basis of biometric information such as the viewer's pulse, blood pressure, and electroencephalogram acquired from the biometric information acquisition terminal 80. A notification of a suppression instruction signal for suppressing the operation of 60 or a promotion instruction signal for promoting the operation is given. The biometric information acquisition unit 28g determines that, for example, when an abnormal increase in the heart rate of the viewer is detected, it causes physiological, mental or physical harm or pressure to the viewer, and the sensitivity information conversion unit 28g. 24 control information suppression promoting means 2
4h is notified of a suppression instruction signal for suppressing (including stopping) the operation of the presentation terminal 60. Further, for example, when there is no change in the heart rate of the viewer and the effect of the presentation terminal 60 is small, a promotion instruction signal for promoting the operation of the presentation terminal 60 is notified to the control information suppression promotion means 24h.

In order to judge the abnormality or effect of the biometric information, the personal profile updating means 28c uses the personal profile accumulated in the personal profile accumulating means 24d of the sensitivity information converting means 24 in advance for the viewer. It is possible to make a judgment by registering the normal heart rate range and the like. Alternatively, the personal profile may be updated based on the biometric information. For example, by judging the physical condition of the viewer (such as having a cold) based on the viewer's body temperature and reflecting the judgment result in the personal profile, the temperature of the "air conditioner" should not be lowered, or It will be possible to change or not to make the "chair" vibrate.

Further, the biometric information is used as a biometric control signal (signal B) by an unillustrated transmitting means (biological information transmitting means) by the external device interlocking type content generating apparatus 1.
0 (FIG. 2), and the external device-interlocked content generation device 10 can change the sensitivity information based on the biometric information. Alternatively, the viewer inputs an instruction to change the affective information from the input unit 70, and the change instruction is used as a change instruction signal (signal B) by a transmission unit (biological information transmission unit) not shown in the drawing, and the external device-linked content It is also possible to transmit the information to the generation device 10 (FIG. 2) and allow the external device-linked content generation device 10 to change the sensitivity information based on the selection instruction signal.

Further, the personal profile can be changed by the viewer from the input terminal 70 according to the viewing situation such as the mood and mood of the viewer at the time of viewing, and the password is set when the personal profile is updated. by doing,
It is also possible that only that viewer can update the personal profile.

The configuration of the external device-interlocked content generation apparatus 20 according to the present invention has been described above based on the embodiment, but the present invention is not limited to this.
For example, a form may be provided in which a content reading unit for reading the content written in a digital recording medium such as a CD-ROM is provided and the external device interlocking content written in the CD-ROM or the like is reproduced.

Further, the external device interlocking type content generation apparatus 20 can also realize each means in the computer as each functional program, and combine each functional program to operate as the external device interlocking type content reproducing program. Is also possible.

(Operation of External Device-Linked Content Playback Device) Next, the operation of the external device-linked content playback device 20 will be described with reference to FIGS. 3, 4, 5, and 11. FIG. 11 is a flowchart showing the operation of the content receiving device 2 including the external device-linked content reproducing device 20.

First, the external device interlocking type content reproduction apparatus 20 issues a recognition confirmation command (signal F) to the home network 7 by the connection device confirmation means 28b of the integrated control means 28 to connect to the home network 7. The external device connected to the home network 7 is confirmed by acquiring the terminal type indicating the type and the control system of the external device from the existing external device (step S21), and the acquired terminal type and control. Based on the system, the conversion table held in the conversion table holding means 24g of the sensitivity information converting means 24 is updated (step S22). The steps S21 and S22 are periodically performed when the external device-linked content reproduction apparatus 20 is activated or at regular time intervals.

Then, in accordance with an instruction from the reproduction content designating means 28a, the receiving means 5 receives the designated external device-linked content via the broadcast wave or the network (step S23: receiving step). The received external device linked content is separated by the separating means 21 into an encoded video signal, an encoded audio signal, time information, and encoded affective information (step S24: separation step). Then, the affective information control unit 24f acquires the external device and its operation amount corresponding to the encoded affective information separated in step S24 based on the conversion table held in the conversion table holding unit 24g, and It is converted into an operation control signal for operating an external device (step S25).

The coded video signal and the coded audio signal separated in step S24 are the video / audio decoding means 2
The video / audio presentation control unit 25 outputs the video or audio to an external device (presentation terminal 60) that outputs the video or audio based on the presentation timing based on the time information decoded in step 2 and separated in step S24. Audio is reproduced (step S26: video / audio content reproduction step).

On the other hand, based on the operation control signal converted in step S25, the sensitivity information presentation control means 27
By operating the external device connected to the home network 7 corresponding to the operation control signal at the presentation timing based on the time information separated in step S24, the external device (the presentation terminal 60) is associated with the video or audio. ) Is operated (step S27: external device operation step).

At this time, when the biometric information acquisition terminal 80 is connected as an external device, the biometric information monitoring means 28
The biometric information such as the pulse, blood pressure, and electroencephalogram of the viewer is acquired by g, and the operation amount of the external device (presentation terminal 60) is changed as necessary (when an abnormality in the biometric information is detected, for example) (step). S28).

By the above steps, the external device connected to the viewer's home network is operated from the sensitivity information indicating the degree of perception or sensation to simulate the atmosphere or environment intended by the content creator. It can be reproduced.

(Example of Playback Environment for External Device-Linked Content) Next, an example of a playback environment for playing back external device-linked content will be described with reference to FIG. Figure 6
When playing back external device-linked content (Signal A),
FIG. 6 is a schematic diagram of a viewer's reproduction environment 6 showing an external device that operates in conjunction with video and audio. As shown in FIG. 6, an external device-linked content playback environment 6 is configured by connecting a content receiving device 2 including an external device-linked content playback device 20 and various external devices to a home network 7. ing. The general operation of each external device will be described below. It should be noted that all of the following external devices are assumed to be provided with an interface including remote controller control capable of transmitting and receiving control signals for the home network 7.

The video presenting terminal 40 displays a video signal and is, for example, a monitor. The video presenting terminal 40 may be a terminal capable of changing the white balance of the video signal. The white balance is expressed by adding a slight amount of color to a pixel expressed by an achromatic color of white to black. Using this white balance function, sensitivity information such as "joy" and "sadness" can be expressed by adding "redness" and "blueness" to achromatic pixels on the screen. it can.

The voice presentation terminal 41 outputs a voice signal and is, for example, a speaker. It should be noted that the voice presenting terminal 41 presents the kansei information by changing the pitch of the voice signal or transposing the tone of the music when music is playing in a certain scene. For example, as a general sense, to present the “glamor” of kansei information,
It can be expressed by transposing the tone higher.

The illuminance presentation terminal 42 is a lighting device capable of adjusting the brightness. By adjusting the brightness with the illuminance presenting terminal 42, for example, the mood of a “bright” scene can be expressed, and the emotion of “fun” can also be expressed.

The color temperature presenting terminal 43 is a multicolor illuminating device capable of color output with the three primary colors. The color temperature presenting terminal 43 can output a warm color, for example, to represent an atmosphere of a "warm" place or a temperature state of "hot". In addition, by outputting a cold color, it is possible to express the atmosphere of a “silent” place and the temperature state of “cool”.

The performance information presentation terminal 44 is a musical instrument such as a piano capable of automatic performance. This performance information presentation terminal 44
Can play the music and the sound effects in accordance with the video presented by the video presentation terminal 40 and the voice presented by the audio presentation terminal 41 to express the atmosphere of the place. In addition,
The performance information presentation terminal 44 can more accurately express the atmosphere of the place to the viewer by using the music that matches the taste of the viewer.

The tactile sense presentation terminal 45 is a device for presenting a tactile sense by vibration, pressure or the like. The odor presenting terminal 46 is a device that presents various odors by mixing particles that are the bases of odor components. The taste presenting terminal 47, like the odor presenting terminal 46, has components that are the bases of several kinds of taste components,
It is a device that presents a taste to the tongue by mixing these alone or by mixing them. Such a tactile presentation terminal 45
Information corresponding to the sense of touch, the sense of smell, and the sense of taste can be expressed to the viewer by the scent presenting terminal 46 and the taste presenting terminal 47. For example, the tactile sense presentation terminal 45 can express a person's “high feeling” or “tension” by the strength of vibration.

The wind pressure presenting terminal 48 is a device capable of adjusting the strength of the wind, and is, for example, a fan. The wind pressure presenting terminal 48 can express the strength of the wind in the image presented by the image presenting terminal 40 and the atmosphere of the place by the wind. For example, the situation of a "fresh" place can be expressed by a wind with weak wind.

The biometric information acquisition terminal 49 displays the pulse of the viewer,
The brain wave detection terminal 50 is a device that acquires biological information such as blood pressure, and the brain wave detection terminal 50 is a device that detects a viewer's brain wave. With these, for example, the degree of the viewer's sense of receiving the reproduction of the external device-linked content can be grasped by the viewer's pulse rate and blood pressure. Or α
It is possible to know whether or not the viewer feels relaxed by detecting waves or the like.

The vibration acceleration presentation terminal 51 is a device for experiencing vibration and gravitational acceleration. The low frequency sound presentation terminal 52 is a device that outputs low frequency sound. With such a vibration acceleration presenting terminal 51 and a low frequency acoustic presenting terminal 52, for example, an environment such as an earthquake can be experienced.

The motion presenting terminal 53 is a device capable of presenting a human motion such as a humanoid robot. With this motion presenting terminal 53, for example, in a "happy" scene, the enjoyment can be expressed by dancing, and in a "dark" scene, the atmosphere can be expressed by turning the face down. it can.

The emotion presenting terminal 54 is a device capable of expressing emotional characteristics such as wind chimes and lions. With this emotion presenting terminal 54, it is possible to express "coolness" by, for example, ringing a wind chime, or to express "quietness" in the vicinity by ringing a lion.

The humidity adjusting terminal 55 is a device such as a humidifier and a dehumidifier that can adjust the humidity. In addition, the temperature adjustment terminal 56
Is capable of adjusting room temperature, and is, for example, an air conditioner. With the humidity adjusting terminal 55 and the temperature adjusting terminal 56, for example, the humidity and temperature of the scene shown in the video can be expressed as the actual temperature.

The reverberation adjusting terminal 57 is a device for adjusting the reverberation time in the room. With this reverberation adjusting terminal 57, it is possible to express the "expansion" of the scene, for example, by echoing the voice spoken by the character in a certain scene.
The external devices described above are all in the home network 7
Need not be connected to. In addition, if the terminal is compatible with the interface of the home network 7 and can control the operation from the external device-linked content reproduction device 20,
The terminal other than the illustrated terminal may be used.

(Exemplary Playback of External Device-Linked Content) Next, an exemplary playback of external device-linked content will be described with reference to FIGS. 8 and 9. FIG. 9 is a schematic diagram showing an example of a video scene that progresses along the program progress information shown in FIG. 8 and an operation of an external device that operates in conjunction with the video scene.

The video scene A1 of FIG. 9 (1) is a video scene from the start time ST "00:00:00" to the end time ET "00:00:20" of the program progress information of FIG. Is shown. In addition, the video scene A2 of FIG. 9 (2) shows the start time ST “00:
The figure shows "dancing people", which is a video scene from "00:20" to the end time ET "00:01:30". Further, the video scene A3 of FIG. 9 (3) has the end time E from the start time ST “00:01:30” of the program progress information of FIG.
It shows "people who are frightened", which is a video scene until T "00:02:00".

When the sensitivity information of "breeze", "dancing", and "fear 5" of the sensitivity information example EX4 of FIG. 8 is added to each of the video scenes of FIGS. 9 (1) to 9 (3). , For example, in the video scene of FIG. 9 (1), "soft breeze"
As the external device for presenting the above, the wind pressure presenting terminal 48 (fan) is operated with the air volume "weak".

In the video scene of FIG. 9 (2), the color temperature presenting terminal 43 is used as an external device for presenting "dancing".
The (illumination device) and the operation presentation terminal 53 (humanoid robot) are operated. At this time, the color temperature display terminal 43 expresses a pleasant atmosphere of people with a bright color tone.
In addition, the motion presenting terminal 53 expresses a pleasant atmosphere by dancing like people in the video scene.

Further, in the video scene of FIG. 9C, the illuminance presentation terminal 42 is used as an external device for presenting "fear 5".
The (illumination device) and the vibration acceleration presentation terminal 51 are operated. At this time, by causing the illumination of the illuminance presentation terminal 42 to "blink" or operate the vibration acceleration presentation terminal 51 with the amount of vibration "strong", people's fear can be expressed and the shaking of the earthquake can be felt by the viewer. I am letting you.

In this way, by reproducing the external device interlocking type content to which the kansei information is added, the viewer can experience the contents in a simulated manner by using the device in the home, and also have a high sense of presence. You can experience it.

[0125]

As described above, the external device interlocking content generation apparatus, the method and the program thereof, the external equipment interlocking content reproducing apparatus, the method and the program thereof according to the present invention have the following excellent effects. Play.

According to the invention described in claim 1, claim 4 or claim 5, sensitivity information representing the degree of perception or sense is added to the image / audio content of the image and / or audio,
It is possible to generate external device interlocking content that operates an external device existing in a viewer's viewing environment. Also,
Since the external device interlocking content does not include an operation command for directly operating the external device, it can be generalized regardless of the type and model of the external device existing in the viewing environment of the viewer. As a result, the external device interlocking content can be used as content for broadcasting, and the expression method in broadcasting can be greatly expanded from the expression of only video and audio.

According to the invention described in claim 2 or claim 10, since the sensitivity information of the external device interlocking type content reproduction apparatus can be changed based on the biometric information of the viewer, the viewer's constitution and Sensitivity information suitable for the physical condition and the like can be reflected in real time in the external device linked content. This makes it possible for content creators to achieve the emotions, feelings, and
The atmosphere etc. can be reproduced.

According to the invention as set forth in claim 3 or claim 11, the sensitivity information generated by the external device-linked content reproduction apparatus can be changed based on the instruction from the viewer. It is possible to reflect the sensibility information suitable for the sensibility of the external device in real time on the external device linked content. As a result, the emotion, emotion, atmosphere, etc. intended by the content creator can be reproduced by the operation of the external device that is most suitable for the viewer's sensitivity.

According to the sixth, twelfth or thirteenth aspect of the present invention, the viewing environment of the viewer is linked with the video and / or audio based on the kansei information included in the external device linked content. Since it is possible to operate an external device existing in, the emotion, emotion, atmosphere, etc. intended by the content creator can be expressed by the external device instead. As a result, the viewer can experience the content contents in a simulated manner, and can experience a high sense of realism.

According to the invention described in claim 7, the operation of the external device can be changed based on the contents described in the personal profile, so that the age, sex, nationality, hobbies and preferences of the viewer can be changed. The attribute makes it possible to present the affective information with an external device suitable for the sensitivity of the viewer or its operation. This makes it possible to reproduce the emotions, feelings, moods, etc. intended by the content creator by the most suitable expression method for each viewer.

According to the invention described in claim 8, since the viewing history of the content viewed by the viewer can be accumulated and the operation of the external device can be changed based on the viewing history, the viewer's recent It is possible to present the kansei information by an external device or its operation that reflects the hobbies and tastes of. This makes it possible to reproduce the emotions, feelings, moods, etc. intended by the content creator by an expression method that automatically reflects the hobbies and preferences of the viewer.

According to the ninth aspect of the invention, the operation of the external device can be changed according to the biometric information of the viewer. Therefore, the external device can be automatically operated based on the physical condition and physical condition of the viewer. The amount of movement can be suppressed or promoted. As a result, the emotion, emotion, atmosphere, etc. intended by the content creator can be reproduced by the operation amount of the external device most suitable for the viewer.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of an external device-linked content transmission system of the present invention.

FIG. 2 is a block diagram showing a configuration of an external device-linked content generation device according to an embodiment of the present invention.

FIG. 3 is a block diagram showing a configuration of an external device-linked content reproduction device according to an embodiment of the present invention.

FIG. 4 is a block diagram showing a configuration of sensitivity information converting means of the external device-linked content reproduction device according to the embodiment of the present invention.

FIG. 5 is a block diagram showing a configuration of integrated control means of the external device-linked content reproduction device according to the embodiment of the present invention.

[Fig. 6] Fig. 6 is a schematic diagram schematically showing a reproduction environment of a viewer who reproduces contents linked with an external device.

FIG. 7 is an explanatory diagram for describing an example of converting a physical quantity into sensitivity information.

FIG. 8 is an explanatory diagram for explaining program progress information.

FIG. 9 is a schematic diagram showing an example of an operation of a video scene that progresses according to program progress information and an external device that operates in conjunction with the video scene.

FIG. 10 is a flowchart showing an operation of the external device-linked content generation device.

FIG. 11 is a flowchart showing an operation of the external device-linked content reproduction device.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Content transmission device 10 ... External device linked content generation device 11 ... Kansei information / reproduction time input means (sensibility information input means, reproduction time input means) 12 ... External environment detection means 13 ... Kansei information conversion Means 14 ... Sensitivity information coding means 15 ... Video coding means 16 ... Audio coding means 17 ... Multiplexing means (associating means) 2 ... Content receiving device 20 ... External device interlocking type content reproducing device 21 ... ... Separating means 22 ... Video / audio decoding means 23 ... Time generation means 24 ... Sensitivity information conversion means 24b ... Viewing history storage means 24d ... Personal profile storage means (profile storage means) 25 ... Video / audio presentation Control means 26 ...... Time control means 27 ...... Sensitivity information presentation control means 28 ...... Integrated control means 28 g ...... Biometric information acquisition means 60 ...... Presentation terminal (outside) Equipment) 7 ...... home network

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Koichi Ishikawa             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Seiichi Namba             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Takeshi Kimura             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Kenjiro Kai             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Kyoichi Saito             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Hirokazu Konishi             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Mikihiro Ueno             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Kinji Matsumura             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Kazuhiro Otsuki             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Takashi Tohari             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Eisuke Nakasu             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Atsuro Ichigaya             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Mitsuhiro Yamada             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute (72) Inventor Toshihiro Shimizu             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute F-term (reference) 5C025 DA10                 5C064 BA01 BB03 BC16 BC23 BD03                       BD08 BD09 BD13

Claims (13)

[Claims] 1. The degree of the kansei information by operating an external device controllable by the playback device based on the kansei information indicating the degree of the perception or the sense corresponding to the video / audio content of the video and / or audio. An external device interlocking type content generation device for generating external device interlocking type content to be presented by substituting, wherein the affective information input means for inputting the affective information, the video / audio content, and the affective information, An external device interlocking content generation apparatus, comprising: an associating unit that associates the video / audio content based on a reproduction time. 2. A transmission means for transmitting the external device interlocking content, and a biometric information reception means for receiving biometric information of a viewer including at least one of pulse, blood pressure, and electroencephalogram, the sensitivity information. The external device-interlocked content generation device according to claim 1, wherein the input unit changes the sensitivity information based on the biometric information. 3. A transmission means for transmitting the external device interlocking content, and a change instruction receiving means for receiving a sensitivity information change instruction for changing the sensitivity information, wherein the sensitivity information input means has the sensitivity. The external device-interlocked content generation device according to claim 1, wherein the sensitivity information is changed based on an information change instruction. 4. The degree of the kansei information by operating an external device controllable by the reproduction device based on the kansei information indicating the degree of perception or sensation corresponding to the video / audio content of the video and / or audio. An external device interlocking content generation method for generating external device interlocking content to be presented by substituting for, wherein a kansei information input step of inputting the kansei information, the video / audio content, and the kansei information, An associating step of associating based on the reproduction time of the video / audio content, the external device interlocking type content generating method. 5. The degree of the kansei information by operating an external device controllable by the playback device based on the kansei information indicating the degree of perception or sensation corresponding to the video / audio content of video and / or audio. In order to generate the external device interlocking type content to be presented instead of, a computer, a kansei information input means for inputting the kansei information, the video / audio content, and the kansei information of the video / audio content. An external device interlocking content generation program characterized by causing it to function as an associating means for associating based on a reproduction time. 6. Playback of the video / audio content by inputting video / audio content of video and / or audio, sensitivity information indicating the degree of perception or sense, and reproduction time for reproducing the environment of the sensitivity information. An external device interlocking type content reproduction device for reproducing the environment of the affective information by interlocking an external device with a conversion table in which one or more operations of the external device are associated with the affective information. The conversion table holding means for holding, the video / audio content playing means for playing the video / audio content, and the external device associated by the conversion table holding means based on the sensitivity information and the reproduction time. An external device interlocking type content reproduction device, comprising: an external device operation control means for operating the external device. 7. A profile accumulating means for accumulating a personal profile which is viewer-specific personal information, wherein the external device operation control means is based on the personal profile accumulated in the profile accumulating means,
The external device-linked content reproduction apparatus according to claim 6, wherein the operation of the external device is changed. 8. A viewing history accumulating means for accumulating a viewing history of the video / audio contents viewed by a viewer, wherein the external device operation control means stores the viewing history in the viewing history accumulating means. The external device-linked content reproduction apparatus according to claim 6 or 7, wherein the operation of the external device is changed based on the above. 9. A biometric information acquisition unit for acquiring biometric information of a viewer including at least one of pulse, blood pressure, and electroencephalogram, and the external device operation control unit is acquired by the biometric information acquisition unit. 9. The external device-linked content reproduction apparatus according to claim 6, wherein the operation of the external device is changed based on the biometric information. 10. The apparatus according to claim 9, further comprising: a receiving unit that receives the external device interlocking content, and a biometric information transmitting unit that transmits the biometric information to the external device interlocking content generation device. External device interlocking type content playback device. 11. Receiving means for receiving external device interlocking content, change instruction inputting means for inputting the affective information change instruction for changing the affective information, and external device interlocking content generation for the affective information change instruction. 10. An external device interlocking type content reproducing apparatus according to claim 6, further comprising: a change instruction transmitting unit that transmits the change instruction to the apparatus. 12. The reproduction of the video / audio contents by inputting the video / audio contents of the video and / or audio, the sensitivity information indicating the degree of perception or the sense, and the reproduction time for reproducing the environment of the sensitivity information. An external device-linked content reproduction method for reproducing the environment of the affective information by interlocking an external device with a video / audio content reproducing step of reproducing the video / audio content, the affective information and the reproduction time. An external device operation step of operating the external device associated with the conversion table holding unit that holds a conversion table in which the sensitivity information is associated with the operation of one or more external devices based on A method for reproducing content linked to an external device, comprising: 13. Playback of the video / audio content by inputting video / audio content of video and / or audio, sensitivity information indicating a degree of perception or sense, and reproduction time for reproducing the environment of the sensitivity information. In order to reproduce the environment of the affective information by interlocking an external device with the computer, a computer, a video / audio content reproducing means for reproducing the video / audio content, based on the affective information and the reproduction time, External device operation control means for operating the external device in which the conversion table holding means for holding the conversion table in which the sensitivity information is associated with the operation of one or more external devices is operated. An external device linked content playback program.