WO2010087153A1 - 感覚効果情報のデータ構造、感覚効果情報出力装置、感覚効果情報出力方法、感覚効果情報生成装置、制御装置、システム、プログラムおよび記録媒体 - Google Patents
感覚効果情報のデータ構造、感覚効果情報出力装置、感覚効果情報出力方法、感覚効果情報生成装置、制御装置、システム、プログラムおよび記録媒体 Download PDFInfo
- Publication number
- WO2010087153A1 WO2010087153A1 PCT/JP2010/000436 JP2010000436W WO2010087153A1 WO 2010087153 A1 WO2010087153 A1 WO 2010087153A1 JP 2010000436 W JP2010000436 W JP 2010000436W WO 2010087153 A1 WO2010087153 A1 WO 2010087153A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sensory effect
- information
- reproduction
- effect information
- start time
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
Definitions
- the present invention relates to a data structure of sensory effect information, a sensory effect information output device, a sensory effect information output method, a sensory effect information generation device, a control device, a system, a program, and a recording medium.
- RoSE Representation of Sensitivity Effect
- ISO / IEC JTC1 / SC29 MPEG
- RoSE makes it possible to control indoor lighting, air conditioners, blowers, etc. according to the scene content. For example, you can darken room lighting in the night scene, illuminate the wall around the screen with the sunset color in the sunset scene, vibrate the vibration chair in the earthquake scene, or lower the room temperature in the extremely cold scene become.
- sensory effect information which is information describing sensory effects, is required together with audio and video data that have conventionally existed as AV contents.
- the sensory effect information (Sensory Effect Metadata) of RoSE is described according to a notation method based on XML, as described in the working draft (see Non-Patent Document 1).
- the sensory effect information of RoSE is a kind of XML description, it has a tree structure, and a branch branched from the root represents one sensory effect.
- the lighting effect 1 starts at time 0 and means that the intensity of lighting is set to 60 for 60 seconds.
- lighting effect 2 starts at time 60 and makes the intensity of illumination 40 for 60 seconds.
- Temperature effect 1 starts at time 0 and increases the temperature to 50 for 120 seconds.
- the lighting effect 3 and the air blowing effect 1 are 50 and 20, respectively, but are grouped as an effect group 1 because the start time and the duration time are common.
- the start of effect group 1 is 150 and the duration is 60 seconds.
- FIG. 12 shows the XML tree structure of FIG. 11 expanded on the time axis. Reproduction of lighting effect 1 and temperature effect 1 starts at time 0, lighting effect 1 ends and lighting effect 2 starts after 60 seconds, and lighting effect 2 and temperature effect 1 end simultaneously at 120 seconds. Nothing is played until the second. Subsequently, the effect group 1, that is, the lighting effect 3 and the air blowing effect 1 are regenerated between 150 seconds and 210 seconds.
- the RoSE work draft uses XML Streaming Instruction defined in section 8.6 of MPEG-21-2DIA (Digital Item Adaptation) (see Non-Patent Document 2) as a means for describing the start time.
- BML Broadcast Markup Language
- DSM-CC Digital Storage Media Command and Control
- BML documents, still images and sound effects required for screen layout are used.
- Monomedia is stored and transmitted in one or more components.
- the receiver receives all necessary data and presents the screen.
- the entire component is updated and a new data_event_id is assigned.
- the present invention has been made in view of the above problems, and has as its main object to provide a technique for reproducing a sensory effect at an accurate timing.
- a data structure according to the present invention is a data structure of sensory effect information referred to by a control device in order to control a sensory effect playback device that plays back a sensory effect
- the control device includes: Control start time defining information for defining a control start time for starting control of the sensory effect reproduction device for reproduction of the sensory effect, and a reproduction start time at which the sensory effect reproduction device should start reproduction of the sensory effect.
- the control start time is determined after the sensory effect playback device receives control for playback of the sensory effect rather than the playback start time. It is characterized in that it is set at least before the preparation period required for starting the reproduction.
- the control device can acquire information about both the control start time and the reproduction start time.
- the control device can start the control of the sensory effect reproduction device at least at the control start time according to these pieces of information and reproduce the sensory effect at the reproduction start time.
- the control start time is a preparation period required for the sensory effect playback device to start playback of the sensory effect after the sensory effect playback device receives control for playback of the sensory effect than the playback start time. Since the sensory effect information having the data structure is used, the sensory effect can be reproduced at an accurate timing without causing a reproduction delay due to the preparation period.
- control start time defining information is not particularly limited as long as it defines the control start time.
- the control start time defining information may be information defining a difference between the control start time and the reproduction start time. Those skilled in the art will easily understand that the control start time can be defined even using such information.
- the data structure according to the present invention further includes reproduction state information defining a reproduction state that is a reproduction target of the sensory effect by the sensory effect reproduction device, and the reproduction start time information is stored in the sensory effect reproduction device.
- the playback start time for achieving the playback state is defined, and the control start time is determined after the sensory effect playback device receives control for playback of the sensory effect, rather than the playback start time. It may be set before the preparation period required to achieve the reproduction state.
- the preparation period is a time required for the sensory effect reproduction device to achieve the reproduction state after receiving control for reproducing the sensory effect.
- the data structure according to the present invention includes reproduction period information that defines a reproduction period of the sensory effect by the sensory effect reproduction device, and an end state when the reproduction period has elapsed after the reproduction of the sensory effect has started. And end state information to be defined may be further included.
- the control start time for reproducing the certain sensory effect is set. It is possible to set appropriately referring to the state at the end of the sensory effect reproduced before. For example, when two sensory effects are made in succession, if the state at the end of the previously reproduced sensory effect is the same as the target playback state of the sensory effect, the preparation period However, no time is required for achieving the reproduction state. Thus, since the data structure includes information on the state at the end of the sensory effect, the control start time of the subsequent sensory effect is specified particularly when the sensory effect is continuously present. Information can be set appropriately.
- the sensory effect reproducing device may be one or more devices selected from the group consisting of a lighting device, a blower device, an air conditioner, a scent generating device, a vibration generating device, and a humidity adjusting device. Good.
- the sensory effect reproducing device can successfully reproduce various sensory effects such as illumination (illuminance), wind (wind power), room temperature, scent, vibration, and humidity.
- the information recording medium according to the present invention is characterized in that sensory effect information having the data structure according to the present invention is recorded.
- the sensory effect information output device is characterized by comprising output means for outputting sensory effect information having the data structure according to the present invention.
- the sensory effect information output device can output the data structure according to the present invention, the same effect as the data structure according to the present invention can be achieved.
- the sensory effect information includes reproduction period information that defines a reproduction period of the sensory effect by the sensory effect reproduction device, and the output means determines the control start time defining information from the sensory effect information to be output.
- Sensory effect information in which the control start time defined by is before the output time and the time after the playback period has elapsed after the output time from the playback start time is extracted and output. Also good.
- the extraction is performed with reference to the control start time regulation information.
- Sensory effect information can be appropriately extracted. That is, the sensory effect in which the control start time defined by the control start time defining information is after the output time point is that the control device controls the sensory effect reproduction device to reproduce the sensory effect at the output time point. It is necessary to start, and according to said structure, such a sensory effect can be extracted successfully and output.
- the sensory effect information output method is a sensory effect information output method for outputting sensory effect information to a control device that controls a sensory effect reproduction device that reproduces a sensory effect. And a step of outputting sensory effect information having the data structure according to the above.
- the sensory effect information having the data structure according to the present invention can be output, so that the same effect as the data structure according to the present invention can be achieved.
- the sensory effect information includes reproduction period information that defines a reproduction period of the sensory effect by the sensory effect reproduction device, and the step of outputting the sensory effect information includes the sensory effect information output step.
- the control start time defined by the control start time defining information is before the output time, and after the reproduction period has elapsed from the reproduction start time.
- Sensory effect information whose time is after the output time may be extracted and output to the control device.
- the control device refers to the sensory effect information having the data structure according to the present invention, and performs at least control for causing the sensory effect reproduction device to start reproduction of the sensory effect at the reproduction start time. Control means for starting by the control start time is provided.
- the said control apparatus refers to the sensory effect information which has the data structure which concerns on this invention, and controls the said sensory effect reproduction
- the control device starts control of the sensory effect reproducing device at least by the control start time with reference to the sensory effect information.
- the control start time is a preparation period required for the sensory effect playback device to start playback of the sensory effect after the sensory effect playback device receives control for playback of the sensory effect, rather than the playback start time. Since it is set before, the sensory effect playback device can successfully start playback of the sensory effect at the playback start time.
- the sensory effect reproduction system includes a sensory effect information output device that outputs sensory effect information having a data structure according to the present invention to a control device, and the sensory effect information output from the sensory effect information output device. And the control device for controlling the reproduction of the sensory effect by the sensory effect playback device.
- the sensory effect information having the data structure according to the present invention is output from the sensory effect output device, and the control device refers to the output sensory effect information to control the sensory effect reproduction device. Therefore, the same effect as the data structure according to the present invention can be obtained.
- the sensory effect information generation device is a sensory effect information generation device that generates sensory effect information having the data structure according to the present invention, and is based on the reproduction start time and the preparation period input in advance.
- the control start time is provided with information generating means for generating the control start time defining information so that the control start time is more than the preparation period before the reproduction start time.
- the said sensory effect information generation apparatus is based on the said reproduction start time and the said preparation period which were input previously, and the said control start time is more than the said preparation period before the said reproduction start time.
- the control start time regulation information is generated as described above.
- Such control start time regulation information is suitable for the data structure according to the present invention, and according to the sensory effect information generation apparatus, the sensory effect information having the data structure according to the present invention can be successfully generated. Can do.
- a program for operating the sensory effect information output device, the control device, or the sensory effect information generation device according to the present invention a program for causing a computer to realize the functions of each of the above devices, and a computer reading that records the program Possible recording media are also included in the scope of the present invention.
- the preparation period required from when the sensory effect reproducing device receives control for reproducing the sensory effect to when the sensory effect starts to be reproduced is taken into consideration.
- Control start time defining information for defining the control start time term is included, so if the sensory effect information is used, the sensory effect can be obtained at an accurate timing without causing a reproduction delay due to the preparation period. Can be played.
- FIG. 1 It is a figure which shows schematic structure of the sensory effect transmission / reception system which concerns on one Embodiment of this invention. It is a figure which shows the relationship between the sensory effect information in one Embodiment (structure example 1) of this invention, and the sensory effect reproduced
- the sensory effect refers to a state that can be sensed by human senses, and examples thereof include, but are not limited to, lighting, air blowing, temperature, scent, vibration, humidity, and the like.
- the reproduction of the sensory effect refers to artificially creating the state at a specific timing.
- FIG. 1 is a diagram illustrating an overall configuration of a sensory effect transmission / reception system according to the present embodiment.
- the sensory effect transmission / reception system includes a sensory effect information transmitter (sensory effect information output device) 100, a sensory effect information receiver (control device) 110, and a plurality of sensory effect playback devices (sensory effect playback). Device) 120-150.
- Sensory effect information transmitter 100 is not particularly limited as long as it is a transmitter that transmits sensory effect information.
- a broadcast station that performs public transmission or specific transmission via wireless communication or wired communication (via an Internet line or the like). (Including a server that performs information transmission), or package software is read, and sensory effect information is transmitted (output) to the sensory effect information receiver 110 that is integrated or directly or indirectly connected )
- the sensory effect information receiver 110 receives the sensory effect information transmitted from the sensory effect information transmitter 100, decodes the content thereof, and selects the sensory effect playback device connected directly or indirectly to itself. Control by timing.
- the sensory effect information receiver 110 decodes the sensory effect information received from the sensory effect information transmitter 100 in order to describe the case where the sensory effect information is encoded.
- the sensory effect information is not necessarily encoded.
- the encoding and decoding methods are not particularly limited, and a well-known and commonly used information processing technique can be used.
- Sensory effect reproduction devices 120 to 150 are a group of devices that actually reproduce sensory effects in accordance with control signals sent from the sensory effect information receiver 110.
- the sensory effect reproduction device connected to the sensory effect information receiver 110 in this embodiment includes an illuminator (illuminating device) 120, a blower (blower device) 130, an air conditioner (air conditioner) 140, and a scent generator (scent generator).
- Odor substance releasing device) 150 reproduces the sensory effects of lighting, air blowing, temperature, and scent respectively.
- a vibration chair vibration generator
- a humidity adjuster humidity adjuster
- the like can also be used as the sensory effect reproducing device.
- the sensory effect information receiver 110 stores a device control unit 113 that controls the sensory effect reproducing devices 120 to 150 at an arbitrary timing and a storage unit 115 that stores information used in the control. May be provided.
- the sensory effect information is not limited to this, but for example, similar to the SEM (Sensory Effect Metadata) described in Non-Patent Document 1, the type of sensory effect, the playback value of the sensory effect (playback status), the sensory effect
- This can be an XML document describing information such as the reproduction timing (reproduction start time). However, at the time of transmission, the entire XML document is not always transmitted, and may be divided as necessary as will be described later.
- the data structure of the sensory effect information according to the present embodiment is reproduced by the sensory effect information receiver 110.
- control start time defining information for defining the control timing (control start time) of the devices 120 to 150 is included.
- information defining the control timing is included, and the format is not limited to XML, and may be other structured documents, binary. It may be data.
- the sensory effect set as the sensory effect information 1 includes values of 10, 100, and 70 as the decoding start time (control start time defining information), the playback period (playback period information), and the playback start time (playback start time information), respectively. Is set.
- other attributes such as a specified value (playback state information), an end-time specified value (end-time state information), a fade-in period, and a fade-out period are omitted.
- FIG. 2 is an explanatory diagram illustrating various time attributes of sensory effect information in an example (configuration example 1).
- the playback start time indicates the time at which actual playback by the sensory effect playback devices 120 to 150 is started. From this time, the reproduction of the sensory effect is continued over the period designated as the reproduction period, and at the reproduction end time, the reproduction ends and returns to the initial value.
- the decoding start time indicates a time when the receiver has not received the sensory effect information and decoding has not started before this time, and the reproduction start is not in time. For example, in the case of an air conditioner that reproduces the effect of temperature, a certain preparation period is often required until the actual adjustment of the room temperature is started even when it is in the activated state. Even if you receive it, you cannot start driving immediately.
- the decoding start time is specified to avoid this, and the transmitter needs to send the sensory effect information to the receiver by this time so that the receiver can start decoding.
- the sensory effect reproduction devices 120 to 150 decode and decode the sensory effect information as compared to the preparation period required from the start of the sensory effect reproduction after receiving the control for the sensory effect reproduction.
- the time from processing the sensory effect information to starting the control of the sensory effect playback devices 120 to 150 is very short, and the time from the decoding start time to the playback start time can be substantially equated with the preparation period. That is, the decoding start time may be set at least a preparation period before the reproduction start time.
- the time required for decoding or the like is shorter than the preparation period, and the decoding start time substantially defines the control start time for starting the control of the sensory effect reproducing devices 120 to 150. It can be said that there is.
- the accurate reproduction start at the reproduction start time is achieved by setting the control start time at least a preparation period before the reproduction start time.
- the decoding start time is set before the reproduction start time by a time determined by this level rule.
- each sensory effect playback device has its own characteristics depending on the type of sensory effect.
- the illuminance and the like can be changed to a specified value (also called intensity in RoSE) within a short time after receiving the control signal.
- the effect does not remain when playback is stopped.
- an air conditioner that regenerates the temperature effect
- a scent generator that regenerates the scent effect
- it starts the operation after receiving the control signal, and then the regeneration value (temperature, etc. if it is an air conditioner, odor substance if it is a scent generator) It takes several minutes for the air concentration to reach the specified value included in the control signal. Even after the reproduction with the specified value is completed and the operation is stopped, the effect remains for a while in the actual reproduction environment. For this reason, when describing sensory effect information, a description corresponding to each sensory effect is required.
- these characteristics that is, the period until the reproduction value is achieved and the remaining time of the effect after the reproduction are different depending on the individual sensory effect reproduction apparatus, and are also influenced by the reproduction environment, for example, the indoor situation.
- the operational characteristics of the sensory effect playback device a condition that can be satisfied by most of the assumed sensory effect playback device is specified in advance, and the transmitter side provides sensory effect information that can be played back if the condition is satisfied. send.
- This condition does not need to be a single condition, and there may be a plurality of conditions such as for high-end machines and low-priced versions. Therefore, this condition will be referred to as the level definition of the sensory effect playback device.
- the level regulation for temperature effect regenerators is level A, if the time required to raise the temperature from 25 degrees to 30 degrees is within 5 minutes and the time required for switching between heating and cooling is within 2 minutes, the temperature rise Within 10 minutes and within 4 minutes for switching, level B is specified.
- the sensory effect information transmitter 100 side transmits data for a specific level regulation in consideration of an assumed user layer and the like.
- the user side having the sensory effect information receiver 110 determines for which level the content to be played is created, the indoor environment where the playback device is placed, etc. In consideration, select and install a sensory effect playback device that meets the desired level requirements. As a result, it is possible to provide sensory effect information that can be reproduced in many user environments without making fine adjustments to individual devices.
- the decoding start time of the effect of operating heating or cooling in the sensory effect information is -It is set at least 2 minutes before the regeneration start time in order to cause the air conditioner 140 to switch between cooling units in advance.
- the sensory effect information receiver 110 refers to the sensory effect information and starts decoding two minutes before the playback start time and starts controlling the air conditioner 140. Air conditioning can be operated successfully.
- the preparation period can be set in advance by using the level definition, it is possible to easily set the decoding start time before the reproduction start time.
- the sensory effect information receiver 110 can issue an instruction signal to the sensory effect playback devices 120 to 150 at a sufficiently early time including the time required for preparing the sensory effect playback devices 120 to 150, and start playback. Playback can be started at the time.
- the level information indicating the level definition corresponding to the sensory effect playback devices 120 to 150 is information known to the user who owns the sensory effect playback devices 120 to 150, the user explicitly receives the sensory effect information receiver 110.
- the level information may be input to the sensory effect reproducing device 120-150, or when the sensory effect reproducing device 120-150 is connected to the sensory effect information receiver 110, the level information is automatically converted into the sensory effect reproducing device 120-150. May be configured to be notified to the sensory effect information receiver 110.
- the sensory effect reproducing devices 120 to 150 connected to the sensory effect information receiver 110 transmit level information indicating the level to which the sensory effect playback devices 120 to 150 are connected to the sensory effect information receiver 110 connected to the sensory effect information receiver 110,
- the information receiver 110 receives this, the main control unit 111 stores the level information in the storage unit 115, and the device control unit 113 uses the level information stored in the storage unit 115 during reproduction. It can also be configured.
- DTS Decoding
- MPEG-2 Systems ISO / IEC 13818-1
- MPEG-4 Systems ISO / IEC 14496-1
- Time Stamp PTS (Presentation Time Stamp)
- CTS Composition Time Stamp
- configuration example 2 In another example (configuration example 2), in the preparation period, in addition to the preparation period of the sensory effect reproduction devices 120 to 150, the state indicated by the specified value (the reproduction state as a reproduction target) is changed to the sensory effect reproduction device 120. It is also possible to include a period until ⁇ 150 is achieved. Even when the sensory effect information is designated as shown in FIG. 2, for example, in the case of the air conditioner 140, it is impossible to change the temperature from the initial value to the designated value suddenly at the reproduction start time. In order to reach the specified temperature at the regeneration start time, it is necessary to operate the air conditioner before the regeneration start time. In this case, the actual temperature change draws a curve as shown in FIG.
- the preparation period may include a set period for the specified value as a period required to change the reproduction value to the specified value.
- the idea of the device level rule is applied as well as the device preparation period, and decoding is started before the playback start time for the time required for the temperature change specified in the level rule.
- the time can be set.
- the temperature in the sensory effect information is 25 degrees (normal room temperature) to 30 degrees (this The decoding start time of the effect to be increased to the specified value) is set at least 7 minutes before the reproduction start time.
- the sensory effect information receiver 110 refers to the sensory effect information and starts the decoding and starts controlling the air conditioner 7 minutes before the reproduction start time, so that the air conditioner 140 is heated in two minutes. -By switching between cooling and raising the room temperature to 30 degrees in 5 minutes, the above specified value of sensory effect can be successfully achieved at the playback start time.
- the sensory effect information receiver 110 that has received the sensory effect information takes into account the capabilities of the sensory effect playback devices 120 to 150 connected to itself and sets the time at which the sensory effect playback devices 120 to 150 are actually instructed. You may decide. For example, in the case of a temperature sensory effect, the sensory effect information receiver 110 uses the equipment preparation period required to start operation from the initial state as the capability of the connected air conditioner 140 and the room temperature from the current room temperature to the specified temperature. Is calculated based on the capability information of the sensory effect playback device that has been input in advance or obtained through communication with each sensory effect playback device, etc., and the playback start time An instruction signal is issued before that time (control is started). Thereby, the temperature change as shown in FIG. 3 is reproduced.
- the capability information of the sensory effect playback device may be specified by the installer when the sensory effect playback device is connected, or information is automatically exchanged between the sensory effect playback device and the sensory effect information receiver. May be. Also, if the connected sensory effect playback device has a rapid temperature adjustment function that exceeds the level specification, it will not issue an instruction immediately even if decoding is performed at the decoding start time, By giving an instruction to, it is possible to perform sensory effect reproduction according to the intention of the content creator.
- FIG. 4 is a diagram illustrating optional time attributes of sensory effect information in an example (configuration example 3). The description of the same components as in FIG. 1 is omitted.
- the fade-in period is optional, but if it is specified, it indicates that the playback value is gradually changed from the initial value to the specified value using that period.
- the fade-out period is also optional, and if specified, indicates that the playback value is gradually changed from the specified value to the initial value using that period.
- FIG. 5 is an explanatory diagram showing another optional time attribute of the sensory effect information. Description of the same components as those in FIG. 1 or FIG. 4 is omitted.
- the designated value at the end is information that defines the state at the end when the reproduction period has elapsed after the reproduction of the sensory effect has started.
- FIG. 6 shows a description example of sensory effect information described using the above time attributes.
- FIG. 6 describes the two consecutive sensory effects shown in FIG. 5.
- the description of effect 1 includes a fade-in period and a fade-out period, and the same value as the specified value of effect 2 is set as the end specified value. It is specified. Further, since the reproduction end time of effect 1, that is, the sum of the reproduction start time and the reproduction period, coincides with the reproduction start time of effect 2, as a result, as shown in FIG. Is changed.
- the reproduction value may instantaneously become zero at the time when effect 1 ends and effect 2 starts.
- the sensory effect information receiver 110 controls the sensory effect reproducing devices 120 to 150 so that the effect 1 and the effect 2 are continuously and smoothly connected and do not instantaneously become an inappropriate value such as 0. Reproduce.
- the preparation period of effect 2 can be set in consideration of the above-mentioned designated value at the end of effect 1. That is, for the effect 2, when the fade-in is not performed, the time to be included in the preparation period is not the time from the initial value to the specified value, but the time from the end specified value to the specified value. can do. For example, in the case shown in FIG. 5, since there is usually no fade-in designation in effect 2, the preparation period includes the time from the initial value until the designated value is achieved. If the specified value at the end of effect 1 is taken into consideration, the time from the specified value at the end of effect 1 to the specified value of effect 2 is zero. It is only necessary to include the time until the operation.
- the time required for operating the sensory effect playback device is necessary because the sensory effect playback device may not be operating during the fade-out process.
- the sensory effect information includes the end-time designated value, the preparation period and the decoding start time can be calculated more appropriately.
- the sensory effect information receiver 110 controls the sensory effect reproduction devices 120 to 150 as in the fourth configuration example.
- a resend request is made if possible. It is possible to take a more appropriate action according to the situation, such as determining that reproduction is impossible and canceling reproduction of effect 2 itself.
- the reproduction start time and the preparation period define the decoding start time or the control start time. That is, the control start time regulation information included in the sensory effect information may be information indicating a difference between the reproduction start time and the control start time.
- the device control unit 113 of the sensory effect information receiver 110 can calculate the control start time from information indicating the playback start time and information indicating the difference between the playback start time and the control start time, and based on the control start time. Thus, control of the sensory effect reproducing devices 120 to 150 can be started.
- the control disclosure time is defined using the decoding start time information in consideration of the preparation period of the sensory effect playback device, the required time to reach the specified value, etc. Yes.
- the reproduction start time information and the control start time regulation information are described for each sensory effect, it is easy to understand what each information indicates, but the same sensory effect appears many times. There is also an aspect that sensory effect information becomes redundant.
- a method for substituting the description of the decoding disclosure time by describing the level definition of the sensory effect device in the interval effect information will be described.
- the decoding start time of sensory effect 1 shown in FIG. 13 is also a value that complies with a specific level rule.
- the name of the level definition is level A
- the sensory effect type of sensory effect 1 is temperature.
- Level A in this case defines 60 seconds as the maximum preparation time of the temperature sensory effect playback device, and for this reason, the decoding start time in FIG. 13 is set 60 seconds before the playback start time.
- level A is determined as a standard, details can be obtained in advance on the receiving side as well as on the transmitting side. That is, in the sensory effect information transmitter 100 and the sensory effect information receiver 110, the meaning can be interpreted equally. For this reason, all or a part of the sensory effect information to be transmitted is transmitted from the sensory effect information transmitter 100 to the sensory effect information receiver 110 instead of transmitting information defining the decoding start time for each sensory effect. Even when information indicating the level definition of the standard to which all or part of the sensory effect information conforms (for example, information indicating that “the following descriptions are all conforming to Level A”) is transmitted.
- the sensory effect information receiver 110 obtains the difference between the reproduction start time and the control start time based on the received information indicating the level specification, calculates the control start time, and reproduces the sensory effect at an appropriate timing. Control of the devices 120-150 can be started.
- FIG. 18 is an example in which the same contents as the sensory effect information shown in FIG. 13 are described by the method of this configuration example.
- the sensory effect information receiver 110 calculates the decoding start time from the sensory effect information shown in FIG. According to the definition of level A, since the maximum preparation time is specified as 60 seconds for the temperature sensory effect playback device, 10 obtained by subtracting 60 from the playback start time is 10 as the decoding start time.
- FIG. 20 is an example in which the sensory effect information in FIG. 5 is described with a structure different from that in FIG.
- the sensory effect information in this configuration example does not include information indicating the end-time designated value, information indicating the fade-in period, and information indicating the fade-out period. Instead, fade period defining information (attribute) indicating a fade period is added.
- the sensory effect 1 is 20 to 120 seconds and the sensory effect 2 is 120 to 180 seconds.
- this separation is changed.
- the sensory effect 1 is 20 to 100 seconds, and the sensory effect 2 is 100 to 180 seconds.
- fade-in and fade-out are collectively treated as fade, and the value is changed from the initial value to the specified value at the specified time, that is, defined as the effect of fade-in.
- Fade-out is treated as a fade-in of subsequent effects. When fading out toward the specified value 0, it is described as a fade-in to the sensory effect of the specified value 0.
- the sensory effect information receiver 110 performs the following operation when sensory effect information having a structure as shown in FIG. 20 is received. First, the sensory effect information is decoded at the time indicated by the decoding start time, and the control of the sensory effect reproducing devices 120 to 150 is started. In this control, the sensory effect information receiver 110 controls the sensory effect playback devices 120 to 150 so as to achieve the state indicated by the designated value over a fade period from the playback start time.
- the sensory effect information receiver 110 starts decoding the sensory effect information related to the effect 1 at the decoding start time 10 seconds specified in the effect 1 and changes the effect 1 from the reproduction start time 20 seconds specified in the effect 1.
- the sensory effect reproducing devices 120 to 150 are controlled so as to achieve the state specified by the specified value (60) over a specified fade period of 20 seconds. Then, the sensory effect information receiver 110 maintains the state specified by the specified value from the end time specified in effect 1 (from the reproduction start time 20 seconds to 120 seconds after the reproduction period 100 seconds).
- the sensory effect information receiver 110 starts decoding the sensory effect information related to the effect 2 at the decoding start time 90 seconds specified for the effect 2, and the reproduction start time 100 specified for the effect 2
- the sensory effect reproducing devices 120 to 150 are controlled so as to achieve the state specified by the specified value (40) by taking the specified fade period 20 seconds from the second to the effect 2.
- the sensory effect information receiver 110 maintains the state specified by the specified value from the end time specified in effect 2 (from the reproduction start time 100 seconds to 180 seconds after the reproduction period 80 seconds). Thereby, the sensory effect shown in FIG. 5 can be reproduced.
- the fade period in this configuration example is defined as a period for changing from the initial value to the specified value at the start of the sensory effect, but in other embodiments, the fade period is changed from the specified value at the end of the sensory effect. You may define as the period which changes to a subsequent value, ie, the effect of fade-out. Even in such a configuration, the effect of simplifying the grammar can be obtained.
- the subsequent value mentioned here is the specified value of the sensory effect that is adjacent in time.
- the sensory effect information in FIG. 5 describes, as sensory effect 1, a playback start time of 20 seconds, a playback period of 20 seconds, a fade period of 20 seconds, and a specified value of 0, and as a sensory effect 2, playback start time. 40 seconds, a playback period of 80 seconds, a fade period of 20 seconds, and a specified value 60 are described. Further, as a sensory effect 3, a playback start time of 120 seconds, a playback period of 60 seconds, and a specified value of 40 are described.
- the sensory effect information receiver 110 controls the sensory effect reproducing devices 120 to 150 to reproduce the sensory effect shown in FIG.
- configuration example 7 has a grammar simplification compared to the notation of configuration example 4, but has the disadvantage of lower readability. For example, it is one sensory effect at first glance as shown in FIG. 4, and even a case described as one sensory effect in the RoSE work draft must be described as two sensory effects.
- the fade-in is defined as the effect of changing the fade-in period from the initial value to the specified value
- the fade-out is defined as the effect of changing the fade-out from the specified value to zero over the fade-out period.
- a fade period that becomes a value other than zero after the end of the fade is treated as a fade-in period of the subsequent sensory effect, and only one that becomes zero after the fade is finished is treated as a fade-out period of the immediately preceding sensory effect.
- the sensory effect of FIG. 4 can be described as one sensory effect.
- the description of the sensory effect in FIG. 5 is the same as that in FIG. 20 which is a description example in the configuration example 7, except that the fade-in period is used instead of the fade period.
- both the fade-in period and the fade-out period are necessary, and the grammatical aspect is more complicated than the description method of the configuration example 7.
- the description amount may be simplified. Is effective.
- the sensory effect information is described in the sensory effect information described in the information XML that defines the preparation time of the sensory effect reproducing devices 120 to 150.
- the description method is not limited to this.
- the sensory effect information described in XML is transmitted for broadcasting use, it is conceivable to store and transmit it in MPEG-2TS, but this is used because there is a part that describes the decoding start time in MPEG-2TS. It is also possible to do.
- the sensory effect information transmitter 100 divides sensory effect information described in XML into elements of each sensory effect and stores them in an MPEG-2TS PES packet.
- the decoding start time is described here and transmitted to the sensory effect information receiver 110. This eliminates the need to describe the decoding start time in the XML description.
- the sensory effect information receiver 110 extracts the DTS from the received MPEG-2TS, acquires the decoding start time, starts decoding the sensory effect information described in the PES packet at the decoding start time, Control of the sensory effect reproducing devices 120 to 150 based on the sensory effect information is started.
- the sensory effect information having the data structure according to the present embodiment is not only transmitted / received or referred to for control of the sensory effect reproducing device, but also recorded on a recording medium (information recording medium).
- the sensory effect information is recorded on a recording medium, so that it can be stored and carried.
- Examples of the medium used for recording include portable recording media such as CD, DVD, and Blu-ray (registered trademark), and fixed recording media such as a hard disk, but are not particularly limited.
- the method for transmitting and receiving sensory effect information is not particularly limited as long as it includes a step of outputting sensory effect information (preferably sensory effect information according to the present invention).
- sensory effect information preferably sensory effect information according to the present invention.
- BML Non-Patent Document 3
- the data carousel method of DSM-CC which is also used in the reference
- the sensory effect information needs to be repeatedly transmitted from the decoding start time to the reproduction end time.
- the sensory effect information according to the present invention it is wasteful to transmit all the data as shown in FIG. 7 together in a DSM-CC data carousel. In this example, the number of sensory effects is small for the sake of simplicity of explanation.
- the number of sensory effect elements is usually several hundreds. If this is put on the data carousel as it is, the amount of data allocated will be reduced due to the large amount of data, or the time required for the data carousel to go round will be increased due to the narrowing of the bandwidth, and random accessibility will be increased. Either one of them will drop.
- the XML text describing the sensory effect information has some important characteristics not found in other XML texts. Therefore, when the conventional transmission method is used as it is for the transmission of the sensory effect information, the following is given. Various inconveniences occur.
- the playback start time and the playback duration time are attached to each branch as time information, and there is a problem that the sensory effect that started playback lasts longer than the sensory effect that started playback later. .
- the branch of the lighting effect 2 starts at the time 60, but the temperature effect 1 is still continuing at this time, and simply the temperature effect 1 and the lighting effect. If the XML sentence is divided between 2 and only the lighting effect 2 is transmitted after the time 60, the temperature effect 1 is not reproduced correctly.
- the sensory effect information transmitter 100 may divide and transmit sensory effect information.
- the minimum sensory effect information required at the current time is sensory effect information in which the lifetime of sensory effect information extends over the current time, that is, the decoding start time is before the current time (output time), and playback ends It is sensory effect information whose time is after the current time. Note that this division can be achieved because the sensory effect information has the data structure according to the present embodiment in consideration of the preparation period of the sensory effect reproducing device.
- the illumination information 1 and the temperature information 1 are in the period 71, the illumination information 1, the temperature information 1, and the air blow information 1 are in the period 72, and the illumination information 1 and the temperature information 1 are in the period 73.
- the blast information 1 and the illumination information 2 are the temperature information 1, the blast information 1, the illumination information 2 and the scent information 1 in the period 74, and the temperature information 1, the illumination information 2 and the scent information 1 are in the period 75, In the period 77, the illumination information 3 and the air blowing information 2 are transmitted. There is no sensory effect information transmitted in the period 76.
- FIG. 8 shows a summary of this division method.
- the sensory effect information receiver 110 that has received the sensory effect information divided by the division method shown in FIG. 8 receives all the data being transmitted by the data carousel and reproduces the specified sensory effect. 120 to 150 are controlled.
- the broadcast is received from the middle, for example, during the period 75, since the illumination information 2, the temperature information 1, and the scent information 1 are valid, the corresponding effects are reproduced.
- the corresponding effects are reproduced.
- FIG. 15 is a block diagram showing a schematic configuration of the sensory effect information transmitter 100 according to the present embodiment.
- the sensory effect information transmitter 100 includes a main control unit (output unit) 101, a storage unit 104, and a transmission unit 105.
- the storage unit 104 stores sensory effect information to be transmitted.
- the main control unit 101 includes an extraction unit 102 and a transmission control unit 103. Based on the sensory effect information stored in the storage unit 104, the extraction unit 102 has a decoding start time before the current time and a playback end time (a time after the playback period has elapsed from the playback start time) after the current time. Sensory effect information is extracted and output to the transmission control unit 103.
- the transmission control unit 103 performs necessary processing such as encoding on the sensory effect information input from the extraction unit 102, and then transmits the sensory effect information to the sensory effect information receiver 110 via the transmission unit 105.
- FIG. 16 is a block diagram illustrating a schematic configuration of the sensory effect information receiver 110 according to the present embodiment.
- the sensory effect information receiver 110 includes a main control unit (control unit) 111, a reception unit 114, and a storage unit 115.
- the main control unit 111 includes a reception control unit 112 and a device control unit 113.
- the sensory effect information received by the receiving unit 114 is decoded by the reception control unit 112 at the decoding start time of the sensory effect information and passed to the device control unit 113.
- the reception control unit 112 may perform the decoding process at the time of reception and pass the sensory effect information to the device control unit 113 at the decoding start time.
- the device control unit 113 controls the sensory effect reproduction devices 120 to 150 according to the passed sensory effect information.
- the control start timing may be substantially the same as the timing when the sensory effect information is passed or the decoding start time, or may be stored in advance in the storage unit 115. The timing may be adjusted based on the individual capability information of the effect playback devices 120-150.
- the sensory effect information required at a certain time is extracted and transmitted.
- the entire sensory effect information is subtrees that are independent and do not overlap each other. It may be desirable to store the data separately as In the division method 1 described above, for example, the illumination information 1 is included in both the period 71 and the period 72, and there is an overlap.
- a method of dividing at a divisible point that includes all necessary information and does not overlap each other so that each can be reproduced independently will be shown as a division method 2. Since the system configuration is the same as that of the first embodiment, a description thereof will be omitted.
- FIG. 9 is a diagram showing the lifetime of sensory effect information for explaining the division method 2. Since there is no sensory effect information that takes a lifetime during the period shown in the period 92, it is possible to divide all sensory effect information in this respect. That is, as the sensory effect information of the period 91, the illumination information 1, the illumination information 2, the air blowing information 1, the temperature information 1, and the scent information 1 are collected, there is no sensory effect information corresponding to the period 92, and the sensory effect corresponding to the period 93. Illumination information 3 and air blowing information 2 are collected as information.
- the temperature information 1 has dependency on the illumination information 1 and the illumination information 2, and it is shown that it is not preferable to divide these.
- the blast information 1 is also dependent on the illumination information 1 and the illumination information 2
- the illumination information 2 is dependent on the illumination information 1
- the scent information 1 is dependent on the blast information 1.
- the air blowing information 2 is dependent on the lighting information 3. Since it is preferable to transmit what has dependence as one body, the part which can be divided in this example is between the fragrance information 1 and the effect group 1.
- the dependency” described here means that one effect is exhibited as a whole or only when a specific effect is present.
- the scent information 1 depends on the blast information 1, but this is for the purpose of spreading the scent information 1 on the blast information 1, and if the blast information 1 cannot be reproduced for some reason, the scent information The reproduction of 1 is also specified because it does not make sense.
- the illumination information 2 depends on the illumination information 1. This is a continuous effect that the illumination information 2 continues from the illumination information 1. If the illumination information 2 is reproduced without the illumination information 1, it is originally intended. It is specified to deviate from the effect. For this reason, it is desirable that they are handled as a unit even when divided.
- the sensory effect information group composed of a plurality of sensory effect information
- the sensory effect information group is set to be before the specific timing.
- the division may be performed, for example, by the sensory effect information transmitter 100 at the time of transmission, or by a computer on which authoring software or the like is executed.
- the present invention also provides a sensory effect generation device that generates sensory effect information as described above.
- the sensory effect generation device includes an input unit that receives in advance an input other than a decoding start time (control start time) among information constituting a preparation period and sensory effect information, and a preparation period and a reproduction of the inputs received by the input unit.
- a decoding start time is calculated based on the start time, and an information generation unit (information generation means) that generates sensory effect information according to the present invention from information input in advance and the calculated decoding start time. is there.
- the sensory effect generation device according to the present invention has the above functions realized by, for example, a general business computer or personal computer.
- the information generation unit For the input such as the preparation period, a well-known and commonly used technique such as input via a keyboard or a GUI can be used.
- the information generation unit most simply, sets the decoding start time before the preparation period from the reproduction start time. Further, instead of inputting the preparation period, the above-described level setting may be input, and the information generation unit may specify the preparation period with reference to a table stored in advance in the sensory effect generation apparatus. For example, as a sensory effect, when a reproduction start time of 70 seconds, a preparation period of 60 seconds, and a reproduction period of 100 seconds are input, the information generation unit uses 10 seconds before the preparation period from the reproduction start time as a decoding start time, As shown in FIG.
- sensory effect information including a decoding start time of 10 seconds, a playback start time of 70 seconds, and a playback period of 100 seconds is generated. Further, when level A is input as the level setting described above, the reproduction start time is 10 minutes, and the sensory effect content is an effect that the temperature is set to 30 degrees, the information generation unit performs the effect at level A.
- the sensory effect information including the decoding start time 3 minutes, the reproduction start time 10 minutes, and the specified value 30 degrees is generated using 3 minutes obtained by subtracting 7 minutes, which is the preparation period, from the playback start time.
- the sensory effect generation device may further include a dividing unit that divides the generated sensory effect information in the same manner as the division method 2 described above.
- the main control unit 101 of the sensory effect information transmitter 100, the main control unit 111 of the sensory effect information receiver 110, and the information generation unit of the sensory effect information generation device may be configured by hardware logic. Alternatively, it may be realized by software using a CPU (Central Processing Unit) as follows.
- CPU Central Processing Unit
- the main control units 101 and 111 and the information generation unit include a CPU such as an MPU that executes instructions of a program that realizes each function, a ROM (Read Memory) that stores the program, and a format that can execute the program. And a storage device (recording medium) such as a memory for storing the program and various data.
- the object of the present invention is not limited to the case where the main control units 101 and 111 and the program memory of the information generation unit are fixedly supported, but the program code of the program (execution format program, intermediate code program, or , A source program) is supplied to the sensory effect information transmitter 100, the sensory effect information receiver 110, and the sensory effect information generator, and the sensory effect information transmitter 100, the sensory effect information receiver 110, and the sensory effect information generator.
- the effect information generating device reading and executing the program code recorded on the recording medium.
- the recording medium is not limited to a specific structure or type. That is, the recording medium includes, for example, a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. System, a card system such as an IC card (including a memory card) / optical card, or a semiconductor memory system such as a mask ROM / EPROM / EEPROM / flash ROM.
- a tape system such as a magnetic tape and a cassette tape
- a magnetic disk such as a floppy (registered trademark) disk / hard disk
- an optical disk such as a CD-ROM / MO / MD / DVD / CD-R.
- a card system such as an IC card (including a memory card) / optical card, or a semiconductor memory system such as a mask ROM / EPROM /
- the present invention is also applicable. Can achieve the purpose.
- the program code is supplied to the main control units 101 and 111 and the information generation unit via a communication network.
- the communication network only needs to be able to supply program codes to the main control units 101 and 111 and the information generation unit, and is not limited to a specific type or form.
- the Internet intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network (Virtual Private Network), telephone line network, mobile communication network, satellite communication network, etc. may be used.
- the transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type.
- wired lines such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL (Asymmetric Digital Subscriber Line) line, infrared such as IrDA or remote control, Bluetooth (registered trademark), 802.11 wireless, HDR, NFC It can also be used by radio such as DLNA, mobile phone network, satellite line, and digital terrestrial network.
- the present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.
- the present invention can be used in a system for transmitting and receiving sensory effects, in particular, in a broadcasting system that realizes highly realistic reproduction using sensory effects and a content distribution system using optical disks.
- Sensory effect information transmitter (sensory effect information output device) 110 Sensory effect information receiver (control device) 120-150 Sensory effect playback device (sensory effect playback device)
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
Description
図1は、本実施形態に係る感覚効果送受信システムの全体構成を示す図である。図1に示すように、上記感覚効果送受信システムは、感覚効果情報送信機(感覚効果情報出力装置)100、感覚効果情報受信機(制御装置)110、および複数の感覚効果再生機器(感覚効果再生装置)120~150から構成される。
感覚効果情報は、これに限定するものではないが、例えば、非特許文献1に記載のSEM(Sensory Effect Metadata)と同様に、感覚効果の種別、感覚効果の再生値(再生状況)、感覚効果の再生タイミング(再生開始時刻)などの情報を記述したXML文書とすることができる。ただし、送信時には、当該XML文書の全体が常時送信されるとは限らず、後述するように必要に応じて分割される場合がある。本実施形態に係る感覚効果情報のデータ構造と、上記SEMのデータ構造との差異としては、まず、本実施形態に係る感覚効果情報のデータ構造には、感覚効果情報受信機110による感覚効果再生機器120~150の制御タイミング(制御開始時刻)を規定する情報(制御開始時刻規定情報)が含まれている点がある。言い換えれば、本実施形態に係るデータ構造で重要なのは、制御タイミングを規定する情報が含まれていることであり、その形式はXMLに限定されず、その他の構造化文書であってもよく、バイナリデータであってもよい。
図2は、一例(構成例1)において、感覚効果情報が持つ各種の時間属性を示す説明図である。
他の例(構成例2)において、準備期間には、感覚効果再生機器120~150の準備期間の他に、指定値により示される状態(再生の目標となる再生状態)を感覚効果再生機器120~150が達成するまでの期間を含めることも可能である。感覚効果情報が図2のように指定されていた場合でも、例えば、エアコン140の場合は再生開始時刻にいきなり初期値から指定値まで温度を変化させることは不可能である。再生開始時刻に指定温度にするためには、再生開始時刻以前にエアコンを稼動させておく必要がある。この場合、実際の温度変化は図3のような曲線を描く。そこで、準備期間には機器の準備期間に加えて、再生値を指定値まで変化させるのに要する期間として指定値への設定期間を含ませてもよい。これにより、感覚効果情報受信機110は、感覚効果再生機器が指定値を再生するのに要する時間(再生状態を達成するために必要な時間)を含めて十分に早い時点で感覚効果再生機器に指示を出すことができ、再生開始時刻に指定された値で再生することが出来る。
図4は、一例(構成例3)における感覚効果情報が持つオプションの時間属性を示した図である。図1と同じ構成要素の説明は省略する。
図5は、感覚効果情報が持つ別のオプションの時間属性を示した説明図である。図1または図4と同じ構成要素の説明は省略する。
なお、構成例1および2では、図13に示すように、感覚効果情報に、再生開始時刻と、復号開始時刻とを記述する形式としたが、感覚効果情報に、再生開始時刻と、準備期間とを記述する形式でも全く同様の効果を上げることができる。この場合の感覚効果情報を図14に示す。ここでは準備期間として60が指定され、図13の感覚効果情報と同じ効果を表している。すなわち、図14に示される感覚効果情報の場合には、再生開始時刻(70)から準備期間(60)を引いて復号開始時刻(10)を算出して、上述した実施形態と同様に処理することができる。言い換えれば、図14に示される感覚効果情報の場合には、再生開始時刻と準備期間とが、復号開始時刻または制御開始時刻を規定していることを当業者は容易に理解する。すなわち、感覚効果情報に含まれる制御開始時刻規定情報は、再生開始時刻と制御開始時刻との差分を示す情報であってもよい。感覚効果情報受信機110の機器制御部113は、再生開始時刻を示す情報および再生開始時刻と制御開始時刻との差分を示す情報から制御開始時刻を算出することができ、当該制御開始時刻に基づいて、感覚効果再生機器120~150の制御を開始することができる。
また、構成例1および2では、感覚効果情報のそれぞれについて、復号開始時刻情報を用いて、感覚効果再生機器の準備期間、指定値までの到達所要時間等を考慮した制御開示時刻を規定している。このような構成では、再生開始時刻情報および制御開始時刻規定情報が感覚効果ごとに記載されているため、それぞれの情報が何を示しているかがわかり易い反面、同様の感覚効果が何度も現れる場合は、感覚効果情報が冗長になるという側面もある。本構成例では、間隔効果情報に感覚効果機器のレベル規定を記述することにより、復号開示時刻の記述を代替する方法を説明する。
構成例4では、図5の感覚効果情報を記載するのに図6に示すような構造を有するXML記述を使用するが、本構成例では、これに代わる記述方法を例示する。
フェード効果を有する感覚効果の記述方法として構成例4および構成例7を例示したが、本構成例ではこれらに変わる記述方法を例示する。
なお、以上の構成例では、感覚効果再生機器120~150の準備時間を規定する情報XMLで記述した感覚効果情報の中に記述していた。しかし記述方法はこれに限られるわけではない。XMLで記述した感覚効果情報を放送用途で送出する場合、MPEG-2TSに格納して送出することが考えられるが、MPEG-2TSの中に復号開始時刻を記載する部分があるため、これを利用することも可能である。
次に、本発明に係る感覚効果情報の送信方法(感覚効果情報出力方法)について説明する。本実施例で送信機から送信される感覚効果情報の具体例を、図7に示す。ここでは、感覚効果情報の生存期間だけに着目し、各感覚効果を時間軸上に展開した形で示した。なお、復号開始時刻から再生終了時刻までを感覚効果情報の生存期間と呼ぶことにする。
そこで、本実施形態に係る感覚効果情報送信機100は、感覚効果情報を分割して送信するものであってもよい。
上記の分割方法1では、ある時点で必要となる感覚効果情報を抽出して送信する方法であったが、光ディスクなどのパッケージメディアでは、感覚効果情報全体を各々が独立して重複も無い部分木として分割して格納したほうが望ましい場合がある。上記の分割方法1では、例えば期間71にも期間72にも照明情報1が含まれており、重複がある。
本発明は、また、上述したような感覚効果情報を生成する感覚効果生成装置を提供する。上記感覚効果生成装置は、準備期間および感覚効果情報を構成する情報のうち復号開始時刻(制御開始時刻)以外の入力を予め受け付ける入力部と、入力部が受け付けた入力のうち、準備期間および再生開始時刻に基づいて、復号開始時刻を算出して、予め入力された情報と、算出した復号開始時刻から、本発明に係る感覚効果情報を生成する情報生成部(情報生成手段)を有するものである。本発明に係る感覚効果生成装置は、例えば、一般的な業務用コンピュータまたはパーソナルコンピュータによって、上記機能が実現されるものである。準備期間等の入力は、キーボードまたはGUIを介した入力等の周知慣用の技術を用いることができる。上記情報生成部は、復号開始時刻を、最も単純には、再生開始時刻から準備期間前に設定する。また、準備期間の入力の代わりに、上述したレベル設定を入力させ、上記情報生成部は、感覚効果生成装置が内部に予め記憶しているテーブルを参照して準備期間を特定してもよい。例えば、感覚効果として、再生開始時刻70秒、準備期間60秒、再生期間100秒が入力されたときには、上記情報生成部は、再生開始時刻から準備期間前の10秒を復号開始時刻として用い、図13に示すような、復号開始時刻10秒、再生開始時刻70秒、再生期間100秒を含む感覚効果情報を生成する。また、上述したレベル設定としてレベルAが入力されており、再生開始時刻が10分、感覚効果内容が、温度を30度にするという効果である場合、上記情報生成部は、レベルAにおける当該効果の準備期間である7分を再生開始時刻から引いた3分を復号開始時刻として用い、復号開始時刻3分、再生開始時刻10分、指定値30度を含む感覚効果情報を生成する。
感覚効果情報送信機100の主制御部101、感覚効果情報受信機110の主制御部111、感覚効果情報生成装置の情報生成部は、ハードウェアロジックによって構成すればよい。または、次のように、CPU(Central Processing Unit)を用いてソフトウェアによって実現してもよい。
110 感覚効果情報受信機(制御装置)
120~150 感覚効果再生機器(感覚効果再生装置)
Claims (18)
- 感覚効果を再生する感覚効果再生装置を制御するために、制御装置が参照する感覚効果情報のデータ構造であって、
上記制御装置が、上記感覚効果の再生のための上記感覚効果再生装置の制御を開始する制御開始時刻を規定する制御開始時刻規定情報と、
上記感覚効果再生装置が上記感覚効果の再生を開始すべき再生開始時刻を規定する再生開始時刻情報と、を含んでおり、
上記制御開始時刻は、上記再生開始時刻よりも、上記感覚効果再生装置が、上記感覚効果の再生のための制御を受けてから、上記感覚効果の再生を開始するまでに要する準備期間以上前に設定されていることを特徴とするデータ構造。 - 上記データ構造は、上記感覚効果再生装置による上記感覚効果の再生の目標となる再生状態を規定する再生状態情報をさらに含んでおり、
上記再生開始時刻情報は、上記感覚効果再生装置が上記再生状態を達成する再生開始時刻を規定するものであり、
上記制御開始時刻は、上記再生開始時刻よりも、上記感覚効果再生装置が、上記感覚効果の再生のための制御を受けてから、上記再生状態を達成するまでに要する準備期間以上前に設定されていることを特徴とする請求項1に記載のデータ構造。 - 上記感覚効果再生装置による上記感覚効果の再生期間を規定する再生期間情報と、
上記感覚効果の再生が開始してから上記再生期間が経過した時の終了時状態を規定する終了時状態情報と、をさらに含んでいることを特徴とする請求項1または2に記載のデータ構造。 - 上記感覚効果再生装置が、照明装置、送風装置、空調装置、香り発生装置、振動発生装置および湿度調整装置からなる群より選ばれる1つ以上の装置であることを特徴とする請求項1から3のいずれか1項に記載のデータ構造。
- 請求項1から4のいずれか1項に記載のデータ構造を有する感覚効果情報が記録されていることを特徴とする情報記録媒体。
- 請求項1から4のいずれか1項に記載のデータ構造を有する感覚効果情報を出力する出力手段を備えていることを特徴とする感覚効果情報出力装置。
- 上記感覚効果情報は、上記感覚効果再生装置による上記感覚効果の再生期間を規定する再生期間情報を含むものであり、
上記出力手段は、出力すべき上記感覚効果情報から、上記制御開始時刻規定情報によって規定される制御開始時刻が出力の時刻以前であり、かつ、上記再生開始時刻から上記再生期間を経過後の時刻が出力の時刻以後である感覚効果情報を抽出して出力することを特徴とする請求項6に記載の感覚効果情報出力装置。 - コンピュータを請求項7に記載の感覚効果情報出力装置として動作させるためのプログラムであって、上記コンピュータを上記感覚効果情報出力装置が備えている各手段として機能させるためのプログラム。
- 請求項8に記載のプログラムを記録したコンピュータ読み取り可能な記録媒体。
- 感覚効果を再生する感覚効果再生装置を制御する制御装置に感覚効果情報を出力する感覚効果情報出力方法であって、
感覚効果情報出力装置が、請求項1から4のいずれか1項に記載のデータ構造を有する感覚効果情報を出力する工程を含むことを特徴とする感覚効果情報出力方法。 - 上記感覚効果情報は、上記感覚効果再生装置による上記感覚効果の再生期間を規定する再生期間情報を含むものであり、
上記感覚効果情報を出力する工程は、上記感覚効果情報出力装置が、出力すべき上記感覚効果情報から、上記制御開始時刻規定情報によって規定される制御開始時刻が出力の時刻以前であり、かつ、上記再生開始時刻から上記再生期間を経過後の時刻が出力の時刻以後である感覚効果情報を抽出して上記制御装置に出力することを特徴とする請求項10に記載の感覚効果情報出力方法。 - 請求項1から4のいずれか1項に記載のデータ構造を有する感覚効果情報を参照して、上記感覚効果再生装置に対する、上記再生開始時刻に上記感覚効果の再生を開始させるための制御を、少なくとも上記制御開始時刻までに開始する制御手段を備えていることを特徴とする制御装置。
- コンピュータを請求項12に記載の制御装置として動作させるためのプログラムであって、上記コンピュータを上記制御装置が備えている各手段として機能させるためのプログラム。
- 請求項13に記載のプログラムを記録したコンピュータ読み取り可能な記録媒体。
- 請求項1から4のいずれか1項に記載のデータ構造を有する感覚効果情報を制御装置に対して出力する感覚効果情報出力装置と、
上記感覚効果情報出力装置から出力された上記感覚効果情報を参照して、上記感覚効果再生装置による上記感覚効果の再生を制御する上記制御装置と、を備えていることを特徴とする感覚効果再生システム。 - 請求項1から4のいずれか1項に記載のデータ構造を有する感覚効果情報を生成する感覚効果情報生成装置であって、
予め入力された、上記再生開始時刻および上記準備期間に基づいて、上記制御開始時刻が、上記再生開始時刻よりも上記準備期間以上前になるように上記制御開始時刻規定情報を生成する情報生成手段を備えていることを特徴とする感覚効果情報生成装置。 - コンピュータを請求項16に記載の感覚効果情報生成装置として動作させるためのプログラムであって、上記コンピュータを上記感覚効果情報生成装置が備えている各手段として機能させるためのプログラム。
- 請求項17に記載のプログラムを記録したコンピュータ読み取り可能な記録媒体。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2010800052063A CN102292725A (zh) | 2009-01-27 | 2010-01-26 | 感官效果信息的数据结构、感官效果信息输出装置、感官效果信息输出方法、感官效果信息生成装置、控制装置、系统、程序以及记录介质 |
JP2010548413A JPWO2010087153A1 (ja) | 2009-01-27 | 2010-01-26 | 感覚効果情報のデータ構造、感覚効果情報出力装置、感覚効果情報出力方法、感覚効果情報生成装置、制御装置、システム、プログラムおよび記録媒体 |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009-015774 | 2009-01-27 | ||
JP2009015774 | 2009-01-27 | ||
JP2009-098395 | 2009-04-14 | ||
JP2009098395 | 2009-04-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010087153A1 true WO2010087153A1 (ja) | 2010-08-05 |
Family
ID=42395418
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/000436 WO2010087153A1 (ja) | 2009-01-27 | 2010-01-26 | 感覚効果情報のデータ構造、感覚効果情報出力装置、感覚効果情報出力方法、感覚効果情報生成装置、制御装置、システム、プログラムおよび記録媒体 |
Country Status (3)
Country | Link |
---|---|
JP (1) | JPWO2010087153A1 (ja) |
CN (1) | CN102292725A (ja) |
WO (1) | WO2010087153A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017502361A (ja) * | 2013-09-26 | 2017-01-19 | アルカテル−ルーセント | クライアントデバイスにメディアアセットを提供するための方法 |
EP4191562A1 (en) * | 2018-08-27 | 2023-06-07 | Google LLC | Algorithmic determination of a story readers discontinuation of reading |
US11749279B2 (en) | 2018-09-04 | 2023-09-05 | Google Llc | Detection of story reader progress for pre-caching special effects |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10541005B2 (en) * | 2017-05-17 | 2020-01-21 | Cypress Semiconductor Corporation | Distributed and synchronized control system for environmental signals in multimedia playback |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001333030A (ja) * | 2000-05-19 | 2001-11-30 | Minolta Co Ltd | 放送番組送受信システム、これに使用される放送装置及び受信装置、放送番組送受信方法、並びに、記録媒体再生システム、これに使用される記録媒体再生装置及び記録媒体 |
JP2001343900A (ja) * | 2000-05-31 | 2001-12-14 | Matsushita Electric Ind Co Ltd | 照明システムおよび照明制御データ作成方法 |
JP2007006352A (ja) * | 2005-06-27 | 2007-01-11 | Nippon Television Network Corp | データ放送を利用した外部機器の制御システムと、それに用いられる装置及びプログラム |
WO2007123008A1 (ja) * | 2006-04-21 | 2007-11-01 | Sharp Kabushiki Kaisha | データ送信装置、データ送信方法、視聴環境制御装置、視聴環境制御システム、及び視聴環境制御方法 |
WO2007145064A1 (ja) * | 2006-06-13 | 2007-12-21 | Sharp Kabushiki Kaisha | データ送信装置、データ送信方法、視聴環境制御装置、視聴環境制御システム、及び視聴環境制御方法 |
-
2010
- 2010-01-26 CN CN2010800052063A patent/CN102292725A/zh active Pending
- 2010-01-26 WO PCT/JP2010/000436 patent/WO2010087153A1/ja active Application Filing
- 2010-01-26 JP JP2010548413A patent/JPWO2010087153A1/ja active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001333030A (ja) * | 2000-05-19 | 2001-11-30 | Minolta Co Ltd | 放送番組送受信システム、これに使用される放送装置及び受信装置、放送番組送受信方法、並びに、記録媒体再生システム、これに使用される記録媒体再生装置及び記録媒体 |
JP2001343900A (ja) * | 2000-05-31 | 2001-12-14 | Matsushita Electric Ind Co Ltd | 照明システムおよび照明制御データ作成方法 |
JP2007006352A (ja) * | 2005-06-27 | 2007-01-11 | Nippon Television Network Corp | データ放送を利用した外部機器の制御システムと、それに用いられる装置及びプログラム |
WO2007123008A1 (ja) * | 2006-04-21 | 2007-11-01 | Sharp Kabushiki Kaisha | データ送信装置、データ送信方法、視聴環境制御装置、視聴環境制御システム、及び視聴環境制御方法 |
WO2007145064A1 (ja) * | 2006-06-13 | 2007-12-21 | Sharp Kabushiki Kaisha | データ送信装置、データ送信方法、視聴環境制御装置、視聴環境制御システム、及び視聴環境制御方法 |
Non-Patent Citations (2)
Title |
---|
POINT ZUKAISHIKI SAISHIN MPEG KYOKASHO, 1 August 1994 (1994-08-01), pages 236 - 237 * |
SOGO MULTIMEDIA SENSHO MPEG, 20 April 1996 (1996-04-20), pages 54 - 55 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017502361A (ja) * | 2013-09-26 | 2017-01-19 | アルカテル−ルーセント | クライアントデバイスにメディアアセットを提供するための方法 |
EP4191562A1 (en) * | 2018-08-27 | 2023-06-07 | Google LLC | Algorithmic determination of a story readers discontinuation of reading |
US11862192B2 (en) | 2018-08-27 | 2024-01-02 | Google Llc | Algorithmic determination of a story readers discontinuation of reading |
US11749279B2 (en) | 2018-09-04 | 2023-09-05 | Google Llc | Detection of story reader progress for pre-caching special effects |
Also Published As
Publication number | Publication date |
---|---|
JPWO2010087153A1 (ja) | 2012-08-02 |
CN102292725A (zh) | 2011-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101967810B1 (ko) | 데이터 프로세서 및 사용자 제어 데이터의 오디오 디코더들과 렌더러들로의 전송 | |
JP5026423B2 (ja) | 電子メッセージを配信する方法および装置 | |
CN103119960B (zh) | 信息处理装置、信息处理方法和程序 | |
US20110188832A1 (en) | Method and device for realising sensory effects | |
JP2009521170A (ja) | 透かしによるスクリプト同期化方法 | |
US20040268384A1 (en) | Method and apparatus for processing a video signal, method for playback of a recorded video signal and method of providing an advertising service | |
JP2009540725A (ja) | 周囲環境及びコンテンツの配信 | |
JP2010109965A (ja) | オーケストラメディアサービスシステム及び方法 | |
KR20090038834A (ko) | 실감 미디어 생성 및 소비 방법 및 그 장치 | |
JP2008530938A5 (ja) | ||
WO2010087153A1 (ja) | 感覚効果情報のデータ構造、感覚効果情報出力装置、感覚効果情報出力方法、感覚効果情報生成装置、制御装置、システム、プログラムおよび記録媒体 | |
KR101352790B1 (ko) | 환경정보 제공방법, 이를 적용한 영상기기 및 영상 시스템 | |
JP5270031B2 (ja) | コンテンツ提供システム、コンテンツ生成装置、コンテンツ再生装置及びコンテンツ提供方法 | |
WO2019188393A1 (ja) | 情報処理装置、情報処理方法、送信装置、及び送信方法 | |
JP2011155532A (ja) | 体感効果再生装置 | |
KR20090061516A (ko) | 멀티미디어 콘텐츠 메타데이터 분석에 따른 홈 네트워크제어 장치 및 방법 | |
JP5230437B2 (ja) | コンテンツ提示オプティマイザ | |
JP2009089350A (ja) | ネットワーク基盤のカスタマイズコンテンツを提供するためのユーザ装置及びその方法並びに著作装置及びその方法 | |
TW200400765A (en) | DVD virtual machine | |
KR20050116916A (ko) | 환경 정보를 포함하는 콘텐츠를 생성하고 재생하는 방법과그 재생 장치 | |
US20110110641A1 (en) | Method for real-sense broadcasting service using device cooperation, production apparatus and play apparatus for real-sense broadcasting content thereof | |
JP2011119883A (ja) | 体感効果再生装置 | |
JP2000013759A (ja) | 情報送信装置および方法、情報受信装置および方法、並びに提供媒体 | |
JP2000332709A (ja) | マルチメディア情報再生装置、及びマルチメディア情報再生方法 | |
JP4042958B2 (ja) | 外部機器連動型コンテンツ再生装置、その方法及びそのプログラム、並びに外部機器連動型コンテンツ送信方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080005206.3 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10735625 Country of ref document: EP Kind code of ref document: A1 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
ENP | Entry into the national phase |
Ref document number: 2010548413 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10735625 Country of ref document: EP Kind code of ref document: A1 |