KR20180048199A - Feedback device, content reproduction device, system and method for providing thermal experience - Google Patents

Abstract

According to an aspect of the present invention, a method of providing a thermal experience for an electronic game, in which the method is performed by a content reproduction device interworking with a feedback device for driving the electronic game and outputting a thermal feedback by using a thermoelectric element, includes the steps of: executing the electronic game including a player, and an enemy character attacking the player by performing an attack action having an element attribute including a flame attribute, a cold attribute, and an electric attribute; determining a type of the thermal feedback based on the element attribute of the attack action when a stroke event in which the player is subject to a stroke by the attack action occurs in the electronic game, such that a type of the thermal feedback for a stroke event occurring due to the attack action of the flame attribute is determined as a warm-feeling feedback, a type of the thermal feedback for a stroke event occurring due to the attack action of the cold attribute is determined as a cold-feeling feedback, and a type of the thermal feedback for a stroke event occurring due to the attack action of the electric attribute is determined as a thermal-pain feedback; and controlling the feedback device to output the thermal feedback according to the stroke event together with a stroke graphic, such that the thermoelectric element is controlled to start a heating operation when the thermal feedback is the warm-feeling feedback, the thermoelectric element is controlled to start a heat-absorbing operation when the thermal feedback is the cold-feeling feedback, and the thermoelectric element is controlled to start a thermal-grill operation in which the heating operation and the heat-absorbing operation are combined when the thermal feedback is the thermal-pain feedback.

Description

TECHNICAL FIELD [0001] The present invention relates to a feedback device, a content playback device, a thermal experience providing system, and a thermal experience providing method.

The present invention relates to a feedback device, a content reproducing device, a thermal experience providing system, and a thermal experience providing method, and more particularly, to a feedback device for outputting thermal feedback in accordance with multimedia content reproduction, a content reproducing device for reproducing the multimedia content, To a thermal experience providing system and a thermal experience providing method for allowing a user to experience a thermal experience.

Recently, as technology for virtual reality (VR) or augmented reality (AR) has been developed, demand for providing feedback through various senses in order to increase user engagement with contents is increasing. Particularly, at the Consumer Electronics Show (CES) in 2016, virtual reality technology was introduced as one of promising technologies for the future. In parallel with this trend, research is being actively carried out to provide a user experience for all human senses including smell and tactile sensation in the future, away from the user experience (UX: User experience) mainly limited to visual and auditory sense.

Thermoelement (TE) is a device that generates an exothermic reaction or an endothermic reaction by receiving electric energy by a Peltier effect, and has been expected to be used for providing thermal feedback to a user. However, The application of the thermoelectric element has been limited since it is difficult to adhere to the body part of the user.

However, recently, development of a flexible thermoelement (FTE) has come to a successful stage, and it is expected to overcome the problems of a conventional thermoelectric device and to transmit thermal feedback effectively to a user.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a thermal experience providing system and a thermal experience providing method that provide a thermal experience by outputting thermal feedback when reproducing multimedia contents to a user.

In particular, the present invention aims to enhance the user's content immersion by interlocking the audiovisual output and the thermal feedback of the multimedia contents with each other.

It is to be understood that the present invention is not limited to the above-described embodiments and that various changes and modifications may be made without departing from the spirit and scope of the present invention as defined by the following claims .

According to an aspect of the present invention there is provided a method of providing a thermal experience for an electronic game, the method being performed by a content playback device operable with a feedback device that drives an electronic game and outputs thermal feedback using a thermoelectric element, Executing an electronic game including an enemy character attacking the player by performing an attack action having an element attribute including a flame attribute, a cold attribute, and an electric attribute; Determining a type of the thermal feedback based on the element attribute of the attack action when a shooting event in which the player is shot by the attack action occurs in the electronic game, The kind of the thermal feedback is determined as the warm feedback, and the type of the thermal feedback is determined as the cold feedback for the shot event by the attack action of the cool air attribute, and for the shot event by the attack action of the electric attribute, Determining the type of thermal feedback as thermal sensory feedback; And controlling the feedback device so that the thermal feedback according to the shot event is output together with the shot graphic, wherein when the thermal feedback is the warm feedback, control is performed so that the thermoelectric element starts a heating operation, Controlling the thermoelectric element to initiate a heat absorbing operation and controlling the thermoelectric element to initiate a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined when the thermal feedback is the heat trapping feedback A method of providing a thermal experience can be provided.

According to another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And an enemy character attacking the player by performing an attacking action having an element attribute including a player and a flame attribute, a cold attribute, and an electric attribute, wherein the player executes an attacking action The type of the thermal feedback is determined based on the element attribute of the attack action, and the kind of the thermal feedback is judged as the warm feedback for the shot event by the attack action of the flame attribute And determines the type of the thermal feedback as the cold feedback, and determines the type of the thermal feedback as the thermal sensation feedback for the shot event by the attack of the electrical attribute , According to the shot event Controlling the feedback device via the communication module such that the thermal feedback is output together with the shot graphic, wherein the thermal feedback controls the thermoelement to initiate a heating operation when the thermal feedback is the warm feedback, and wherein the thermal feedback is the cold feedback And a controller for controlling the thermoelectric element to initiate a heat absorbing operation and to control the thermoelectric element to initiate a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined when the thermal feedback is the thermal sensation feedback A reproducing device may be provided.

According to still another aspect of the present invention, there is provided a heat generating apparatus including: a heat generating unit that generates heat generated by a thermoelectric action including a heat generating operation, a heat absorbing operation, and a heat grill operation in which the heat generating operation and the heat absorbing operation are combined, A method of providing a thermal experience performed by a feedback device that outputs thermal feedback by communicating to a user through a contact surface that makes contact, the method comprising: performing an attack action having an elemental attribute including a player and a flame attribute, Interlocking with a content reproducing device for executing an electronic game including an enemy character attacking the player; Outputting a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when the player is hit by the attacking action having the flame attribute in the game; Applying a reverse voltage for the heat absorbing operation to the thermoelectric element to output cold feedback when the player is hit by the attack action having the cold air attribute in the game; And a controller for simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation when the player is shot by the attacking action having the electric attribute in the game to output thermal sensation feedback A method of providing a thermal experience comprising:

According to still another aspect of the present invention, there is provided a content playback device for executing an electronic game including an enemy character attacking the player by performing an attacking action having a player and an element attribute including a flame attribute, And a feedback device for outputting thermal feedback corresponding to an attribute of the attack action when a player shoots an attack event shot by the attack action, the feedback device comprising: a heat generating operation, an endothermic operation, and a combination of the heat generating operation and the heat absorbing operation A power terminal for supplying power to the thermoelectric element, and a contact surface provided on one side of the thermoelectric element and in contact with the body part of the user, wherein the contact surface To the user < RTI ID = 0.0 > By month heat output module for outputting the thermal feedback; And outputting a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when the shooting event occurs due to the attacking action having the flame attribute, so that the shooting event having the cold- And outputs a cold feedback to the thermoelectric element by applying a reverse voltage that is opposite to the positive voltage and the power application direction for the heat absorbing operation to output the cold feedback. When the hit event occurs due to the attack action having the electrical attribute, And a feedback controller for applying the constant voltage and the reverse voltage simultaneously or alternately for outputting heat trapping feedback for the thermal grill operation.

According to yet another aspect of the present invention, there is provided a content reproduction device for driving an electronic game, a display for outputting the video game image, and a feedback device for interfacing with the content reproduction device and outputting thermal feedback using a thermoelectric element Wherein the content playback device is configured to perform an attacking action with a first communication module and a player communicating with the feedback device and an element attribute including a flame attribute, Wherein the type of the thermal feedback is determined based on the element attribute of the attack action when a shooting event in which the player is shot by the attack action occurs in the game, , An attack action of the flame attribute The type of the thermal feedback is determined as the warm feedback, and the type of the thermal feedback is determined as the cold feedback for the hit event based on the attack of the cool air attribute, Determining a type of the thermal feedback as a thermal sensation feedback for the shot event, transmitting the kind of thermal feedback to the feedback device through the first communication module, outputting a shot graphic according to the shot event through the display Wherein the feedback device includes a thermoelectric element that performs a thermoelectric operation including a heat generating operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined, A power supply terminal for supplying power and A thermal output module provided on one side of the thermoelectric element and including a contact surface contacting the body part of the user and outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface, Receiving a type of the thermal feedback through a second communication module for communicating with the reproducing device and the second communication module and applying the power to the thermoelectric element so that the received kind of thermal feedback is outputted, The control unit applies a constant voltage for the heat generation operation to the thermoelectric element when received, and applies a reverse voltage for the heat absorption operation to the thermoelectric element when the cold feedback is received, The constant voltage and the reverse voltage may be simultaneously or alternately A feedback controller which is applied as can be provided with a thermal experience providing system.

According to yet another aspect of the present invention there is provided a method of providing a thermal experience for an electronic game, the method being performed by a content reproduction device operable with a feedback device that drives an electronic game and outputs thermal feedback using a thermoelectric element Executing an action having an element attribute including a flame attribute, a frost attribute, and an electrical attribute; The player activating the action according to a user input indicating the action; Outputting a graphic for the action; Determining a kind of the thermal feedback based on the element attribute of the action, determining the type of the thermal feedback as the warm-feeling feedback with respect to the action of the flame attribute, and determining the type of the thermal feedback as the cold- Determining the type of thermal feedback as thermal feedback feedback for the action of the electrical attribute; And controlling the feedback device to output the thermal feedback together with the graphic of the action, wherein when the thermal feedback is the warm feedback, control is performed so that the thermoelectric element starts a heating operation, and when the thermal feedback is the cold feedback, Controlling a thermoelectric element to initiate a heat absorbing operation and controlling the thermoelectric element to initiate a thermal grill operation in which the thermoelectric element and the heat absorbing operation are combined when the thermal feedback is the thermal sensory feedback A method can be provided.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And a player performing an action having an element attribute including a flame attribute, a freezing attribute, and an electric attribute, causing the player to play the action according to a user input indicating the action, The type of the thermal feedback is determined based on the element attribute of the action, the type of the thermal feedback is determined as the warm feedback for the action of the flame attribute, The type of the thermal feedback is judged as the cold feedback, the type of the thermal feedback is judged as the thermal sensation feedback for the action of the electric attribute, and the thermal feedback is outputted together with the graphic of the action To control the feedback device And controls the thermoelectric element to start the heat generating operation when the thermal feedback is the warm feedback, and controls the thermoelectric element to start the heat absorbing operation when the thermal feedback is the cold feedback, And the controller controls the thermoelectric element to start the thermal grill operation in which the heat generating operation and the heat absorbing operation are combined.

According to still another aspect of the present invention, heat generated by a thermoelectric operation including a heat generating operation, an endothermic operation, and a heat grill operation in which the heat generating operation and the heat absorbing operation are combined is applied to a user's body part A player performing an attacking action having an elemental attribute including a flame attribute, a frost attribute and an electrical attribute, the method comprising the steps of: Interlocking with a content reproducing device that executes an electronic game including; When the player performs the attacking action with the flame attribute in the game, applying a constant voltage for the heat generating operation to the thermoelectric element to output a warm-feeling feedback; When the player performs the attacking action with the cold-air attribute in the game, applying a reverse voltage for the heat-absorbing operation to the thermoelectric element to output cold feedback; And a controller for simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation when the player performs the aggressive action with the electric attribute in the game, And outputting the thermal feedback signal.

According to yet another aspect of the present invention, in cooperation with a content playback device that executes an electronic game including a player who performs an attack action having an element attribute including a flame attribute, a freezing attribute, and an electric attribute, A feedback device for outputting thermal feedback corresponding to an element attribute of the attack action when performing an action, the feedback device comprising: an input module for obtaining a user input; A thermoelectric element for performing a thermoelectric operation including a heat generating operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined, a power supply terminal for supplying power to the thermoelectric element, A thermal output module including a contact surface contacting the body part of the user and outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface; And outputting a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when a user input indicating the attack action having the flame attribute is obtained through the input module, Wherein the control unit applies a reverse voltage that is opposite to the positive voltage and the power supply direction for the heat absorbing operation to output cold feedback to the thermoelectric element, And a feedback controller for simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation to output thermal sensation feedback when a user input indicating the attack action having the attribute is acquired A feedback device may be provided.

It is to be understood that the solution of the problem of the present invention is not limited to the above-mentioned solutions, and the solutions which are not mentioned can be clearly understood by those skilled in the art to which the present invention belongs It will be possible.

According to the present invention, it is possible to provide a thermal experience as one of the user experiences on multimedia contents.

According to the present invention, the feeling of immersion of the multimedia contents can be improved by interlocking the thermal experience with the audiovisual experience in the reproduction of the multimedia contents or outputting the thermal feedback in a form suitable for the situation given to the user by the multimedia contents.

The effects of the present invention are not limited to the above-mentioned effects, and the effects not mentioned can be clearly understood by those skilled in the art from the present specification and the accompanying drawings.

1 is a block diagram of a configuration of a thermal experience providing system according to an embodiment of the present invention.
2 is a block diagram of a configuration of a content reproduction device according to an embodiment of the present invention.
3 is a block diagram of a configuration of an audiovisual device according to an embodiment of the present invention.
4 is a block diagram illustrating the configuration of a feedback device according to an embodiment of the present invention.
5 is a schematic diagram of a first embodiment of a thermal experience providing system according to an embodiment of the present invention.
6 is a block diagram of a configuration of a first embodiment of a thermal experience providing system according to an embodiment of the present invention.
FIGS. 7 and 8 are schematic diagrams illustrating an exemplary form of an HMD of a first embodiment of a thermal experience providing system according to an embodiment of the present invention.
9 is a block diagram of the configuration of the HMD of the first embodiment of the thermal experience providing system according to the embodiment of the present invention.
10 and 11 are schematic diagrams illustrating exemplary embodiments of input devices of a first embodiment of a thermal experience providing system according to an embodiment of the present invention.
12 is a block diagram of a configuration of an input device according to the first embodiment of the thermal experience providing system according to the embodiment of the present invention.
13 to 17 are schematic diagrams showing another exemplary form of the input device of the first embodiment of the thermal experience providing system according to the embodiment of the present invention.
18 and 22 are schematic diagrams showing exemplary forms of a wearable device of a first embodiment of a thermal experience providing system according to an embodiment of the present invention.
23 is a schematic diagram of a second embodiment of a thermal experience providing system according to an embodiment of the present invention.
24 is a block diagram relating to the configuration of the second embodiment of the thermal experience providing system according to the embodiment of the present invention.
25 is a block diagram of a configuration of a smart device in a second embodiment of a thermal experience providing system according to an embodiment of the present invention.
26 is a schematic diagram of a third embodiment of a thermal experience providing system according to an embodiment of the present invention.
27 is a block diagram relating to the configuration of the third embodiment of the thermal experience providing system according to the embodiment of the present invention.
28 is a schematic diagram of a fourth embodiment of a thermal experience providing system according to an embodiment of the present invention.
29 is a schematic diagram of a fifth embodiment of a thermal experience providing system according to an embodiment of the present invention.
30 is a schematic diagram of a sixth embodiment of a thermal experience providing system according to an embodiment of the present invention.
31 is a block diagram of a configuration of a thermal output module according to an embodiment of the present invention.
32 is a diagram illustrating an embodiment of a heat output module according to an embodiment of the present invention.
33 is a view showing another embodiment of the heat output module according to the embodiment of the present invention.
FIG. 34 is a view of another embodiment of a heat output module according to an embodiment of the present invention. FIG.
35 is a view showing yet another embodiment of the heat output module according to the embodiment of the present invention.
36 is a diagram illustrating a heating operation for providing warm feedback according to an embodiment of the present invention.
37 is a graph relating to the strength of the warm feedback according to the embodiment of the present invention.
38 is a diagram illustrating a heat absorbing operation for providing cold feedback according to an embodiment of the present invention.
39 is a graph relating to the strength of the cold feedback according to the embodiment of the present invention.
40 is a graph showing the strength of warm / cool feedback using voltage control according to an embodiment of the present invention.
41 is a graph relating to warm / cool feedback with the same temperature change amount according to an embodiment of the present invention.
FIG. 42 is a diagram illustrating a voltage regulating type thermal grill operation according to an embodiment of the present invention. FIG.
Figure 43 is a table of voltages for providing neutral column grill feedback in a voltage regulation scheme according to an embodiment of the present invention.
Figure 44 is a basic flowchart of a thermal experience providing method according to an embodiment of the present invention.
45 is a flow chart of a first embodiment of a thermal experience providing method according to an embodiment of the present invention.
46 is a diagram illustrating an example of thermal feedback data used in the first embodiment of the thermal experience providing method according to the embodiment of the present invention.
47 is a diagram of a thermal feedback output operation of a first embodiment of a thermal experience providing method according to an embodiment of the present invention.
Figure 48 is a flow chart of a second embodiment of a thermal experience providing method according to an embodiment of the present invention.
49 is a flowchart of a third embodiment of the thermal experience providing method according to the embodiment of the present invention.
50 is a diagram of a skill-thermal feedback table used in a third embodiment of the thermal experience providing method according to an embodiment of the present invention.
51 is a flowchart of a fourth embodiment of the thermal experience providing method according to the embodiment of the present invention.
52 is a diagram related to a fingerprint presentation event provided in the fourth embodiment of the thermal experience providing method according to the embodiment of the present invention.
53 is a flow chart of a fifth embodiment of the thermal experience providing method according to the embodiment of the present invention.
54 is a flowchart of a sixth embodiment of a method for providing a thermal experience according to an embodiment of the present invention.
55 is a flowchart of a seventh embodiment of the thermal experience providing method according to the embodiment of the present invention.
Figure 56 is a diagram of a game providing a timing action according to a seventh embodiment of a method for providing a thermal experience according to an embodiment of the present invention.
57 is a flowchart of an eighth embodiment of the thermal experience providing method according to the embodiment of the present invention.
58 is a view showing a virtual space in a game in the eighth embodiment of the thermal experience providing method according to the embodiment of the present invention.
59 is a flowchart of a ninth embodiment of a thermal experience providing method according to an embodiment of the present invention.
60 is a flowchart of a tenth embodiment of the thermal experience providing method according to the embodiment of the present invention.
61 is a flowchart of an eleventh embodiment of the method for providing thermal experience according to the embodiment of the present invention.
62 is a flowchart of a fourteenth embodiment of a method for providing a thermal experience according to an embodiment of the present invention.
63 is a flowchart of a fifteenth embodiment of a thermal experience providing method according to an embodiment of the present invention.
Figure 64 is a flow chart of a sixteenth embodiment of a thermal experience providing method according to an embodiment of the present invention.
65 is a flowchart of a seventeenth embodiment of the method for providing thermal experience according to the embodiment of the present invention.
FIG. 66 is a view showing a thermal feedback object according to a point of occurrence of a thermal event in a first person game according to a seventeenth embodiment of the thermal experience providing method according to the embodiment of the present invention. FIG.
67 is a block diagram of an electronic apparatus according to an embodiment of the present invention.
68 is a flowchart of a first embodiment of a method of generating multimedia contents according to an embodiment of the present invention.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to be illustrative of the present invention and not to limit the scope of the invention. Should be interpreted to include modifications or variations that do not depart from the spirit of the invention.

Although the terms used in the present invention have been selected in consideration of the functions of the present invention, they are generally used in general terms. However, the present invention is not limited to the intention of the person skilled in the art to which the present invention belongs . However, if a specific term is defined as an arbitrary meaning, the meaning of the term will be described separately. Accordingly, the terms used herein should be interpreted based on the actual meaning of the term rather than on the name of the term, and on the content throughout the description.

The drawings attached hereto are intended to illustrate the present invention easily, and the shapes shown in the drawings may be exaggerated and displayed as necessary in order to facilitate understanding of the present invention, and thus the present invention is not limited to the drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of known configurations or functions related to the present invention will be omitted when it is determined that the gist of the present invention may be obscured.

According to one aspect of the present invention, there is provided a method of reproducing multimedia content, comprising: reproducing multimedia content including video data relating to moving pictures and thermal feedback data relating to thermal feedback interlocked with a specific scene of the moving pictures; Acquiring a thermoelectronic operation start time point set to a time point earlier than the output time point of the specific scene in consideration of a delay time from the start of the thermoelectric operation for the thermal feedback to the bodily sensation of the user by the thermal feedback; And outputting the thermal feedback using the thermoelectric element when the reproduction time point of the multimedia content reaches the thermoelectric-action start time so that the user is provided with the thermal feedback with the specific scene at the output time of the specific scene And outputting the specific scene through a display when the playback start time of the multimedia content reaches the output time point of the specific scene. have.

Here, the thermoelectric-activation start time may be a time point preceding the reproduction time of the specific scene by the delay time.

Here, the thermal feedback data may include identification information of the specific scene interlocked with the thermal feedback, and the obtaining may include acquiring identification information of the specific scene linked to the thermal feedback from the thermal feedback data Obtaining the output time point of the specific scene from the image data based on the identification information of the specific scene and calculating the thermoelectric-motion start time point based on the output time point of the specific scene and the delay time, .

Here, in the step of calculating the start time of the thermoelectric conversion, a time point ahead of the output time of the specific scene by the delay time can be calculated as the thermoelectric-action start time point.

Here, the thermal feedback data includes an output time point of the thermal feedback set to be the same as the output time point of the specific scene, and the acquiring step includes obtaining an output time point of the thermal feedback from the thermal feedback data And calculating the thermoelectric-activation start time based on the output time of the thermal feedback and the delay time.

Here, in the step of calculating the thermoelectric operation time, a point of time preceding the output of the thermal feedback by the delay time may be calculated as the thermoelectric action time point.

Here, the thermoelectric operation may include at least one of a heat generating operation and an heat absorbing operation performed by the thermoelectric element when the power is applied thereto.

Here, the thermal feedback data may include information on the kind of the thermal feedback including the warm feedback and the cold feedback, and determining the type of the thermal feedback based on the thermal feedback data. And obtaining the delay time in consideration of the kind of the thermal feedback.

Here, the thermal feedback data may include information on the strength of the thermal feedback, and the strength of the thermal feedback may be determined based on the thermal feedback data. And obtaining the delay time in consideration of the strength of the thermal feedback.

Wherein the intensity of the thermal feedback includes a first intensity and a second intensity that is stronger than the first intensity and wherein a second delay time for the second intensity is greater than a first delay time for the first intensity It can be big.

Wherein the intensity of the thermal feedback includes a first intensity and a second intensity that is stronger than the first intensity and wherein a second delay time for the second intensity is greater than a first delay time for the first intensity Can be small.

Obtaining feedback information of the feedback device from the feedback device; And obtaining the delay time in consideration of the identification information of the feedback device.

Here, the method may further include receiving information on the delay time from the feedback device.

Here, the image data and the thermal feedback data may be provided as a single file.

Here, the image data and the thermal feedback data may be provided as separate files.

Here, in the outputting step, the specific scene may be outputted through the display by transmitting a video signal to an external device equipped with the display.

According to another aspect of the present invention, there is provided a data processing apparatus including: a memory for storing data; A communication module for performing communication with an external device; And a controller for acquiring and reproducing multimedia content including video data related to motion pictures from the memory and thermal feedback data relating to thermal feedback associated with a specific one of the motion pictures, Acquiring a thermoelectronic operation start time point set at a time point earlier than the output time point of the specific scene in consideration of a delay time from the start of the thermoelectric action to the user's bodily sensation of the thermal feedback, To the feedback device for outputting the thermal feedback using the thermoelectric element when the reproduction time point of the multimedia contents reaches the thermoelectric-activation start time so that the specific scene and the thermal feedback are interlocked with each other, Communication module And outputting the specific scene through a display when the reproduction time point of the multimedia content reaches the output time point of the specific scene.

Here, the thermoelectric-activation start time may be a time point preceding the reproduction time of the specific scene by the delay time.

Here, the thermal feedback data includes identification information of the specific scene interlocked with the thermal feedback, and the controller acquires identification information of the specific scene linked to the thermal feedback from the thermal feedback data, The output time point of the specific scene is obtained from the image data based on the identification information of the specific scene, and the thermoelectric-action start time point is calculated based on the output time point of the specific scene and the delay time.

Here, the controller may calculate a time point that is ahead of the output time of the specific scene by the delay time as the thermoelectric-action start time point.

Here, the thermal feedback data includes an output time point of the thermal feedback set to be the same as the output time point of the specific scene, and the controller obtains the output time point of the thermal feedback from the thermal feedback data, It is possible to calculate the thermoelectric-activation start time based on the output time of the feedback and the delay time.

Here, the controller may calculate a time point that is ahead of the output time of the thermal feedback by the delay time to the thermoelectric action time point.

Here, the thermoelectric operation may include at least one of a heat generating operation and an heat absorbing operation performed by the thermoelectric element when the power is applied thereto.

Here, the thermal feedback data may include information on the type of thermal feedback including warm feedback and cold feedback, and the controller may determine the type of the thermal feedback based on the thermal feedback data, The delay time can be obtained in consideration of the kind of thermal feedback.

Here, the thermal feedback data may include information on the strength of the thermal feedback, and the controller may determine the strength of the thermal feedback based on the thermal feedback data, The delay time can be obtained.

Wherein the intensity of the thermal feedback includes a first intensity and a second intensity that is stronger than the first intensity and wherein a second delay time for the second intensity is greater than a first delay time for the first intensity It can be big.

Wherein the intensity of the thermal feedback includes a first intensity and a second intensity that is stronger than the first intensity and wherein a second delay time for the second intensity is greater than a first delay time for the first intensity Can be small.

Here, the controller may acquire the identification information of the feedback device from the feedback device through the communication module, and may obtain the delay time in consideration of the identification information of the feedback device.

Here, the controller may receive information on the delay time from the feedback device through the communication module.

Here, in the memory, the image data and the thermal feedback data may be stored as a single file.

Here, in the memory, the image data and the thermal feedback data may be stored as separate files.

Here, the controller may receive the multimedia content through the communication module and store the multimedia content in the memory.

Here, the controller may output the specific scene through the display by transmitting the image signal to the external module on which the display is mounted.

According to another aspect of the present invention, there is provided an image processing apparatus including a memory for storing data, a first communication module for communicating with an external device, and thermal feedback A content playback device including a controller for acquiring and playing back multimedia content including data; A second communication module for performing communication with an external device, a thermoelectric element for performing a thermoelectric operation for the thermal feedback, a feedback controller for applying a power for the thermoelectric operation to the thermoelectric element, And a feedback device including a contact surface for transmitting heat generated by the thermoelectric action to a user, wherein the controller controls a delay time from the start of the thermoelectric operation until the contact surface reaches a temperature at which the contact surface is sensed by the user When the playback start time of the multimedia content reaches the start time of the thermoelectric operation, the feedback device transmits the feedback start message to the first device Through a communication module, And outputs the specific scene through the display when the reproduction time of the content reaches the output time of the specific scene, and the feedback controller outputs the specific scene when the feedback start message is received through the second communication module There is provided a thermal experience providing system for applying power to the thermoelectric element such that the user is provided with the thermal feedback in conjunction with the specific scene.

According to yet another aspect of the present invention there is provided a feedback device for providing a user with a thermal experience in the reproduction of multimedia content comprising video data relating to moving pictures and thermal feedback data relating to thermal feedback associated with a particular scene of the moving pictures, A thermoelectric element for performing thermoelectric conversion for the thermal feedback; A feedback controller for applying a power for the thermoelectric conversion to the thermoelectric element; And a contact surface for contacting the body of the user and transmitting heat generated by the thermoelectric action to the user, wherein the feedback controller is operable to cause the user to input the specific scene and the thermal feedback Is set to a time point ahead of the output time point of the specific scene in consideration of the delay time required for the playback time of the multimedia content from the start of the thermoelectric operation until the contact surface reaches the temperature at which the user touches the user A feedback device may be provided to apply the power to the thermoelectric element when the thermoelectric operation start time is reached.

According to yet another aspect of the present invention there is provided a method of generating multimedia content that provides a thermal experience using a feedback device that provides thermal feedback by thermoelectric action of a thermoelectric element through a contact surface that contacts a user & The method comprising: obtaining an output time point of a specific scene to be interlocked with the thermal feedback during a reproduction interval of the moving image; The output of the specific scene in consideration of the delay time from the start of the thermoelectric conversion operation until the temperature of the contact surface reaches the temperature at which the user is sensed by the user so that the specific scene and the thermal feedback are interlocked during reproduction of the multimedia contents. Obtaining a thermoelectronic operation start time point that is set to a time point earlier than a time point; And generating thermal feedback data including the thermoelectric-activation start time point. The method of generating multimedia contents for providing a thermal experience may be provided.

Here, the thermoelectric-activation start time may be a time point preceding the reproduction time of the specific scene by the delay time.

Here, in the step of acquiring the thermoelectric-activation starting point, a point of time preceding the output time of the specific scene by the delay time may be calculated as the thermo-electric-starting point of time.

Here, the thermoelectric operation may include at least one of a heat generating operation and an heat absorbing operation performed by the thermoelectric element when the power is applied thereto.

Here, the method further includes the steps of: acquiring information on the type of thermal feedback including warm feedback and cold feedback; And obtaining the delay time in consideration of the kind of the thermal feedback.

Here, it is also possible to obtain information on the strength of the thermal feedback; And obtaining the delay time in consideration of the strength of the thermal feedback.

Wherein the intensity of the thermal feedback includes a first intensity and a second intensity that is stronger than the first intensity and wherein a second delay time for the second intensity is greater than a first delay time for the first intensity It can be big.

Wherein the intensity of the thermal feedback includes a first intensity and a second intensity that is stronger than the first intensity and wherein a second delay time for the second intensity is greater than a first delay time for the first intensity Can be small.

Here, the method further comprises: obtaining identification information of the feedback device; And obtaining the delay time in consideration of the identification information of the feedback device.

Here, the method may further include creating a single file in which the thermal feedback data and the image data related to the moving image are merged.

Here, the method may further include creating a file including the thermal feedback data separately from a file including image data related to the moving image.

According to yet another aspect of the present invention there is provided an electronic device for generating multimedia content that provides a thermal experience using a feedback device that provides thermal feedback by thermoelectric action of a thermoelectric element during a motion picture reproduction through a contact surface that contacts the user & 1. An apparatus comprising: a memory for storing data; And a control unit for acquiring an output time point of a specific scene to be interlocked with the thermal feedback during a reproduction period of the moving picture, and from the start of the thermoelectric operation so that the specific scene and the thermal feedback are interlocked during reproduction of the multimedia content, A thermal activation start time point is set to a time point earlier than the output time point of the specific scene in consideration of the delay time required to reach the temperature sensed by the user, and thermal feedback data including the thermal activation start time point is generated And a controller for storing the program in the memory.

Here, the thermoelectric-activation start time may be a time point preceding the reproduction time of the specific scene by the delay time.

Here, the controller may calculate a time point that is ahead of the output time of the specific scene by the delay time as the thermoelectric-action start time point.

Here, the thermoelectric operation may include at least one of a heat generating operation and an heat absorbing operation performed by the thermoelectric element when the power is applied thereto.

Wherein the controller obtains a user input relating to the kind of the thermal feedback including warm feedback and cold feedback through the input module, The delay time can be obtained in consideration of the kind of feedback.

The controller may further include an input module for acquiring a user input relating to the intensity of the thermal feedback through the input module, Time can be obtained.

Here, the matching table between the intensity of the thermal feedback and the delay time is stored in the memory, and the controller obtains the delay time with respect to the intensity of the thermal feedback with reference to the matching table, Includes a first intensity, a second intensity, a first delay time with respect to the first intensity, and a second delay time with respect to the second intensity, the second intensity is set stronger than the first intensity, The second delay time may be set to be larger than the first delay time.

Here, the matching table between the intensity of the thermal feedback and the delay time is stored in the memory, and the controller obtains the delay time with respect to the intensity of the thermal feedback with reference to the matching table, Includes a first intensity, a second intensity, a first delay time with respect to the first intensity, and a second delay time with respect to the second intensity, the second intensity is set stronger than the first intensity, The first delay time may be set to be larger than the second delay time.

Here, the controller can obtain the identification information of the feedback device, and obtain the delay time based on the identification information of the feedback device.

Here, the controller may create a single file in which the thermal feedback data and the image data related to the moving image are merged, and store the created file in the memory.

Here, the controller may create a file including the thermal feedback data separately from a file including image data related to the moving image, and store the created file in the memory.

According to yet another aspect of the present invention there is provided a method of providing a thermal experience for an electronic game, the method being performed by a content reproduction device operable with a feedback device that drives an electronic game and outputs thermal feedback using a thermoelectric element Executing an electronic game including an enemy character attacking the player by performing an attacking action having an element attribute including a player and a flame attribute, a cold attribute and an electric attribute; Determining a type of the thermal feedback based on the element attribute of the attack action when a shooting event in which the player is shot by the attack action occurs in the electronic game, The kind of the thermal feedback is determined as the warm feedback, and the type of the thermal feedback is determined as the cold feedback for the shot event by the attack action of the cool air attribute, and for the shot event by the attack action of the electric attribute, Determining the type of thermal feedback as thermal sensory feedback; And controlling the feedback device so that the thermal feedback according to the shot event is output together with the shot graphic, wherein when the thermal feedback is the warm feedback, control is performed so that the thermoelectric element starts a heating operation, Controlling the thermoelectric element to initiate a heat absorbing operation and controlling the thermoelectric element to initiate a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined when the thermal feedback is the heat trapping feedback A method of providing a thermal experience can be provided.

Here, the strength of the thermal feedback is judged based on at least one of the attack power of the attack action, the damage amount of the player based on the shot event, the ratio of the damage amount to the entire physical strength points of the player, and the remaining physical strength points of the player And controlling, in the step of controlling the feedback device, the thermal feedback to be outputted in accordance with the determined intensity.

Here, when the attacking action uses the skill, the element attribute of the attacking action can be determined by the attribute of the element attached to the skill.

Here, the step of obtaining the strength of the thermal feedback set based on at least one of the tiers of the skill on the skill tree including the skill level, the damage amount of the skill, and the plurality of skills having the same element attribute And controlling the feedback device to output the thermal feedback in accordance with the determined intensity.

Here, when the attacking action uses a melee weapon, the element attribute of the attacking action can be determined by the attribute of the element attached to the melee weapon.

And wherein the step of obtaining the strength of the thermal feedback based on at least one of the rating of the middleman and the attack power of the middleman further comprises the step of controlling the feedback device, And can be controlled so as to be output in accordance with the determined strength.

Here, when the attacking action uses a ranged weapon, the element attribute of the attacking action may be determined by at least one of an element attribute assigned to the ranged weapon and an attribute assigned to a projectile launched by the ranged weapon have

Here, the element attribute of the attack action is determined by the element attribute of the projectile when the projectile is given an element attribute, and is determined by the element attribute of the ranged weapon when no element attribute is assigned to the projectile .

And obtaining the strength of the thermal feedback set based on at least one of a rating of the ranged weapon, an attack strength of the ranged weapon, a rating of the projectile, and an attack strength of the projectile, In the controlling step, it is possible to control the thermal feedback to be output in accordance with the determined intensity.

Further comprising the step of causing a debuff effect to be triggered on the player by the shot event in the game, wherein in the step of controlling the feedback device, control is performed to output the thermal feedback during the duration of the debuff effect can do.

Here, in the step of controlling the feedback device, it is possible to control the intensity of the output thermal feedback to decrease during the duration of the debuff effect.

Here, the electronic game may include a 2D game, a VR game, and an AR game.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And an enemy character attacking the player by performing an attacking action having an element attribute including a player and a flame attribute, a cold attribute, and an electric attribute, wherein the player executes an attacking action The type of the thermal feedback is determined based on the element attribute of the attack action, and the kind of the thermal feedback is judged as the warm feedback for the shot event by the attack action of the flame attribute And determines the type of the thermal feedback as the cold feedback, and determines the type of the thermal feedback as the thermal sensation feedback for the shot event by the attack of the electrical attribute , According to the shot event Controlling the feedback device via the communication module such that the thermal feedback is output together with the shot graphic, wherein the thermal feedback controls the thermoelement to initiate a heating operation when the thermal feedback is the warm feedback, and wherein the thermal feedback is the cold feedback And a controller for controlling the thermoelectric element to initiate a heat absorbing operation and to control the thermoelectric element to initiate a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined when the thermal feedback is the thermal sensation feedback A reproducing device may be provided.

Here, the electronic game is installed in the memory, and the controller can execute the electronic game by loading the electronic game from the memory.

Here, the controller can load and execute the electronic game from the game server through the communication module.

Here, the game apparatus may further include a recording medium drive for reading the recording medium storing the electronic game, wherein the controller can execute the electronic game by loading the electronic game from the recording medium drive.

Here, the game apparatus may further include a display for outputting an image, and the controller may output a graphic relating to the game through the display.

Here, the controller may control the external display to output the graphic related to the game through the communication module.

Here, the controller is further configured to determine, based on at least one of the attack power of the attack action, the damage amount of the player based on the shot event, the ratio of the damage amount to the player's total health points, Determine the strength of the feedback, and control the feedback device to output the thermal feedback according to the determined strength through the communication module.

Here, when the attacking action uses the skill, the element attribute of the attacking action can be determined by the attribute of the element attached to the skill.

Here, the controller obtains the intensity of the thermal feedback set based on at least one of the tiers of the skill on a skill tree including a plurality of skills having the level of the skill, the damage amount of the skill, and the same element attribute Through the communication module, the feedback device outputs the thermal feedback in accordance with the determined strength.

Here, the controller may give the player a debuff effect by the shot event in the game and control the feedback device to output the thermal feedback during the duration of the debuff effect through the communication module have.

Here, the controller can control, through the communication module, to cause the feedback device to reduce the intensity of the output thermal feedback during the duration of the debuff effect.

Here, the electronic game may include a 2D game, a VR game, and an AR game.

According to still another aspect of the present invention, heat generated by a thermoelectric operation including a heat generating operation, an endothermic operation, and a heat grill operation in which the heat generating operation and the heat absorbing operation are combined is applied to a user's body part And providing feedback to the user via a contact surface in contact with the contact surface to output thermal feedback, the method comprising: performing an attacking action having an element attribute including a player and a flame attribute, a frost attribute and an electrical attribute Interlocking with a content reproducing device for executing an electronic game including an enemy character attacking the player; Outputting a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when the player is hit by the attacking action having the flame attribute in the game; Applying a reverse voltage for the heat absorbing operation to the thermoelectric element to output cold feedback when the player is hit by the attack action having the cold air attribute in the game; And a controller for simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation when the player is shot by the attacking action having the electric attribute in the game to output thermal sensation feedback A method of providing a thermal experience comprising:

According to still another aspect of the present invention, there is provided a content playback device for executing an electronic game including an enemy character attacking the player by performing an attacking action having a player and an element attribute including a flame attribute, And a feedback device for outputting thermal feedback corresponding to an attribute of the attack action when a player shoots an attack event shot by the attack action, the feedback device comprising: a heat generating operation, an endothermic operation, and a combination of the heat generating operation and the heat absorbing operation A power terminal for supplying power to the thermoelectric element, and a contact surface provided on one side of the thermoelectric element and in contact with the body part of the user, wherein the contact surface To the user < RTI ID = 0.0 > By month heat output module for outputting the thermal feedback; And outputting a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when the shooting event occurs due to the attacking action having the flame attribute, so that the shooting event having the cold- And outputs a cold feedback to the thermoelectric element by applying a reverse voltage that is opposite to the positive voltage and the power application direction for the heat absorbing operation to output the cold feedback. When the hit event occurs due to the attack action having the electrical attribute, And a feedback controller for applying the constant voltage and the reverse voltage simultaneously or alternately for outputting heat trapping feedback for the thermal grill operation.

Here, the thermoelectric element is provided as a thermocouple array including a plurality of individually thermocouple controllable groups, and the feedback controller controls the thermocouple group when the attacking event occurs due to the attacking action having the electric property, The positive voltage may be applied to the first group, and the reverse voltage may be applied to the second group which is another part of the thermocouple group.

According to yet another aspect of the present invention, there is provided a content reproduction device for driving an electronic game, a display for outputting the video game image, and a feedback device for interfacing with the content reproduction device and outputting thermal feedback using a thermoelectric element Wherein the content playback device is configured to perform an attacking action with a first communication module and a player communicating with the feedback device and an element attribute including a flame attribute, Wherein the type of the thermal feedback is determined based on the element attribute of the attack action when a shooting event in which the player is shot by the attack action occurs in the game, , An attack action of the flame attribute The type of the thermal feedback is determined as the warm feedback, and the type of the thermal feedback is determined as the cold feedback for the hit event based on the attack of the cool air attribute, Determining a type of the thermal feedback as a thermal sensation feedback for the shot event, transmitting the kind of thermal feedback to the feedback device through the first communication module, outputting a shot graphic according to the shot event through the display Wherein the feedback device includes a thermoelectric element that performs a thermoelectric operation including a heat generating operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined, A power supply terminal for supplying power and A thermal output module provided on one side of the thermoelectric element and including a contact surface contacting the body part of the user and outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface, Receiving a type of the thermal feedback through a second communication module for communicating with the reproducing device and the second communication module and applying the power to the thermoelectric element so that the received kind of thermal feedback is outputted, The control unit applies a constant voltage for the heat generation operation to the thermoelectric element when received, and applies a reverse voltage for the heat absorption operation to the thermoelectric element when the cold feedback is received, The constant voltage and the reverse voltage may be simultaneously or alternately A feedback controller which is applied as can be provided with a thermal experience providing system.

 According to yet another aspect of the present invention there is provided a method of providing a thermal experience for an electronic game, the method being performed by a content reproduction device operable with a feedback device that drives an electronic game and outputs thermal feedback using a thermoelectric element Executing an action having an element attribute including a flame attribute, a frost attribute, and an electrical attribute; The player activating the action according to a user input indicating the action; Outputting a graphic for the action; Determining a kind of the thermal feedback based on the element attribute of the action, determining the type of the thermal feedback as the warm-feeling feedback with respect to the action of the flame attribute, and determining the type of the thermal feedback as the cold- Determining the type of thermal feedback as thermal feedback feedback for the action of the electrical attribute; And controlling the feedback device to output the thermal feedback together with the graphic of the action, wherein when the thermal feedback is the warm feedback, control is performed so that the thermoelectric element starts a heating operation, and when the thermal feedback is the cold feedback, Controlling a thermoelectric element to initiate a heat absorbing operation and controlling the thermoelectric element to initiate a thermal grill operation in which the thermoelectric element and the heat absorbing operation are combined when the thermal feedback is the thermal sensory feedback A method can be provided.

Here, the action may include at least one of an attacking action for attacking enemy characters and a buffing action for helping the player.

Here, the action is an attacking action for attacking enemy characters, and the intensity of the thermal feedback based on at least one of an attack power of the attack action, an attribute of a skill associated with the attack action, and an attribute of the weapon associated with the attack action Wherein the controlling of the feedback device controls the thermal feedback to be output in accordance with the determined intensity, wherein the attribute of the skill is a level of the skill, an amount of damage of the skill, and the same Wherein the attributes of the weapon include a rating of the weapon, an attack power of the weapon, a rating of the projectile being fired by the weapon, and a rating of the weapon in the skill tree including a plurality of skills having elemental attributes, It can include attack power.

Here, in the step of controlling the feedback device, it is possible to control the thermal feedback to be output during the casting time when casting time is required in the game in the step of controlling the feedback device.

Here, in the step of controlling the feedback device, it is possible to control the intensity of the output thermal feedback to be increased during the casting time.

Here, in the step of controlling the feedback device, it is possible to control to output the thermal feedback during the holding time when the result of the action is maintained during the holding time at the time of the action in the game.

Here, in the step of controlling the feedback device, it is possible to control the intensity of the output thermal feedback to be decreased during the holding time.

Here, the electronic game may include a 2D game, a VR game, and an AR game.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And a player performing an action having an element attribute including a flame attribute, a freezing attribute, and an electric attribute, causing the player to play the action according to a user input indicating the action, The type of the thermal feedback is determined based on the element attribute of the action, the type of the thermal feedback is determined as the warm feedback for the action of the flame attribute, The type of the thermal feedback is judged as the cold feedback, the type of the thermal feedback is judged as the thermal sensation feedback for the action of the electric attribute, and the thermal feedback is outputted together with the graphic of the action To control the feedback device And controls the thermoelectric element to start the heat generating operation when the thermal feedback is the warm feedback, and controls the thermoelectric element to start the heat absorbing operation when the thermal feedback is the cold feedback, And the controller controls the thermoelectric element to start the thermal grill operation in which the heat generating operation and the heat absorbing operation are combined.

Here, the action may include at least one of an attacking action for attacking enemy characters and a buffing action for helping the player.

Here, the action is an attacking action for attacking the enemy character, and the controller is configured to determine, based on at least one of the attack power of the attack action, the attribute of the skill associated with the attack action, and the attribute of the weapon associated with the attack action, And the feedback device controls the feedback device to output the thermal feedback in accordance with the determined strength through the communication module, and the attribute of the skill is determined based on the level of the skill, the damage amount of the skill, Wherein the attribute of the weapon includes at least one of a rating of the weapon, an attack power of the weapon, a rating of the projectile fired by the weapon, and an attack power of the projectile on a skill tree including a plurality of skills .

Here, the controller may control the feedback device to output the thermal feedback during the casting time when a casting time is required in the game in the actuation of the action.

Here, the controller may control the intensity of the output thermal feedback to be increased during the casting time.

Here, the controller may control the feedback device to output the thermal feedback during the holding time when the result of the action is maintained during the holding time at the time of the action in the game.

Here, the controller may control the intensity of the output thermal feedback to be reduced during the holding time.

According to still another aspect of the present invention, heat generated by a thermoelectric operation including a heat generating operation, an endothermic operation, and a heat grill operation in which the heat generating operation and the heat absorbing operation are combined is applied to a user's body part A player performing an attacking action having an elemental attribute including a flame attribute, a frost attribute and an electrical attribute, the method comprising the steps of: Interlocking with a content reproducing device that executes an electronic game including; When the player performs the attacking action with the flame attribute in the game, applying a constant voltage for the heat generating operation to the thermoelectric element to output a warm-feeling feedback; When the player performs the attacking action with the cold-air attribute in the game, applying a reverse voltage for the heat-absorbing operation to the thermoelectric element to output cold feedback; And a controller for simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation when the player performs the aggressive action with the electric attribute in the game, And a step of outputting the thermal experience.

According to yet another aspect of the present invention, in cooperation with a content playback device that executes an electronic game including a player who performs an attack action having an element attribute including a flame attribute, a freezing attribute, and an electric attribute, A feedback device for outputting thermal feedback corresponding to an element attribute of the attack action when performing an action, the feedback device comprising: an input module for obtaining a user input; A thermoelectric element for performing a thermoelectric operation including a heat generating operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined, a power supply terminal for supplying power to the thermoelectric element, A thermal output module including a contact surface contacting the body part of the user and outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface; And outputting a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when a user input indicating the attack action having the flame attribute is obtained through the input module, Wherein the control unit applies a reverse voltage that is opposite to the positive voltage and the power supply direction for the heat absorbing operation to output cold feedback to the thermoelectric element, And a feedback controller for simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation to output thermal sensation feedback when a user input indicating the attack action having the attribute is acquired A feedback device may be provided.

Here, the thermoelectric element is provided as a thermocouple array including a plurality of individually thermocouple controllable thermo couple pairs, and the feedback controller is operable, when a user input indicating the attack action having the electric property is obtained, When the event occurs, the constant voltage may be applied to the first group, which is a part of the thermocouple group, and the reverse voltage may be applied to the second group, which is another part of the thermocouple group.

According to yet another aspect of the present invention, there is provided a device for playing a multimedia content, the content being played by a content playback device operable with a feedback device that drives multimedia content including an electronic game and a haptic application and outputs thermal feedback using a thermoelectric element, Wherein the virtual object includes a player and a virtual object, wherein the virtual object implements a shooting event in which the player is struck by the virtual object, and wherein the multimedia content providing the player with thermal resistance to the shooting event ; Generating the hit event for the player in the game; Setting an intensity of the thermal feedback based on the shot event; Adjusting the intensity of the thermal feedback based on the thermal resistance imparted to the player; And controlling the feedback device to output the thermal feedback of the adjusted intensity.

Here, the shot event includes at least a warm-feeling shooting event and a cold-feeling shooting event, the thermal feedback includes at least warm-feeling feedback and cold-feeling feedback, and determines the type of the thermal feedback based on the type of the shot- Further comprising: controlling the feedback device to output the thermal feedback of the determined type in the controlling step.

Here, the thermal resistance imparted to the player includes at least a cold resistance corresponding to a warm-feeling resistance and a cold-feeling event corresponding to a warm-feeling event, and in the adjustment, the thermal resistance corresponding to the type of the shooting event The intensity of the thermal feedback can be adjusted based on the resistance.

Here, the method may further include calculating the thermal resistance of the player based on the thermal resistance inherent to the player and the thermal resistance imparted to the equipment mounted on the player.

Here, in the step of adjusting the intensity, the intensity of the thermal feedback can be reduced.

Wherein the intensity of the thermal feedback includes a plurality of classes and the setting of the intensity comprises selecting a specific grade of the plurality of classes as the intensity of the thermal feedback for the shot event, The adjusting step may downgrade the selected particular grade to a lower grade.

Here, in the step of adjusting the intensity, the downward degree of the grade can be determined based on the thermal resistance.

Here, in the step of adjusting the intensity, the intensity of the thermal feedback can be adjusted to at least the lowest grade.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And multimedia provided in the form of an electronic game or a haptic application that includes a player and a virtual object, implements a hit event in which the player is hit by the virtual object, and provides the player with thermal resistance to the hit event And sets the strength of the thermal feedback based on the shot event when the shot event for the player occurs in the game, and sets the strength of the thermal feedback based on the thermal resistance imparted to the player And a controller for controlling the feedback device to output the thermal feedback of the adjusted intensity through the communication module.

Here, the hit event includes at least a warm-fire hit event and a cold hit event, and the thermal feedback includes at least warm feedback and cold feedback, and the controller is configured to determine, based on the type of the hit event, Determine the type, and control the feedback device to output the thermal feedback of the determined type.

Here, the thermal resistance imparted to the player includes at least a cold resistance corresponding to a warm-feeling resistance and a cold-feeling event corresponding to a warm-feeling event, and the controller controls the thermal resistance corresponding to the type of the shooting event The intensity of the thermal feedback can be adjusted on the basis of the following equation.

Here, the controller can calculate the thermal resistance of the player based on the thermal resistance inherent to the player and the thermal resistance imparted to the equipment mounted on the player.

Here, the controller may reduce the intensity of the thermal feedback according to the thermal resistance.

Wherein the intensity of the thermal feedback includes a plurality of grades and the controller selects a specific grade of the plurality of grades as the intensity of the thermal feedback for the shot event, The selected grade can be lowered to a lower grade.

Here, the controller can determine the downward degree of the grade based on the thermal resistance.

Here, the controller can adjust the intensity of the thermal feedback to at least the lowest grade.

According to yet another aspect of the present invention there is provided an electronic game system including a player and a virtual object, implementing an attack event in which the player is hit by the virtual object, and providing the player with thermal resistance to the attack event CLAIMS What is claimed is: 1. A feedback device interlocked with a content playback device for driving multimedia content provided in the form of a tactile application, comprising: a casing including a gripper gripped by a user and forming an appearance of the feedback device; An input module for receiving a user input according to an operation of the user; A communication module for communicating with the content reproduction device; And a contact surface which is provided in the grip portion and transmits heat generated by the thermoelectric action of the thermoelectric element to the user, wherein the contact surface A thermal output module for outputting the thermal feedback by transmitting heat generated by the thermoelectric conversion operation to the user through the thermoelectric conversion module; And transmitting the user input to the content reproduction device via the communication module so that the player operates in accordance with the user operation, wherein the user input is received through the input module, Receiving an intensity of the thermal feedback from the device, selecting an operating voltage among a plurality of predetermined voltage values based on the intensity of the thermal feedback, generating an operating power based on the operating voltage, And a controller for applying the operating power to the power terminal so as to output thermal feedback, wherein when the thermal resistance given to the player is a first value, when a shooting event occurs in the multimedia, The first operation voltage is applied to the first A feedback device may be provided to apply a second operating voltage greater than the first operating voltage to the thermoelectric device when a shooting event occurs in the multimedia, when the thermal resistance applied to the thermoelectric device is a second value greater than the first value have.

According to yet another aspect of the present invention, there is provided a content playback apparatus for playing back multimedia content provided by an electronic game and a sensible application, the content playback device being interlocked with a feedback device for outputting thermal feedback using a thermoelectric element, Driving the multimedia content including a thermal event that causes the thermal feedback, a player, and equipment mounted on the player and equipped with thermal resistance to the thermal event; Determining whether the player is equipped with the equipment when the thermal event occurs; Obtaining a first intensity as an intensity of the thermal feedback if the player does not mount the equipment; Obtaining an adjusted second intensity from the first intensity as the intensity of the thermal feedback when the player is equipped with the equipment; And controlling the feedback device to output the thermal feedback in accordance with the obtained intensity.

Here, the second intensity may be smaller than the first intensity.

Here, in the step of acquiring the second intensity, the second intensity may be calculated in consideration of the first intensity and the thermal resistance imparted to the equipment.

According to yet another aspect of the present invention, there is provided a content playback apparatus for playing back multimedia content provided by an electronic game and a sensible application, the content playback device being interlocked with a feedback device for outputting thermal feedback using a thermoelectric element, Driving the multimedia content including a thermal event that causes the thermal feedback, a player, and equipment mounted on the player and equipped with thermal resistance to the thermal event; Determining whether the player is equipped with the equipment when the thermal event occurs; And determining whether the thermal feedback corresponding to the thermal event is output based on whether or not the player is mounted on the equipment; And controlling the feedback device so that the thermal feedback is output only when the player does not mount the equipment.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And a device, mounted on the player and equipped with thermal resistance to the thermal event, for driving the multimedia content provided by the electronic game and the sensible application, the thermal event causing the thermal feedback, When the player is not equipped with the equipment, the first strength is acquired as the strength of the thermal feedback, and when the player is equipped with the equipment, And a controller for obtaining the adjusted second intensity from the first intensity as the intensity of the thermal feedback and controlling the feedback device to output the thermal feedback according to the obtained intensity via the communication module A device may be provided.

Here, the second intensity may be smaller than the first intensity.

Here, the controller may calculate the second intensity in consideration of the first intensity and the thermal resistance imparted to the equipment.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And a device, mounted on the player and equipped with thermal resistance to the thermal event, for driving the multimedia content provided by the electronic game and the sensible application, the thermal event causing the thermal feedback, Determines whether or not the player is mounted on the equipment, and determines whether the thermal feedback corresponding to the thermal event is output based on whether the player is mounted on the equipment, And a controller for controlling the feedback device through the communication module so that the thermal feedback is output only when the module is not mounted.

According to yet another aspect of the present invention there is provided an electronic game system comprising a thermal event that causes thermal feedback, a player, and equipment mounted on the player and provided with thermal resistance to the thermal event, CLAIMS What is claimed is: 1. A feedback device interlocked with a content playback device for driving content, comprising: a casing including a gripper gripped by a user and defining an appearance of the feedback device; An input module for receiving a user input according to an operation of the user; A communication module for communicating with the content reproduction device; And a contact surface which is provided in the grip portion and transmits heat generated by the thermoelectric action of the thermoelectric element to the user, wherein the contact surface A thermal output module for outputting the thermal feedback by transmitting heat generated by the thermoelectric conversion operation to the user through the thermoelectric conversion module; And transmitting the user input to the content reproduction device via the communication module so that the player operates in accordance with the user operation, wherein the user input is received through the input module, And a controller for receiving a message requesting the output of the thermal feedback from the device and for applying operating power to the power terminal so that the thermal output module outputs the thermal feedback upon receipt of the message, A first operation for outputting the thermal feedback when the thermal event is generated during the reproduction of the multimedia contents, a first operation for reflecting whether the equipment is mounted on the player or not by outputting the thermal feedback, To reflect the intensity adjustment of the second Wherein the first operation is an operation of applying the operating voltage when the player does not mount the equipment and not applying the operating voltage when the player is equipped with the equipment, 2 operation is an operation of applying a first operating voltage when the player does not mount the equipment and a second operating voltage which is smaller than the first operating voltage when the player is equipped with the equipment, May be provided.

 According to yet another aspect of the present invention there is provided a method of providing a thermal experience performed by a content playback device associated with a feedback device that outputs thermal feedback using a thermoelectric device, Driving an electronic game including a player who is dead when the player has exhausted all of the physical strength points; obtaining at least one of the strength and the type of the thermal feedback according to the change of the physical strength point during the progress of the electronic game; And controlling the operation of the feedback device to output the thermal feedback according to at least one of the obtained strength and type, wherein the acquiring step includes: Obtaining the intensity of the thermal feedback in accordance with the ratio of the change amount to the maximum value of the fitness points, and calculating the type of the thermal feedback according to whether the change of the fitness points is increase or decrease. Acquiring a thermal feedback signal, and acquiring the thermal feedback signal.

Here, in the step of acquiring the intensity of the thermal feedback according to the magnitude of the change amount of the fitness point, the first strength is obtained when the change amount is the first value, and when the change amount is the second value larger than the first value A second strength higher than the first strength can be obtained.

Here, in the step of acquiring the intensity of the thermal feedback according to the ratio of the change amount to the maximum value of the fitness point, when the ratio of the change amount is the first value, the first intensity is obtained, And a second intensity higher than the first intensity may be obtained when the second value is greater than the first value.

Here, in the step of acquiring the kind of the thermal feedback depending on whether the change of the fitness point is increase or decrease, one of the warm feedback and the cold feedback is selected as the type of the thermal feedback when the fitness point is increased , And selecting one of the warm feedback and the cold feedback as the type of the thermal feedback when the fitness point is decreased.

According to yet another aspect of the present invention there is provided a method of providing a thermal experience, performed by a content reproduction device operatively associated with a feedback device that outputs thermal feedback using a thermoelectric element, A step of driving an electronic game including a player who dies when the player has exhausted all of the physical points with a point, and a step of playing an electronic game including at least one of the remaining amount of the physical points and the ratio of the remaining amount to the maximum number of physical points Determining at least one of output power, intensity and type of the thermal feedback; And controlling the operation of the feedback device so that the thermal feedback according to at least one of the determined output power, intensity, and type is output.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And an electronic game which is operated by a user's operation and which has a physical strength point and which dies when the physical strength point is exhausted to the full of the physical strength points, And a controller for controlling the operation of the feedback device through the communication module so as to obtain at least one of the obtained strength and type and the thermal feedback according to at least one of the obtained strength and type, Determining a strength of the thermal feedback based on any one of a magnitude of a variation amount of the fitness point and a ratio of the variation amount to a maximum value of the fitness point, A content playback device may be provided that determines the type of content .

Here, the controller may acquire a first intensity when the amount of change is a first value, and a second intensity that is stronger than the first intensity when the amount of change is a second value that is larger than the first value.

Here, the controller obtains the first intensity when the ratio of the change amount to the maximum value is the first value, and when the ratio is the second value that is larger than the first value, A strong second strength can be obtained.

Here, the controller selects one of the warm feedback and the cold feedback as the kind of the thermal feedback when the fitness point is increased, and the other one of the warm feedback and the cold feedback when the fitness point is decreased, You can choose the type of feedback.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And an electronic game which is operated by a user's operation and which includes a player who has a physical strength point and who dies upon exhaustion of the entire physical strength point, and controls the remaining amount of the physical strength point during the progress of the electronic game, Intensity and type of the thermal feedback in accordance with at least one of the ratio of the output of the thermal feedback to the output of the thermal feedback, And a controller for controlling the operation of the feedback device through the module.

According to yet another aspect of the present invention, there is provided a feedback device operable by a user's operation and associated with a content reproduction device for driving an electronic game including a player having a fitness point and dying upon exhaustion of the entire fitness point, A casing including a grip portion gripped by a user and forming an appearance of the feedback device; An input module for receiving a user input according to an operation of the user; A communication module for communicating with the content reproduction device; And a contact surface which is provided in the grip portion and transmits heat generated by the thermoelectric action of the thermoelectric element to the user, wherein the contact surface A thermal output module for outputting the thermal feedback by transmitting heat generated by the thermoelectric conversion operation to the user through the thermoelectric conversion module; And acquiring the user input received through the input module and transmitting the user input to the content reproduction device through the communication module so that the player operates according to the user operation, And a controller for applying operating power to the power terminal so that the thermal output module outputs the thermal feedback, wherein the controller is configured to determine whether the change amount of the fitness point or the ratio of the change amount to the total amount of the fitness point A first operation for applying a first operating voltage in case of a first value and applying a second operating voltage greater than the first operating voltage when a variation of the fitness point or a ratio of the variation is a second value larger than the first value, For constant voltage or cold feedback for warm-up feedback when the fitness point is increased A second operation for applying either one of a constant voltage for warm-up feedback or a reverse voltage for cold feedback when the fitness point is decreased and a second operation for applying the remaining amount of the fitness point or the remaining amount The third operating voltage is applied when the ratio of the third operating voltage to the third operating voltage is greater than the third operating voltage and the fourth operating voltage is greater than the third operating voltage when the ratio of the remaining amount or the remaining amount is the fourth value A feedback device may be provided that performs at least one of the operations.

 According to yet another aspect of the present invention there is provided a method of providing a thermal experience performed by a content reproducing device in conjunction with a feedback device that outputs thermal feedback using a thermoelectric element, Driving multimedia content in the form of an electronic game or a haptic application providing a virtual heat source to be imparted; Determining a virtual amount of heat received from the virtual heat source by the player of the multimedia contents in consideration of the heat transfer property; Determining the thermal feedback intensity according to the calculated virtual heat amount; And controlling the feedback device so that the thermal feedback is output in accordance with the determined intensity, wherein the step of determining the virtual calorie content comprises: determining, when the player is in contact with the virtual heat source of the conductive type, Calculating the amount of heat based on the temperature value of the heat source and calculating the virtual heat amount based on the distance between the player and the virtual heat source and the temperature value of the virtual heat source for the radiation type virtual heat source A method of providing a thermal experience can be provided.

The step of determining the amount of virtual heat may further include determining that the amount of heat is '0' when the virtual heat source of the conductive type is separated from the player or determining that there is no amount of the virtual heat have.

Here, in the step of calculating the virtual heat amount for the radiant type virtual heat source, the virtual heat source can be calculated to be larger as the spacing distance is smaller.

Here, in the step of calculating the virtual heat quantity for the radiant type virtual heat source, when the separation distance is the first distance, the virtual heat quantity is obtained as the first heat quantity, and if the separation distance is smaller than the first distance And the virtual heat quantity can be obtained as the second heat quantity which is larger than the first heat quantity in the case of the second distance.

The method further includes the step of calculating the virtual heat amount based on the temperature of the virtual heat source with respect to the virtual heat source of the directive type, And the same virtual heat amount is equal even when the distance between the player and the virtual heat source is different.

In this case, the heat transfer attribute further includes an area type, and the step of judging the amount of virtual heat is a step of, when the player is within a predetermined distance from the virtual heat source for the virtual heat source of the area type, And calculating the virtual calorie amount based on the temperature value of the hypothetical calorie.

Determining whether the type of the thermal feedback includes the warm feedback and the cold feedback based on whether the calculated heat amount is negative or positive; and in the controlling step, Thereby controlling the feedback device such that the thermal feedback is output.

According to yet another aspect of the present invention, there is provided a content reproducing device operable with a feedback device for outputting thermal feedback using a thermoelectric element, comprising: a memory for storing data; A communication module for communicating with an external device; And a virtual heat source to which a heat transfer property including a conduction type and a radiation type is imparted, and in which the player of the multimedia content plays the virtual And a controller for determining the amount of virtual heat received from the heat source, determining the thermal feedback intensity according to the calculated amount of virtual heat, and controlling the feedback device to output the thermal feedback according to the determined intensity, , Calculating the amount of heat based on the temperature value of the virtual heat source when the player comes into contact with the virtual heat source of the conduction type and calculating a distance between the player and the virtual heat source Based on the temperature value of the virtual heat source W is the content playback device to calculate the virtual amount of heat can be provided.

Here, the controller may determine that the amount of heat is '0' or that there is no amount of virtual heat when the conductive heat source of the conductive type is separated from the player.

In this case, the controller can calculate the virtual heat source as the spacing distance becomes smaller with respect to the radiation heat source of the radiation type.

Here, the controller obtains the virtual heat quantity as a first heat quantity when the distance between the radiating type virtual heat source and the player is a first distance, and when the distance between the virtual heat source of the radiation type and the player is And to obtain the virtual heat amount as the second heat amount larger than the first heat amount when the second distance is smaller than the first distance.

The controller may calculate the virtual heat amount based on the temperature of the virtual heat source with respect to the virtual heat source of the directive type, Even when the distance between the heat sources is different.

The thermal transfer property further includes an area type, and the controller is configured to calculate, based on the temperature value of the virtual heat source when the player is within a predetermined distance from the virtual heat source, So that the virtual heat quantity can be calculated.

Here, the controller may determine the kind of the thermal feedback including the warm feedback and the cold feedback based on whether the calculated heat amount is a negative number or a positive number, and in the controlling step, The feedback device may be controlled to output thermal feedback.

According to yet another aspect of the present invention, there is provided a feedback device for outputting, as thermal feedback, a virtual heat quantity received from a virtual heat source by a player in cooperation with a content reproducing device for driving an electronic game or a haptic application including a virtual heat source, A thermoelectric element for performing a thermoelectric operation including an operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined, a power terminal for supplying power to the thermoelectric element, A thermal output module including a contact surface contacting the body part of the body and outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface; And applying a first power to the power terminal for outputting the thermal feedback reflecting the amount of virtual heat conducted to the player from the first virtual heat source when the player is in contact with the first virtual heat source, When the player is away from the first imaginary heat source by a first distance from the second imaginary heat source having a heat transfer property different from that of the first imaginary heat source, Applying a second power source to the power terminal for outputting the thermal feedback reflecting the amount of virtual heat radiated from the virtual heat source to the player, wherein the player moves the second distance from the second virtual heat source to a second distance A controller for applying a third power greater than the second power to the power terminal; A feedback device may be provided.

 In accordance with yet another aspect of the present invention there is provided a method of providing a thermal experience to a user of a multimedia content in the form of an electronic game or a haptic application performed by a content playback device interfaced with a feedback device using a thermoelement to output thermal feedback A method for providing a multimedia content, the method comprising: providing a virtual object having a column attribute including a player and temperature information and material information, the multimedia content being provided by an interaction including a touch or a grab of the player with respect to the virtual object ; Changing the strength of the thermal feedback according to the interaction duration, the temperature information, and the material information while the interaction between the player and the virtual object is maintained according to an operation of the user; And controlling the feedback device to output the thermal feedback in accordance with the intensity.

Setting a maximum intensity of the thermal feedback based on the temperature information; And fixing the intensity of the thermal feedback to the maximum intensity when the intensity of the thermal feedback reaches the maximum intensity.

Here, in the step of changing the intensity, the degree of change of the intensity per time can be adjusted based on the material information.

According to yet another aspect of the present invention, there is provided a content reproduction device operable in conjunction with a feedback device for outputting thermal feedback using a thermoelectric element and for driving multimedia contents in the form of an electronic game or a sensible application, A power terminal for supplying power for the thermoelectric conversion to the thermoelectric element, and a contact surface provided on one side of the thermoelectric element and contacting the body part of the user, A thermal output module for outputting thermal feedback by transmitting heat generated by the thermoelectric operation to the user through the thermoelectric module; And a memory for storing data; A communication module for performing communication with an external device; And a virtual object to which a player and a column attribute are assigned, wherein the player operates the multimedia content provided by an interaction including a touch or a grab on the virtual object of the player, Wherein the controller is configured to change the intensity of the thermal feedback according to the duration of the interaction and the temperature value and the material value of the thermal attribute while the interaction between the virtual objects is maintained, And a controller for controlling the feedback device through the control unit.

Here, the controller may set the maximum intensity of the thermal feedback based on the temperature information, and may fix the intensity of the thermal feedback to the maximum intensity when the intensity of the thermal feedback reaches the maximum intensity .

Here, the shrinking controller can adjust the degree of change of the strength per hour based on the material value.

According to yet another aspect of the present invention, there is provided a computer program product comprising a player and a virtual object, wherein the player is capable of operating the multimedia content in the form of an electronic game or a haptic application provided by an interaction including touching or grabbing on the virtual object A feedback device that is interlocked with the content playback device and that receives a user operation, the casing including a grip portion gripped by the user and forming an appearance of the feedback device; An input module for receiving a user input according to an operation of the user; A communication module for communicating with the content reproduction device; And a contact surface which is provided in the grip portion and transmits heat generated by the thermoelectric action of the thermoelectric element to the user, wherein the contact surface A thermal output module for outputting the thermal feedback by transmitting heat generated by the thermoelectric conversion operation to the user through the thermoelectric conversion module; And a feedback controller for increasing a voltage of the power source applied to the thermoelectric element while the interaction is maintained when the interaction between the player and the virtual object is started according to an operation of the user Can be provided.

Here, the feedback controller increases the voltage of the power source to a first speed when the virtual object is a wooden material, and increases the voltage of the power source to a second speed that is faster than the first speed when the virtual object is a metal material .

Here, the feedback controller may set the maximum value of the voltage to be different when the temperature of the virtual object is different.

Here, the feedback controller may set the increase rate of the voltage to be different when the material of the virtual object is different.

According to yet another aspect of the present invention, there is provided a collision method for calculating a behavior of the virtual objects in consideration of at least a momentum for a collision event between virtual objects, and a trigger for allowing a virtual object to transmit another virtual object Executing a game using a physics engine that supports a conflict processing method including a method; Determining whether the collision processing method of the shooting event for the player character is the collision method or the trigger method; Determining the strength of the thermal feedback based on the determination result; And controlling the intensity of the thermoelectric action of the feedback device outputting the thermal feedback using the thermoelectric device according to the intensity of the thermal feedback.

The step of determining the intensity of the thermal feedback may include the step of determining the intensity of the thermal feedback based on the momentum calculated according to the collision method when the collision processing method of the shot event is the collision method .

Here, the intensity of the thermal feedback can be determined more strongly as the calculated momentum is larger.

The step of determining the intensity of the thermal feedback may include determining the intensity of the thermal feedback as a predetermined value when the collision processing method of the shot event is the trigger method.

Here, the step of determining the intensity of the thermal feedback may include the step of determining the intensity of the thermal feedback based on the identification information of the impacted object hitting the player character and the identification information of the projectile that launched the impacted object And determining the strength of the thermal feedback according to at least one of the steps.

According to yet another aspect of the present invention there is provided a content playback device operable with a feedback device utilizing a thermoelectric device, comprising: a memory for storing data; A communication module in communication with the feedback device; A collision method for calculating the behavior of the virtual objects in consideration of at least a momentum for a collision event between virtual objects, and a trigger method for allowing a virtual object to transmit another virtual object And determines the strength of the thermal feedback based on the determination result, and the thermal feedback control unit determines the strength of the thermal feedback based on the determination result, And a controller for controlling the intensity of the thermoelectric action of the feedback device for outputting the thermal feedback using the thermoelectric element according to the intensity of the thermoelectric element.

Here, the controller may determine the intensity of the thermal feedback based on the momentum calculated according to the collision method when the collision processing method of the shot event is the collision method.

Here, the intensity of the thermal feedback can be determined more strongly as the calculated momentum is larger.

Here, the controller may determine the intensity of the thermal feedback as a predetermined value when the collision processing method of the shot event is the trigger method.

Here, the controller may further include a thermal feedback control unit for controlling the thermal feedback according to at least one of the identification information of the impacted object hit by the player character and the identification information of the projected object that fired the impacted object, Can be determined.

 According to yet another aspect of the present invention there is provided a method of providing a thermal experience performed by a content playback device interfaced with a plurality of feedback devices outputting thermal feedback using a thermoelectric element and reproducing the multimedia content, Displaying an image of the virtual space through a field of view (FOV) according to a direction of a user's gaze detected by the HMD; Determining a target feedback device to output the thermal feedback among the plurality of feedback devices based on a direction of occurrence of the thermal event for the clock when a thermal event occurs in the virtual space; And transmitting a signal indicative of an output of the thermal feedback to the target feedback device.

Here, in the determining step, when the thermal event occurs in the central area located at the center of the FOV, the first device held by the user's right hand and the second device held by the user's left hand among the plurality of devices The target feedback device can be determined.

Here, the method may further include controlling the first device and the second device to output the thermal feedback with the same intensity.

Here, in the determining step, when the thermal event occurs in one side of the central area, only the feedback device held in the hand of the first device and the second device in the same direction as the one side is determined as the target device .

Here, in the determining step, the first device and the second device may be determined as the target device when the thermal event occurs in one side of the central area, and the thermal and thermal characteristics of the first device and the second device, The strength can be set differently.

Here, in the determining step, the device corresponding to one side of the target device on which the thermal event occurs may be set to have a stronger thermal feedback strength than the other device.

According to yet another aspect of the present invention, there is provided a memory device comprising: a memory interlocked with a plurality of feedback devices outputting thermal feedback using a thermoelectric element and storing data in a content reproduction device for reproducing multimedia contents; A communication module in communication with the feedback device; And displaying an image of the virtual space through a field of view (FOV) in accordance with a direction of a user's sight detected from the HMD, and displaying a thermal event in the virtual space, Determines a target feedback device to output the thermal feedback among the plurality of feedback devices based on the direction of occurrence of the thermal event with respect to the clock, and outputs a signal indicating the output of the thermal feedback to the target feedback device And a controller for transmitting the content playback request to the content playback apparatus.

Here, when the thermal event occurs in a central area located at the center of the FOV, the controller controls the first device held by the user's right hand among the plurality of devices and the second device held by the left hand of the user, It can be judged as a feedback device.

Here, the controller can control the first device and the second device to output the thermal feedback with the same intensity.

Here, the controller may determine only the feedback device held in the hand in the same direction as the one of the first device and the second device as the target device when the thermal event occurs in one side of the central region .

Here, the controller may determine the first device and the second device as the target device when the thermal event occurs at one side of the central region, and determine the thermal intensity of the first device and the second device as Can be set differently.

Here, the controller may set the device corresponding to one side of the target device on which the thermal event occurs to have a stronger thermal feedback strength than the other device.

 According to yet another aspect of the present invention, there is provided a method of managing a virtual reality application, the method comprising: executing a virtual reality application that provides a virtual space including a virtual area to which a temperature property is assigned and a virtual object to which a temperature property is assigned; Controlling a feedback device that outputs thermal feedback using a thermoelectric element that performs a thermoelectric action to output the thermal feedback when an area event in which the player character enters the virtual area occurs; Controlling the feedback device to output the thermal feedback when an object event that interacts with the player character and the virtual object occurs; Detecting the occurrence of the object event during the generation of the area event; And stopping the output of the thermal feedback by the area event when the occurrence of the object event is detected during the occurrence of the area event, and controlling the feedback device to output the thermal feedback by the object event; May be provided.

Detecting an occurrence of a new area event during the generation of the object event; And controlling the feedback device to maintain the output of the thermal feedback by the object event when the occurrence of the new area event during the generation of the object event is detected, ignoring the output of the thermal feedback by the new area event, ; ≪ / RTI >

The method may further include the step of resuming the output of the thermal feedback by the area event when the output of the thermal feedback by the object event or the object event is terminated.

According to yet another aspect of the present invention, there is provided a memory device comprising: a memory interlocked with a plurality of feedback devices outputting thermal feedback using a thermoelectric element and storing data in a content reproduction device for reproducing multimedia contents; A communication module in communication with the feedback device; And a virtual reality application that provides a virtual space including a virtual object to which a temperature attribute is assigned and a virtual object to which a temperature attribute is assigned, and performs a thermoelectric action when an area event in which the player character enters the virtual area occurs A feedback device that outputs thermal feedback using a thermoelectric element is controlled to output the thermal feedback and controls the feedback device to output the thermal feedback when an object event that interacts with the player character and the virtual object occurs And a controller for detecting the occurrence of the object event during the generation of the area event and stopping the output of the thermal feedback by the area event when the occurrence of the object event is detected during the generation of the area event, It can be a content reproducing device including a service; a controller for controlling the feedback device to perform the output of the thermal feedback.

Here, the controller senses the occurrence of a new area event during the generation of the object event, and ignores the output of the thermal feedback due to the new area event when the occurrence of the new area event is detected during the generation of the object event And control the feedback device to maintain an output of thermal feedback by the object event.

Here, the controller may control the feedback device to resume the output of the thermal feedback by the area event when the output of the thermal feedback by the object event or the object event is terminated.

According to yet another aspect of the present invention, there is provided a virtual reality application for providing a virtual space including a virtual area to which a temperature attribute is assigned, the virtual area including a global area and a local area included in the global area Executing; Controlling a feedback device that outputs thermal feedback using a thermoelectric element that performs a thermoelectric operation to output thermal feedback corresponding to a temperature property of the global area when the player character enters the global area; And controlling the feedback device to stop outputting thermal feedback to the global area when the player character enters the local area and to output thermal feedback corresponding to the temperature attribute of the local area A method of providing a thermal experience can be provided.

And resuming output of thermal feedback to the global area when the player character is out of the local area.

According to yet another aspect of the present invention, there is provided a memory device comprising: a memory interlocked with a plurality of feedback devices outputting thermal feedback using a thermoelectric element and storing data in a content reproduction device for reproducing multimedia contents; A communication module in communication with the feedback device; And a virtual attribute to which a temperature attribute is assigned, wherein the virtual area includes a global area and a local area included in the global area, A feedback device for outputting thermal feedback using a thermoelectric element that performs a thermoelectric action is controlled so as to output thermal feedback corresponding to a temperature property of the global area, and when the player character enters the local area And a controller for controlling the feedback device to stop outputting thermal feedback for the global area and output thermal feedback corresponding to the temperature property of the local area.

Here, the controller may control the feedback device to resume outputting thermal feedback to the global area when the player character is out of the local area.

According to yet another aspect of the present invention, there is provided a method of reproducing multimedia content, the method comprising: reproducing multimedia content including an image and data on thermal feedback interlocked with a specific one of the images; Acquiring a power application time point set to a time point earlier than a reproduction time of the specific scene, in consideration of a delay time from a start of the thermoelectric action to a user's perception of thermal feedback by the thermoelectric action; A feedback device for outputting the thermal feedback using the thermoelectric element when the power application time is reached during the reproduction of the multimedia content so that the user can be provided with the specific scene and the thermal feedback interlocked with the specific scene, Transmitting a signal instructing power application to the power supply; And outputting the specific scene when the reproduction time of the specific scene is reached during reproduction of the multimedia content.

The power application time point may be a time point earlier than the reproduction time point of the specific scene by the delay time.

The thermal experience providing method may further include acquiring information on the strength of the thermal feedback from the data of the multimedia contents; And calculating the delay time based on the strength of the thermal feedback.

The delay time may increase as the intensity of the thermal feedback increases.

The thermal experience providing method may further include acquiring information on the type of the thermal feedback from the data of the multimedia contents, and in the calculating step, considering the type of the thermal feedback, Can be calculated.

The thermal experience providing method may further include: obtaining identification information of the feedback device; And calculating the delay time in consideration of the identification information of the feedback device.

The thermal experience providing method may further include receiving information on the delay time from the feedback device.

In addition, in the data of the multimedia contents, the reproduction time point of the thermal feedback is set to be equal to the reproduction time point of the specific scene, and in the step of acquiring the power application time point, the reproduction time point and the delay time of the thermal feedback are considered The power application time point can be calculated.

In addition, in the step of obtaining the power application time point, the power application time point may be calculated in consideration of the reproduction time point and the delay time of the specific scene.

In addition, in the step of obtaining the power application time point, the power application time point may be calculated in consideration of the reproduction time point and the delay time of the specific scene.

According to another aspect of the present invention, there is provided a method of playing an electronic game, the method comprising: executing an electronic game including a skill imparted with an element attribute including a flame, a chill, and a lightning; When the user input for instructing the activation of the skill is acquired, the type of thermal feedback set in consideration of the element attribute of the skill is obtained, and when the skill is the flame attribute, Acquiring cold feedback on the type of the thermal feedback when the skill is the cool air attribute and acquiring thermal sensation feedback on the type of the thermal feedback when the skill is the electric attribute; Controlling the thermoelectric operation of the feedback device that outputs the thermal feedback using the thermoelectric device according to the type of the thermal feedback, and controlling the feedback device to perform the heat generation operation when the type of the thermal feedback is the warm- Wherein the control device controls the feedback device to perform an endothermic operation when the kind of the thermal feedback is the cold feedback, and when the type of the thermal feedback is the thermal sensory feedback, the feedback device controls the heat generation operation and the heat absorption operation Controlling to perform a combined thermal grill operation; And a step of graphically outputting the skill.

The thermal experience providing method may further include obtaining the intensity of the thermal feedback set in consideration of at least one of the level of the skill, the damage, or the tier of the skill on the skill tree to which the skill belongs, , The intensity of the thermoelectric action of the feedback device can be controlled according to the intensity of the thermal feedback.

According to another aspect of the present invention, there is provided a method of playing an electronic game, the method comprising: executing an electronic game including a skill imparted with an element attribute including a flame, a chill, and a lightning; Wherein the type of thermal feedback is set in consideration of an element attribute of the skill when the shooting event is generated by the skill in the electronic game, and when the skill is the flame attribute, Acquiring cold feedback on the type of the thermal feedback when the skill is the cold characteristic and acquiring thermal sensation feedback on the type of the thermal feedback when the skill is the electrical characteristic; And controlling the thermoelectric action of the feedback device for outputting the thermal feedback using the thermoelectric element according to the type of the thermal feedback so that the thermal feedback corresponding to the elemental attribute of the skill is output together with the shot graphic according to the shot event Wherein the controller controls the feedback device to perform a heating operation when the type of the thermal feedback is the warm feedback, and controls the feedback device to perform a heat absorbing operation when the type of the thermal feedback is the cold feedback, And controlling the feedback device to perform the thermal grill operation in which the heat generating operation and the heat absorbing operation are combined when the kind of the thermal feedback is the thermal sensation feedback.

Further, the method for providing the thermal experience may further include obtaining the intensity of the thermal feedback set considering at least one of the level of the skill, the damage according to the shot event, or the tier of the skill on the skill tree to which the skill belongs And in the step of controlling the thermoelectric operation, the intensity of the thermoelectric action of the feedback device can be controlled according to the intensity of the thermal feedback.

Also, in the step of controlling the thermoelectric action, the holding time of the thermoelectric action of the feedback device can be controlled according to the duration of the debuff effect applied according to the hit event of the skill.

Further, in the step of controlling the thermoelectric action, it is possible to control the intensity of the thermoelectric action of the feedback device to decrease during the duration of the debuff effect.

According to another aspect of the present invention, there is provided a collision method for calculating a behavior of the virtual objects in consideration of at least a momentum for a collision event between virtual objects, and a trigger method for allowing a virtual object to transmit another virtual object Executing a game using a physics engine that supports a conflict processing method including: Determining whether the collision processing method of the shooting event for the player character is the collision method or the trigger method; Determining the strength of the thermal feedback based on the determination result; And controlling the intensity of the thermoelectric action of the feedback device outputting the thermal feedback using the thermoelectric device according to the intensity of the thermal feedback.

The step of determining the intensity of the thermal feedback includes the step of determining the intensity of the thermal feedback based on the momentum calculated according to the collision method when the collision processing method of the shot event is the collision method can do.

Further, the intensity of the thermal feedback can be determined more strongly as the calculated momentum is larger.

The step of determining the intensity of the thermal feedback may include determining the intensity of the thermal feedback as a predetermined value when the collision processing method of the hit event is the trigger method.

The step of determining the intensity of the thermal feedback may include determining at least one of the identification information of the impacted object hit by the player character and the identification information of the projected object that fired the impacted object when the collision processing method of the shot event is the trigger method And determining the strength of the thermal feedback according to the thermal feedback.

According to another aspect of the present invention, there is provided a method of providing a thermal experience performed by a content reproduction device that is interlocked with a plurality of feedback devices that output thermal feedback using a thermoelectric element and reproduces the multimedia content, Displaying an image of the virtual space through a field of view (FOV) in accordance with a direction of a user's sight detected by the HMD, the virtual reality application being executed; Determining a target feedback device to output the thermal feedback among the plurality of feedback devices based on a direction of occurrence of the thermal event for the clock when a thermal event occurs in the virtual space; And transmitting a signal indicative of an output of the thermal feedback to the target feedback device.

According to another aspect of the present invention, there is provided a method of providing a thermal experience performed by a content reproduction device that is interlocked with a plurality of feedback devices that output thermal feedback using a thermoelectric element and reproduces the multimedia content, Displaying an image of the virtual space through a field of view (FOV) in accordance with a direction of a user's sight detected by the HMD, the virtual reality application being executed; Determining a target feedback device to output the thermal feedback among the plurality of feedback devices based on a direction of occurrence of the thermal event for the clock when a thermal event occurs in the virtual space; And transmitting a signal indicative of an output of the thermal feedback to the target feedback device.

According to still another aspect of the present invention, there is provided a game control method comprising: executing a game including a player character having a health point; Generating thermal feedback information based on the fitness points; And controlling the thermoelectric action of the feedback device outputting the thermal feedback using the thermoelectric element based on the thermal feedback information.

In addition, the step of generating the thermal feedback information may determine the strength of the thermal feedback among the thermal feedback information based on the magnitude of the change amount when the fitness point is changed.

Further, the intensity of the thermal feedback can be largely determined as the change amount is large.

The step of generating the thermal feedback information may include determining whether the thermal feedback is output according to whether the fitness point is increased or decreased when the fitness point is changed.

The thermal experience providing method may further include generating the thermal feedback information by determining an output of the thermal feedback when the fitness point is decreased.

In addition, the step of generating the thermal feedback information may determine the type of the thermal feedback depending on whether the fitness point is increased or decreased when the fitness point is changed.

The step of generating the thermal feedback information may further include the steps of: determining a first thermal feedback, which is one of warm feedback and cold feedback, as the thermal feedback when the fitness point is increased; And determining the second thermal feedback, which is another one of the cold feedback, as the thermal feedback.

The step of generating the thermal feedback information may determine the strength and type of the thermal feedback among the thermal feedback information according to the ratio of the current physical point to the maximum physical point or the amount of the current physical point.

According to still another aspect of the present invention, there is provided a method for controlling a virtual object, comprising: executing a thermal experience application that outputs thermal feedback in accordance with a touch event for a virtual object; Acquiring a temperature attribute and a texture attribute assigned to the virtual object when a touch event for the virtual object occurs; Determining a type of thermal feedback including at least warm feedback and cold feedback based on the temperature attribute; Determining an intensity of the thermal feedback based on the texture attribute; And transmitting a thermal feedback start signal including a type and an intensity of the thermal feedback to a feedback device including a thermoelectric element that outputs the thermal feedback in accordance with thermoelectric operation .

According to still another aspect of the present invention, there is provided a method of providing a virtual space, the method comprising: driving multimedia contents such as a virtual reality application implementing a virtual space in which a virtual heat source is disposed; Determining the amount of heat received by the player character in the virtual space according to the virtual heat source; Determining an intensity of thermal feedback based on the determined calorie amount; And transmitting a thermal feedback start signal including the intensity of the thermal feedback to a feedback device including a thermoelectric element that outputs the thermal feedback in accordance with the thermoelectric action, Determining whether the heat transfer property of the heat source is a conduction type or a radiation type, and calculating the heat amount based on the heat transfer property of the virtual heat source and the distance to the player character .

Calculating the amount of heat based on the temperature value imparted to the virtual heat source only when the player character makes contact with the virtual heat source for the conductive heat source of the conductive type, And calculating the amount of heat as '0' when the heat is separated from the virtual heat source.

The step of calculating the heat amount may include calculating the heat amount based on the distance between the player character and the virtual heat source for the radiation type virtual heat source.

Calculating the amount of heat for the radiation type virtual heat source includes calculating the amount of heat as the distance is smaller when the radiation type heat source is a radiation heat source, Calculating the heat amount to a constant value according to the temperature imparted to the heat source irrespective of the distance when the heat source of the heat source is a direct heat source; and when the heat source of the radiation type is an area heat source, And calculating the amount of heat.

According to another aspect of the present invention, there is provided a method for managing a virtual reality application, the method comprising: executing a virtual reality application that provides a virtual space including a virtual area to which a temperature attribute is assigned and a virtual object to which a temperature property is assigned; Controlling a feedback device that outputs thermal feedback using a thermoelectric element that performs a thermoelectric action to output the thermal feedback when an area event in which the player character enters the virtual area occurs; Controlling the feedback device to output the thermal feedback when an object event that interacts with the player character and the virtual object occurs; Detecting the occurrence of the object event during the generation of the area event; And stopping the output of the thermal feedback by the area event when the occurrence of the object event is detected during the occurrence of the area event, and controlling the feedback device to output the thermal feedback by the object event; May be provided.

According to another aspect of the present invention, there is provided a virtual reality application providing a virtual space including a virtual area to which a temperature attribute is assigned, the virtual area including a global area and a local area included in the global area ; Controlling a feedback device that outputs thermal feedback using a thermoelectric element that performs a thermoelectric operation to output thermal feedback corresponding to a temperature property of the global area when the player character enters the global area; And controlling the feedback device to stop outputting thermal feedback to the global area when the player character enters the local area and to output thermal feedback corresponding to the temperature attribute of the local area A method of providing a thermal experience can be provided.

According to another aspect of the present invention, there is provided a method of playing a game, the method comprising: executing a game causing thermal feedback when a shooting event of a player character occurs; Setting an intensity of the thermal feedback according to the shot event; Obtaining a thermal resistance applied to the player character when the shooting event occurs; Correcting the intensity of the thermal feedback in consideration of the thermal resistance; And controlling the feedback device outputting the thermal feedback using the thermoelectric element performing the thermoelectric operation to output the thermal feedback in accordance with the intensity of the corrected thermal feedback can be provided .

The obtaining of the thermal resistance may include calculating a thermal resistance of the player character based on the player character's ability value and the thermal resistance value assigned to the player's character.

The step of correcting may include the steps of: determining the type of thermal feedback according to the shot event; determining a thermal resistance corresponding to the kind of the thermal feedback among the thermal resistance of the character; And correcting the intensity of the thermal feedback based on the thermal resistive force.

1. Thermal experience providing system

Hereinafter, a thermal experience providing system 1000 according to an embodiment of the present invention will be described.

1.1. Overview of Thermal Experience System

A thermal experience providing system 1000 according to an embodiment of the present invention is a system that allows a user to experience Thermal Experiences (TX). In particular, the thermal experience providing system 1000 may allow the user to experience thermal experiences by outputting thermal feedback as part of the presentation style of the content when reproducing the multimedia content.

Here, thermal feedback is a kind of thermal stimulus that stimulates a thermal sensation organ distributed mainly in the user's body to allow the user to feel a thermal sensation. In this specification, thermal feedback is applied to all thermal stimuli Should be construed to be inclusive.

Representative examples of thermal feedback include warm feedback and cold feedback. The warm feedback means applying a warmth to a hot spot distributed on the skin so that the user feels warm and the cold feedback is to apply a cold heat to a cold spot distributed on the skin so that the user feels cold feeling it means.

Here, since the column is a physical quantity expressed in a positive scalar form, the expression 'apply cold heat' or 'transmit cold heat' may not be strictly expressed from the physical viewpoint, but in the present specification, And the phenomenon in which the opposite phenomenon occurs, that is, the phenomenon of absorbing heat, is expressed as cold heat is applied or transmitted.

In addition, thermal feedback in this specification may further include thermal grill feedback in addition to warm feedback and cold feedback. When the heat and the cold are given at the same time, the user perceives it as a sensation instead of recognizing it as individual warmth and cold sensation. This sensation is referred to as a so-called thermal grill (TGI). That is, the thermal grill feedback means thermal feedback that applies a combination of heat and cold heat, and can be provided mainly by simultaneously outputting warm feedback and cold feedback. Thermal grill feedback may also be referred to as thermal sensory feedback in terms of providing a sensation close to intuition. A more detailed description of the thermal grill feedback will be provided later.

Here, the multimedia contents may include various kinds of contents including a moving picture, a game, a virtual reality application, an augmented reality application, and the like.

In general, the multimedia contents are provided to users in accordance with an audiovisual expression style mainly based on image and voice, but in the present invention, thermal expression based on the above-described thermal feedback can be included as an essential expression style.

On the other hand, 'playback' of multimedia contents should be interpreted as a comprehensive meaning including all operations of executing multimedia contents to provide to users. Therefore, the term " reproduction " in the present specification should be construed to include not only an operation of reproducing a moving picture through a media player but also an operation of executing a game program, an educational program, a virtual reality application, an augmented reality application, .

1.2. Configuration of a thermal experience system

1 is a block diagram of a configuration of a thermal experience providing system 1000 according to an embodiment of the present invention.

Referring to FIG. 1, a thermal experience providing system 1000 may include a content reproducing device 1200, an audiovisual device 1400, and a feedback device 1600.

Here, the content reproduction device 1200 reproduces the multimedia content, and the audiovisual device 1400 outputs a video or audio corresponding to the content reproduction, and the feedback device 1600 can output thermal feedback in accordance with the reproduction of the content.

For example, the content reproduction device 1200 may decode video content including video data / audio data / thermal feedback data to generate a video signal / audio signal / signal relating to thermal feedback to the audiovisual device 1400 and the feedback output device, respectively . The audiovisual device 1400 receives the video signal and the audio signal, outputs the video and audio, and the feedback output device receives the thermal feedback signal and outputs thermal feedback.

Hereinafter, each component of the thermal experience providing system 1000 will be described in more detail.

1.2.1. The content playback device

The content reproduction device 1200 reproduces the multimedia content.

2 is a block diagram of a configuration of a content reproducing device 1200 according to an embodiment of the present invention.

2, the content reproduction device 1200 may include a communication module 1220, a memory 1240, and a controller 1260.

The communication module 1220 can perform communication with an external device. The content reproduction device 1200 can transmit and receive data to and from the audiovisual device 1400 and the feedback device 1600 through the communication module 1220. [ For example, the content playback device 1200 may communicate an A / V signal to the audiovisual device 1400 via the communication module 1220 or a thermal feedback signal to the feedback device 1600. In addition, the content reproduction device 1200 may access the Internet through the communication module 1220 to download the multimedia content.

The communication module 1220 is divided into a wired type and a wireless type. Since the wired type and the wireless type have advantages and disadvantages, the content reproduction device 1200 may be provided with a wired type and a wireless type at the same time.

In the case of the wired type, a local area network (LAN) or a universal serial bus (USB) communication is a typical example, and other methods are possible.

In the case of the wireless type, a wireless personal area network (WPAN) based communication method such as Bluetooth or Zigbee may be used. However, since the wireless communication protocol is not limited to this, the wireless communication module may use a WLAN (Wireless Local Area Network) communication method such as Wi-Fi or other known communication method.

On the other hand, it is also possible to use a proprietary protocol developed by a game machine or a console manufacturer as a wired / wireless communication protocol.

The memory 1240 may store various types of information. In the memory 1240, various data may be temporarily or semi-permanently stored. Examples of the memory 1240 include a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a ROM (Read-Only Memory), a RAM This can be. The memory 1240 may be provided in a form embedded in the content reproducing device 1200 or in a detachable form.

The memory 1240 stores various data necessary for the operation of the content reproduction device 1200 including an operating system (OS) for operating the content reproduction device 1200 or a content to be executed in the content reproduction device 1200 .

The controller 1260 can control the overall operation of the content reproduction device 1200. [ For example, the controller 1260 may load the multimedia content from the memory 1240 and reproduce it, or may generate a control signal for controlling the video, audio, or thermal feedback output in accordance with the content playback.

The controller 1260 may be implemented as a CPU (Central Processing Unit) or the like according to hardware, software, or a combination thereof. It can be provided in the form of an electronic circuit that performs a control function by processing an electrical signal in a hardware manner and can be provided in a form of a program or a code for driving a hardware circuit in software.

1.2.2. Audiovisual device

The audiovisual device 1400 can output video and audio according to the multimedia playback.

3 is a block diagram of a configuration of an audiovisual device 1400 according to an embodiment of the present invention.

3, the audiovisual device 1400 may include a communication module 1420 and an A / V module 1440. [

The communication module 1420 can perform communication with an external device. The audiovisual device 1400 can send and receive data to and from the content reproduction device 1200 via the communication module 1420. [ For example, the audiovisual device 1400 may receive the A / V signal from the content reproduction device 1200 via the communication module 1420.

The communication module 1420 of the audiovisual device 1400 may be provided similar to the communication module 1220 of the content reproduction device 1200, and thus a detailed description thereof will be omitted.

The A / V module 1440 may provide a video or audio to the user. To this end, the A / V module 1440 may include a video module 1442 and a voice module 1444.

The image module 1442 is generally provided in a display form and can output an image according to a video signal received from the content reproduction device 1200. The audio module 1444 is generally provided in the form of a speaker so as to output audio according to the audio signal received from the content reproduction device 1200. [

1.2.3. Feedback device

Feedback device 1600 may output thermal feedback as a result of multimedia playback.

4 is a block diagram of a feedback device 1600 according to an embodiment of the present invention.

4, the feedback device 1600 may include a communication module 1620 and a thermal output module 1640.

The communication module 1620 can perform communication with an external device. The feedback device 1600 can send and receive data to and from the content reproduction device 1200 via the communication module 1620. [ For example, the feedback device 1600 may receive a thermal feedback signal from the content playback device 1200 via the communication module 1620.

The thermal output module 1640 may output thermal feedback. Thermal feedback is performed by applying a heat or cold heat generated on the thermoelectric element to the contact surface 1641 in response to application of power by a contact surface 1641 contacting the user's body and a thermoelectric element connected to the contact surface 1641, Lt; RTI ID = 0.0 > a < / RTI >

The thermal output module 1640 may perform a thermal operation or an endothermic operation or a thermal grill operation along with a thermal feedback signal received from the content reproduction device 1200 via the communication module 1620 to output thermal feedback, Thermal experience can be experienced by the output thermal feedback.

A more detailed description of the specific configuration and operation of the thermal output module 1640 will be given later.

1.3. On the implementation of thermal experience system

The thermal experience providing system 1000 having the above-described configuration may be implemented in various forms. Hereinafter, some embodiments of the thermal experience providing system 1000 will be described.

1.3.1. First embodiment

The first embodiment 1000-1 of the thermal experience providing system is a system for reproducing an augmented reality application or a virtual reality application.

FIG. 5 is a schematic diagram of a first embodiment of a thermal experience providing system 1000-1 according to an embodiment of the present invention, FIG. 6 is a schematic diagram of a first embodiment of a thermal experience providing system 1000-1 according to an embodiment of the present invention And Fig.

5 and 6, the thermal experience providing system 1000-1 according to the present embodiment includes a console device 1200-1, a head-mounted display (HMD) 1400-1, Device 1600-1. Here, the console device 1200-1 may correspond to the content reproducing device 1200, the HMD 1400-1 to the audiovisual device 1400, and the input device 1600-1 to the feedback device 1600 .

Hereinafter, each component of the thermal experience providing system 1000-1 according to this embodiment will be described.

The console device 1200-1 corresponding to the content reproduction device 1200 may be provided as an augmented reality or an electronic device for reproducing a virtual reality application. For example, the console device 1200-1 may include a game console such as a VR Playstation for Sony (Sony) company for professionally executing a VR application, a PC capable of running an AR / VR application And the like.

The console device 1200-1 may include a communication module 1220, a memory 1240, and a controller 1260, similar to the above-described content reproduction device 1200.

FIGS. 7 and 8 are schematic diagrams showing an exemplary form of the HMD 1400-1 of the first embodiment of the thermal experience providing system 1000-1 according to the embodiment of the present invention.

The HMD 1400-1 corresponding to the audiovisual device 1400 may be mounted on the head of the user to provide an image to the user and perform audio output through an earphone or the like.

For example, HMD 1400-1 may be coupled to a PC or game console, such as Rift TM of Oculus or Vive TM of HTC, similar to that shown in FIG. 7 And may be provided in the form of a device 1400a for outputting images directly or indirectly through an opaque display.

In another example, the audiovisual device 1400 may be a visual display device, such as the one shown in FIG. 8, through a transparent display, such as Google Glass < (TM) > Or may be provided to the wearable device 1400b of the glasses form 1400-1 to provide images. Meanwhile, although the wearable device 1400b in the form of glasses is a concept that is somewhat different from the HMD 1400a using the conventional opaque display, in the present specification, the HMD 1400-1 includes the wearable device 1400b in the form of glasses It should be understood as a comprehensive concept.

9 is a block diagram relating to the configuration of the HMD 1400-1 of the first embodiment of the thermal experience providing system 1000-1 according to the embodiment of the present invention.

9, the HMD 1400-1 may include a communication module 1420 and an A / V module 1440, similar to the audiovisual device 1400 described above.

However, in this embodiment, the communication module 1420 can transmit the information sensed by the sensing module 1460 to the console device 1200-1 in addition to receiving the A / V signal from the console device 1200-1 . Also, the communication module 1420 can be provided mainly as a wireless type so that the HMD 1400-1 mounted on the head of the user does not disturb the user's movement as much as possible.

In addition, the video module 1442 in the A / V module 1440 may be configured with two displays configured as a left-eye display and a right-eye display in order to output a stereoscopic 3D for realizing a virtual reality or an augmented reality have. Or the image module 1442 may be provided in the form of a transparent display or a projector for projecting a virtual image on a transparent glass so that a virtual image and a real image viewed by the user are provided together.

Referring again to FIG. 9, the HMD 1400-1 may further include a sensing module 1460 and a camera 1480.

The sensing module 1460 can sense various information necessary for realizing an augmented reality or a virtual reality. Particularly, in order to provide a high realism in the augmented reality or the virtual reality, it is necessary to control the video output in accordance with the movement of the head of the user. Therefore, the sensing module 1460 is provided with a posture sensor for sensing the posture or motion of the user's head, Sensors may be included.

The camera 1480 photographs an image. In order to realize the augmented reality, it is necessary to recognize the actual space, and the image photographed by the camera 1480 can be used here. The photographed image may also be used to generate an augmented image by being synthesized with a virtual image.

10 and 11 are schematic diagrams showing an exemplary form of the input device 1600-1 of the first embodiment of the thermal experience providing system 1000-1 according to the embodiment of the present invention.

The input device 1600-1 corresponding to the feedback device 1600 can receive user operation and can output thermal feedback.

For example, the input device 1600-1 may be similar to the gaming controller for Move Motion TM or Vive TM of Sony Corporation interlocked with the Play Station for VR, And may be provided as a bar type 1600a gripped by the user's hand. Here, it is also possible that the bar-type input device 1600-1 is a type 1600b in which two pairs are provided so as to be held on both hands, as the case may be, as shown in Fig.

12 is a block diagram relating to the configuration of the input device 1600-1 of the first embodiment of the thermal experience providing system 1000-1 according to the embodiment of the present invention.

12, the input device 1600-1 may include a communication module 1620 and a thermal output module 1640, similar to the feedback device 1600 described above.

However, in this embodiment, in addition to receiving the thermal feedback signal from the console device 1200-1, the communication module 1620 may transmit the user operation inputted through the input module 1650 or the information sensed by the sensing module 1660 to the console To the device 1200-1. Also, the communication module 1620 may be provided mainly in a wireless type so that the user can easily handle the input module 1650. [

12, the input device 1600-1 may further include a casing 1610, an input module 1650, a sensing module 1660, and a vibration module 1670. [

The casing 1610 forms the appearance of the input device 1600-1 and may house other components of the input device 1600-1 therein. Accordingly, the housed components can be protected from an external impact or the like by the casing.

The casing 1610 may be provided with a grip portion 1612 for gripping the input device 1600-1 by the user. The gripping portion 1612 is a portion where the input device 1600-1 is in contact with the user's body so that the contact surface 1641 of the heat output module 1640 can be formed in the grip portion 1612. [ Further, the grip portion 1612 may be made of a material having a high frictional force (for example, rubber or urethane) or may have a non-slip shape (for example, a concavo-convex shape or the like) . It is also possible that the grip portion is made of a material that absorbs perspiration generated from the user's skin.

Input module 1650 may obtain user input from a user. The input module 1650 can be a button or stick, and the user can input a user input by pressing a button or manipulating the stick in a specific direction. Of course, the input module 1650 is not limited to the above-described exemplary form.

The sensing module 1660 may sense various information related to the input device 1600-1. Examples of the typical sensing module 1660 include an orientation sensor for sensing the orientation of the input device 1600-1 or a motion sensor for sensing motion, and a biosensor for sensing a user's body signal. A gyro sensor or an acceleration sensor can be used as the attitude sensor or the motion sensor. The biosensor may include a temperature sensor for sensing a user's body temperature or an electrocardiogram sensor for sensing an electrocardiogram.

Vibration module 1670 may output vibration feedback. Vibration feedback can serve to further enhance user engagement with the game, along with thermal feedback.

Meanwhile, the above-described input device 1600-1 may be provided in various forms other than the bar type. This is true of other embodiments described below.

13-17 are schematic diagrams illustrating another exemplary form of input device 1600-1 of a first embodiment of a thermal experience providing system 1000-1 in accordance with an embodiment of the present invention.

13, the input device 1600-1 includes a gaming controller for Sony's PlayStation (TM) Dual Shock (TM) or Microsoft's Xbox (TM) And may be provided in the form of a gaming controller 1600c held by both hands as well.

The input device 1600-1 of the gaming controller type may be provided with a plurality of grip portions 1612 at two spaced apart portions of the casing 1610 so as to be gripped by both hands and a contact surface 1641 .

In addition, the input device 1600-1 may include a wheel type 1600d, a joystick type 1600e similar to that shown in FIG. 15 used in a flight simulator game, a first-person shooter 1600e, May be implemented with a gun type 1600f similar to that shown in FIG. 16 used in an FPS: First Person Shooter game, or a mouse type 1600g similar to that shown in FIG. 17 commonly used in a computer gaming environment.

Further, in this embodiment, the thermal experience providing system 1000-1 further includes a wearable device 1600-1 ', or the input device 1600-1 is replaced with the wearable device 1600-1' . At this time, the wearable device 1600-1 'may correspond to the feedback device 1600. This is true of other embodiments described below.

18 and 22 are schematic views showing an exemplary form of the wearable device 1600-1 'in the first embodiment of the thermal experience providing system 1000-1 according to the embodiment of the present invention.

The wearable device 1600-1 'corresponding to the feedback device 1600 can be worn on the wearer's body to serve as a human-machine interface (HMI) and can output thermal feedback .

The wearable device 1600-1 'may be provided in various forms according to the part to be mounted on the user's body. For example, the wearable device 1600-1 'may include the above-described glasses or HMD type, a suit type 1600h similar to that shown in Fig. 18, a glove type 1600i similar to that shown in Fig. 19, A shoe type 1600j as shown, a watch type 1600k or a band type 1600l similar to those shown in Figs. 21 and 22, or the like.

The wearable device 1600-1 'may include a communication module 1620 and a thermal output module 1640, which have been described with respect to the input device 1600-1,

Meanwhile, the wearable device 1600-1 'may include a sensing module 1660 that forms the appearance of the wearable device 1600-1' and senses the wearer's body, wearer's actions, attitude, or body information. Here, the contact surface 1641 of the heat output module 1640 may be formed on the body.

The wearable device 1600-1 'may also have somewhat different additional configurations for each type. For example, the wearable device 1600-1 'of the band or watch type may have a display or the like for displaying time or time information.

1.3.2. Second embodiment

A second embodiment of the thermal experience providing system 1000-2 is a system for reproducing an augmented reality application or a virtual reality application.

FIG. 23 is a schematic diagram of a second embodiment of a thermal experience providing system 1000-2 according to an embodiment of the present invention, and FIG. 24 is a second embodiment of a thermal experience providing system 1000-2 according to an embodiment of the present invention And Fig.

A second embodiment of the thermal experience providing system 1000-2 is for processing an augmented reality application or a virtual reality application and may be provided similar to the first embodiment of the thermal experience providing system 1000-1. However, referring to Fig. 23, in this embodiment, the console device 1200-1 may be replaced with the smart device 1200-2. Here, the smart device 1200-2 may correspond to the content reproduction device 1200 and the audiovisual device 1400 at the same time.

For example, the smart device 1200-2 may be provided in the form of a smart phone such as a Galaxy S6 (TM) of Samsung Electronics. The smart device 1200-2 generally includes a display, a voice terminal, a camera, an orientation sensor, and the like, and can be mounted on the HMD 1400-2 to realize a virtual reality or augmented reality.

25 is a block diagram related to the configuration of the smart device 1200-2 of the second embodiment of the thermal experience providing system 1000-2 according to the embodiment of the present invention.

25, instead of the HMD 1400-2, the smart device 1200-2 further includes an A / V module 1440, a sensing module 1460, and a camera 1480 . However, the A / V module 1440, the sensing module 1460, and the camera 1480 in the HMD 1400-2 are not necessarily omitted.

1.3.3. Third embodiment

A third embodiment of the thermal experience providing system 1000-3 is a system for reproducing an augmented reality application or a virtual reality application.

FIG. 26 is a schematic view of a third embodiment of a thermal experience providing system 1000-3 according to an embodiment of the present invention, and FIG. 27 is a schematic view of a third embodiment of a thermal experience providing system 1000-3 according to an embodiment of the present invention And Fig.

A third embodiment of the thermal experience providing system 1000-3 is for processing an augmented reality application or a virtual reality application and may be provided similar to the first embodiment of the thermal experience providing system 1000-1. However, referring to FIG. 27, the console device 1200-1 of the first embodiment may be incorporated in the HMD 1200-3 in this embodiment. Accordingly, the HMD 1200-3 may correspond to the content reproduction device 1200 and the audiovisual device 1400 at the same time.

For example, the HMD (1200-3) may be provided in the form of an HMD with a built-in CPU such as Microsoft's Hololens TM. Accordingly, the HMD 1200-3 can independently drive the virtual reality or the augmented reality application without interlocking with the console device 1200-1. Accordingly, in this embodiment, the console device 1200-1 may be omitted in the thermal experience providing system 1000-3, and the HMD 1200-3 may include the memory 1240 and the controller 1260. [

1.3.4. Fourth embodiment

The fourth embodiment of the thermal experience providing system 1000-4 is a system for reproducing multimedia contents such as a moving picture or a game through a conventional 2D screen.

28 is a schematic diagram of a fourth embodiment of a thermal experience providing system 1000-4 according to an embodiment of the present invention.

The fourth embodiment of the thermal experience providing system 1000-4 is for processing multimedia contents through a conventional 2D screen and can be provided similar to the first embodiment of the thermal experience providing system 1000-1. 28, in this embodiment, the HMD 1400-1 of the first embodiment may be replaced with a display device 1400-4 that provides a 2D screen. Here, the console device 1200-4 may correspond to the content reproducing device 1200, the display device 1400-4 to the audiovisual device 1400, and the input device 1600-4 to the feedback device 1600 have.

The display device 1400-4 may include the communication module 1420 and the A / V module 1440 of the HMD 1400-1 of the first embodiment described above. For example, the display device 1400-4 may be provided in the form of a TV, a monitor, a projector, or the like. Also, the display device 1400-4 can provide a 3D image to the user in a stereoscopic manner.

1.3.5. Fifth embodiment

The fifth embodiment of the thermal experience providing system 1000-5 is a system for reproducing multimedia contents such as a moving picture or a game through a conventional 2D screen.

29 is a schematic diagram of a fifth embodiment of a thermal experience providing system 1000-5 according to an embodiment of the present invention.

A fifth embodiment of the thermal experience providing system 1000-5 may be provided for processing an augmented reality application or a virtual reality application, and similar to the fourth embodiment of the thermal experience providing system 1000-4. 29, in this embodiment, a smart device 1200-5 in which the console device 1200-4 and the display device 1400-4 of the third embodiment are integrated is connected to the console device 1200-4 and the display Device 1400-4 may be substituted. Here, the smart device 1200-5 may correspond to the content reproduction device 1200 and the audiovisual device 1400 at the same time.

For example, the smart device 1200-5 may be provided in the form of a smart phone, a notebook, a tablet, or the like. Accordingly, in this embodiment, the smart device 1200-5 may further include the A / V module 1440. [

1.3.6. Sixth embodiment

In the sixth embodiment of the thermal experience providing system 1000-6, the portable smart device 1200-6 and the peripheral device 1600-6 for the smart device mounted in the thermal experience providing system 1000-6 are included in the thermal experience providing system 1000-6 . This embodiment may be useful in situations such as when the user is carrying the smart device 1200-6 and moving.

30 is a schematic diagram of a sixth embodiment of a thermal experience providing system 1000-6 according to an embodiment of the present invention.

In this embodiment, the smart device 1200-6 may be provided similar to the smart device 1000-5 in the fifth embodiment.

The peripheral device 1600-6 also includes the basic configuration of the feedback device 1600 and may additionally include a mount to which the smart device 1200-6 may be mounted and a battery to output thermal feedback itself . For example, the peripheral device may be provided as a self i stick or a smart phone case shape shown in Fig. This peripheral device 1600-6 can output thermal feedback in conjunction with the smart device 1200-6.

2. Heat output module

Hereinafter, a thermal output module 1640 according to an embodiment of the present invention will be described.

2.1. Overview of the Thermal Output Module

The heat output module 1640 may perform thermal operation, heat absorption operation, or thermal grill operation, thereby outputting thermal feedback that conveys heat and cold to the user. The thermal output module 1640 mounted on the feedback device 1600 in the thermal experience providing system 1000 outputs thermal feedback to the thermal experience providing system 1000 when the feedback device 1600 receives the thermal feedback signal. Provide a thermal experience.

The heat output module 1640 may use a thermoelectric element such as a Peltier element to perform the heat generating operation, the heat absorbing operation, or the thermal grill operation.

The Peltier effect is a thermoelectric phenomenon discovered by Jean Peltier in 1834. When a different kind of metal is bonded and then the current flows, an exothermic reaction occurs on one side and a cooling reaction occurs on the other side This means the phenomenon that occurs. Peltier devices are devices that produce such a Peltier effect. Peltier devices are initially made of dissimilar metal assemblies such as bismuth and antimony, but in recent years they have been manufactured in such a way that NP semiconductors are arranged between two metal plates to have higher thermoelectric efficiency .

The Peltier device is able to instantly induce heat and endothermic currents on both metal plates when current is applied and to convert heat and endothermic currents according to the current direction and to adjust the heat and endothermic degree relatively precisely according to the amount of current, It is suitable to be used for heat generation operation and heat absorption operation. In particular, as a flexible thermoelectric element has been developed, it is possible to manufacture the flexible thermoelectric element in a form that can be easily contacted to the user's body, thereby increasing the commercial availability of the feedback device 1600.

Accordingly, the heat output module 1640 can perform the heat generating operation or the heat absorbing operation as electricity is applied to the thermoelectric element. Physically, an exothermic reaction and an endothermic reaction occur at the same time in a thermoelectric element to which electricity is applied. However, in the present specification, heat generated by the surface of the heat output module 1640, which is in contact with the user's body, Is defined as an endothermic operation. For example, a thermoelectric element can be constructed by disposing an N-P semiconductor on a substrate 1642, where heat is generated at one side and heat is absorbed at the other side. Here, if the side facing the user's body is the front side and the opposite side is the back side, heat generation at the front face and heat absorption at the rear face are defined as performing the heat generation operation with respect to the heat output module 1640, and conversely, Endothermic reaction, and heat generation at the backside can be defined as performing an endothermic operation.

Since the thermoelectric effect is induced by the electric charge flowing in the thermoelectric element, it is possible to describe the electric current inducing the heat generating operation or the heat absorbing operation of the heat output module 1640 from the viewpoint of current. However, It will be described in terms of voltage. However, this is merely for the sake of convenience of description, and it is understood that a person having a general knowledge in the technical field to which the present invention belongs (hereinafter referred to as a "person skilled in the art" It should be noted that the present invention should not be construed as limited in terms of the voltage, since it is not necessary to cause accidents.

2.2. Configuration of the heat output module

31 is a block diagram of a configuration of a thermal output module 1640 according to an embodiment of the present invention.

31, the thermal output module 1640 includes a contact surface 1641, a substrate 1642, a thermocouple array 1643 disposed on the substrate 1642, a power supply terminal 1640 for applying power to the thermal output module 1640, (1644) and a feedback controller (1645).

The contact surface 1641 directly contacts the user's body to transmit heat or cold heat generated by the heat output module 1640 to the user's skin. In other words, the portion of the outer surface of the feedback device 1600 that directly contacts the user's body may be the contact surface 1641. For example, the contact surface 1641 may be formed in the grip portion of the feedback device 1600 casing held by the user.

The contact surface 1641 may be provided as a layer that is directly or indirectly attached to the outer surface of the thermocouple array 1643 that performs the heat generating operation or the heat absorbing operation in the heat output module 1640 (the body direction of the user). This type of contact surface 1641 may be disposed between the thermocouple array 1643 and the skin of the user to perform heat transfer. To this end, the contact surface 1641 may be provided with a material having a high thermal conductivity so that heat transfer from the thermocouple array 1643 to the user's body is well performed. The layer-type contact surface 1641 also prevents direct exposure of the thermocouple array 1643 to the outside, thereby protecting the thermocouple array 1643 from external impacts.

In the above description, the contact surfaces 1641 are disposed on the outer surface of the thermocouple array 1643. However, the outer surface of the thermocouple array 1643 itself may be the contact surface 1641 . In other words, some or all of the front surface of the thermocouple array 1643 can be the contact surface 1641.

The substrate 1642 serves to support the unit thermocouples 1465 and is provided as an insulating material. For example, ceramic can be selected as the material of the substrate 1642. The substrate 1642 may be of a flat plate shape, but it is not necessarily so.

Substrate 1642 may be provided as a flexible material so as to have flexibility generally available to various types of feedback devices 1600 having contact surfaces 1641 of various shapes. For example, in a feedback controller 1600 of a gaming controller type, a portion where a user grasps a gaming controller with the palm of a hand is a curved surface. In order to use the thermal output module 1640 in such a curved portion, 1640) may be important to have flexibility. An example of the flexible material used for the substrate 1642 for this purpose is glass fiber or flexible plastic.

The thermocouple array 1643 is composed of a plurality of unit thermocouples 1465 arranged on a substrate 1642. As the unit thermocouples 1465, different pairs of metals (for example, bismuth and antimony) can be used, but mainly N-type and P-type semiconductor pairs can be used.

In the unit thermocouples 1465, the semiconductor pairs are electrically connected at one end and electrically connected to the unit thermocouples 1465 at the other end. The electrical connection between the semiconductor pair 1645a and 1646b or the adjacent semiconductor is performed by a conductor member 1646 disposed on the substrate 1642. [ The conductor member 1646 may be a wire or an electrode such as copper or silver.

The unit thermocouples 1465 may be electrically connected in series. The unit thermocouples 1465 connected in series form a thermocouple group 1644, and the thermocouple group 1644 may be a thermocouple array 1643).

The power terminal 1644 can apply power to the thermal output module 1640. The thermocouple array 1643 can generate heat or absorb heat according to the voltage value of the power source applied to the power source terminal 1644 and the direction of the current. More specifically, the power supply terminals 1644 may be connected to one thermocouple group 1644 by two. Accordingly, when there are a plurality of thermocouple groups 1644, two power terminals 1644 may be arranged for each thermocouple group 1644. [ According to this connection method, either the voltage value or the current direction is individually controlled for each of the thermocouple groups 1644, and it is possible to control whether heat generation or endothermic generation is performed, and the degree of heat generation or endothermic generation can be controlled.

As will be described later, the power supply terminal 1644 receives the electrical signal output by the feedback controller 1645, and as a result, the feedback controller 1645 adjusts the direction or size of the electrical signal, The heat generation operation and the heat absorption operation can be controlled. When a plurality of thermoelectric couple groups 1644 are provided, the electric signals applied to the respective power terminals 1644 may be individually adjusted to individually control the thermoelectric couple groups 1644.

The feedback controller 1645 may apply an electrical signal to the thermocouple array 1643 via the power terminal 1644. [ Specifically, the feedback controller 1645 receives information about thermal feedback from the controller 1260 of the content reproduction device 1200 via the communication module 1620 and analyzes the information about the thermal feedback to determine the type and intensity of the thermal feedback And generates an electric signal according to the determination result and applies the generated electric signal to the power terminal 1644 so that the thermocouple array 1643 outputs thermal feedback.

To this end, the feedback controller 1645 performs arithmetic operation and processing of various information and outputs an electric signal to the thermocouple array 1643 according to the result of the processing, thereby controlling the operation of the thermocouple array 1643. Thus, the feedback controller 1645 may be implemented in a computer or similar device depending on the hardware, software, or combination thereof. In hardware, the feedback controller 1645 may be provided in the form of an electronic circuit for processing an electrical signal to perform a control function, and may be provided in a form of a program or a code for driving a hardware circuit in software.

The feedback device 1600 may also be provided with a plurality of the above-described thermal output modules 1640. For example, if the feedback device 1600 has a plurality of grippers 1621 as shown in FIG. 13, a thermal output module 1640 may be mounted for each gripper 1621 of the feedback device 1600. If a feedback device 1600 is provided with a plurality of thermal output modules 1640, the feedback device 1600 may be provided with a feedback controller 1660 for each thermal output module 1640, A single feedback controller 1660 may be provided to integrally manage the control unit 1640. Also, when a plurality of feedback devices 1600 are provided in the thermal experiencing system 1000 as shown in FIG. 11, one or a plurality of thermal output modules 1640 may be disposed in each feedback device 1600.

2.3. Type of heat output module

Some exemplary aspects of the thermal output module 1640 will be described based on the description of the configuration of the thermal output module 1640 described above.

32 is a diagram of one embodiment of a thermal output module 1640 according to an embodiment of the present invention.

Referring to FIG. 32, in one form of the heat output module 1640, a pair of substrates 1642 are provided facing each other. A contact surface 1641 is located outside the substrate 1642 of one of the two substrates 1642 so that the heat generated by the heat output module 1640 can be transmitted to the user's body. When the substrate 1642 is used as the flexible substrate 1642, the heat output module 1640 can be provided with flexibility.

A plurality of unit thermoelectric pairs 1465 are placed between the substrates 1642. [ Each unit thermocouple pair 1465 is composed of a semiconductor pair of an N-type semiconductor and a P-type semiconductor. In each of the unit thermocouples 1465, the N-type semiconductor and the P-type semiconductor are electrically connected to each other by a conductor member 1646 at one end. The other ends of the N-type semiconductor and the P-type semiconductor of the optional thermoelectric couple 1465 are electrically connected to each other by the other end of the P-type semiconductor and the N-type semiconductor of the adjacent thermoelectric couple 1465 and the conductor member 1646 The electrical connection between the unit elements is achieved. Accordingly, the unit connection elements are connected in series to form one thermoelectric couple group 1644. In this embodiment, the entire thermoelectric couple array 1643 includes one thermoelectric couple group 1644, and the entire unit thermoelectric couple 1465 is connected in series between the power terminals 1644, so that the thermal output module 1640 The same operation is performed over the entire front surface. That is, when power is applied to the power terminal 1644 in one direction, the heat output module 1640 performs a heat generation operation, and when the power is applied in the opposite direction, the heat output module 1640 can perform a heat absorption operation.

33 is a view of another embodiment of a heat output module 1640 according to an embodiment of the present invention.

Referring to Figure 33, another form of the thermal output module 1640 is similar to the one described above. In this embodiment, however, the thermocouple array 1643 has a plurality of thermocouple groups 1644 and each thermocouple group 1644 is connected to the respective power terminals 1644, Control is possible. For example, in FIG. 33, currents in different directions are applied to the first thermocouple group 1644 and the second thermocouple group 1644 so that the first thermocouple group 1644 performs a heat generating operation Quot; forward "), and the second thermocouples group 1644 may perform an endothermic operation (the current direction at this time is referred to as " reverse direction "). A different voltage value is applied to the power supply terminal 1644 of the first thermocouple group 1644 and the power supply terminal 1644 of the second thermocouple group 1644 to form the first thermocouple group 1644, And the second thermocouple group 1644 may perform a heat generating operation or a heat absorbing operation to a degree different from each other.

In FIG. 33, the thermoelectric couple groups 1644 are arranged in a one-dimensional array in the thermoelectric couple array 1643. Alternatively, the thermoelectric couple groups 1644 may be arranged in a two-dimensional array. 34 is a diagram of another embodiment of a heat output module 1640 according to an embodiment of the present invention. Referring to FIG. 34, using the thermocouple group 1644 arranged in a two-dimensional array, it is possible to further control the motion of each region.

In the meantime, although the above-described embodiments of the heat output module 1640 have been described as using a pair of opposed substrates 1642, it is also possible to use a single substrate 1642 instead. 35 is another diagram of another embodiment of a thermal output module 1640 according to an embodiment of the present invention. 35, a unit thermoelectric couple 1465 and a conductor member 1646 may be embedded in a single substrate 1642 in a single substrate 1642. [ It is possible to use glass fiber or the like as the substrate 1642 for this purpose. A single substrate 1642 of this type may be used to provide greater flexibility to the thermal output module 1640.

Various aspects of the thermal output module 1640 described above may be combined or modified within the scope of what is known to those skilled in the art. For example, in each form of the thermal output module 1640, the contact surface 1641 is formed on the front surface of the thermal output module 1640 as a separate layer from the thermal output module 1640, May be the contact surface 1641 itself. For example, in one form of the above-described heat output module 1640, the outer surface of one substrate 1642 can be the contact surface 1641.

2.4. Thermal feedback output

Hereinafter, the thermal feedback output operation performed by the feedback device 1600 will be described.

The feedback device 1600 may output thermal feedback as the thermal output module 1640 performs a heating operation or an endothermic operation. Thermal feedback may include warm feedback, cold feedback, and thermal grill feedback.

Here, the warm feedback can be output by the heat output module 1640 performing the heat generation operation, and the cold feedback can be output by performing the heat absorption operation. Also, the thermal grill feedback can be output through a thermal grill operation in which a heat generating operation and a heat absorbing operation are combined.

On the other hand, the feedback device 1600 can output the above thermal feedback at various intensities. The intensity of the thermal feedback can be adjusted in such a manner that the feedback controller 1645 of the thermal output module 1640 adjusts the magnitude of the voltage applied to the thermocouple array 1643 through the power terminal 1644. [ Here, the method of controlling the magnitude of the voltage includes a method of smoothing the duty signal and finally applying power to the thermoelectric element. That is, adjusting the voltage level by adjusting the duty rate of the duty signal may also be considered to be included in adjusting the voltage level.

Hereinafter, the heat generating operation, the heat absorbing operation and the heat grill operation will be described in more detail.

2.4.1. Heat / heat absorption operation

The feedback device 1600 may perform a heating operation to the thermal output module 1640 to provide warm feedback to the user. Similarly, the heat output module 1640 may perform an endothermic operation to provide cold feedback to the user.

FIG. 36 is a diagram illustrating a heating operation for providing warm feedback according to an embodiment of the present invention, and FIG. 37 is a graph relating to strength of warm feedback according to an embodiment of the present invention.

Referring to FIG. 36, the heat generating operation may be performed by inducing an exothermic reaction in the direction of the contact surface 1641 as the feedback controller 1645 applies a forward current to the thermocouple array 1643. Here, when the feedback controller 1645 applies a constant voltage (hereinafter referred to as a "constant voltage") to the thermocouple array 1643, the thermocouple array 1643 starts the heat generating operation, 1641 rise to the saturation temperature with time as shown in Fig. Therefore, the user feels that the user does not feel warm or weak feeling at the beginning of the heat generation operation, feels warmth until the temperature reaches the saturation temperature, and then provides warm feedback corresponding to the saturation temperature after a certain period of time do.

FIG. 38 is a diagram illustrating a heating operation for providing cold feedback according to an embodiment of the present invention, and FIG. 39 is a graph relating to strength of cold feedback according to an embodiment of the present invention.

38, an endothermic operation may be performed by inducing an endothermic reaction in the direction of the contact surface 1641 as the feedback controller 1645 applies a reverse current to the thermocouple array 1643. Here, when the feedback controller 1645 applies a constant voltage (hereinafter referred to as a reverse voltage) to the thermocouple array 1643, the thermocouple array 1643 starts the heat absorbing operation, The temperature of the fuel cell 1641 rises to the saturation temperature with time as shown in Fig. Therefore, the user feels that the user does not feel cold feeling at the beginning of the heat absorbing operation, feels weak, feels that the cool feeling rises until reaching the saturation temperature, and then receives the cool feeling feedback corresponding to the saturation temperature after a certain time has elapsed do.

On the other hand, when power is applied to a thermoelectric element, in addition to an exothermic reaction and an endothermic reaction occurring on both sides of the thermoelectric element, electric energy is converted into heat energy and heat is generated. Therefore, when a voltage of the same magnitude is applied to the thermocouple array 1643 by changing only the direction of the current, the temperature change amount due to the heat generation operation may be larger than the temperature change amount due to the heat absorption operation. Here, the temperature change amount means a temperature difference between the initial temperature and the saturation temperature in a state in which the thermal output module 1640 is not operated.

Hereinafter, the heat generating operation and the heat absorbing operation performed by the thermoelectric element using electric energy will be collectively referred to as " thermoelectric conversion operation ". In addition, since the thermal grill operation to be described below is also a combined operation of the heat generating operation and the heat absorbing operation, the thermal grill operation can also be interpreted as a kind of 'thermoelectric operation'.

2.4.2. Strength control of heat / heat absorption operation

As described above, when the heat output module 1640 performs the heat generation operation or the heat absorption operation, the feedback controller 1645 controls the heat generation degree or the heat absorption degree of the heat output module 1640 by adjusting the magnitude of the applied voltage . Accordingly, the feedback controller 1645 can adjust the direction of the current to select the kind of thermal feedback to provide during the warm feedback and the cold feedback, and adjust the magnitude of the voltage to adjust the strength of the warm feedback or cold feedback.

40 is a graph showing the strength of warm / cool feedback using voltage control according to an embodiment of the present invention.

For example, referring to FIG. 40, the feedback controller 1645 applies a voltage value of five levels in a forward direction or a backward direction so that the feedback device 1600 provides the user with a total of ten thermal Feedback can be provided.

In FIG. 40, the warm feedback and the cold feedback are shown to have the same number of strength classes, respectively. However, the number of strength classes of warm feedback and cold feedback is not necessarily the same and may be different from each other.

Here, it is shown that the warm-up feedback and the cold feedback are implemented by changing the current direction using the same-sized voltage value. However, since the magnitude of the voltage value applied for the warm-up feedback and the voltage value applied for the cold feedback Need not be equal to each other.

In particular, when the same voltage is applied to perform the heat generating operation and the heat absorbing operation, since the temperature change amount of the warm-up feedback due to the heat generating operation is generally larger than the temperature change amount due to the heat absorbing operation, It is also possible to apply a voltage higher than the voltage applied to the warm-feeling feedback of the same rating to the same degree of temperature variation in the corresponding strength classes. 41 is a graph relating to warm / cool feedback with the same temperature change amount according to an embodiment of the present invention.

As described above, by adjusting the intensity of the thermal feedback, it is possible to provide subtle thermal feedback such as strong warmth, weak warmth, strong cold feeling, and weak cold feeling, apart from simply providing warmth and cold feeling to the user. Such various types of thermal feedback can provide a higher degree of immersion for the user in a game environment or a virtual / augmented reality environment, and it is possible to inspect a patient's senses more precisely when applied to a medical device.

2.4.3. Thermal grill motion

2.4.3.1. Types of thermal grill feedback

Thermal grill feedback may include neutral thermal grill feedback, hot grill feedback, and cold grill feedback.

Here, the neutral column grill feedback, the hot grill feedback, and the cold grill feedback cause the user to generate neutral heat, heat, and cold and heat, respectively. Neutral heat sensation means sensation without feelings of warmness and coldness. Thermal sensation means feeling sensation in addition to warmth, and cold sensation can mean feeling sensation in addition to feeling cold.

Neutral heat sensation is caused when the user feels warmth and cold sensation falls within a predetermined ratio range. The percentage of neutral fever sensation (hereinafter referred to as 'neutral ratio') can be different for each part of the body that is provided with thermal feedback, and even if it is the same body part, it may be slightly different for each individual. In a situation where the strength is given larger than the strength, there is a tendency to feel a neutral heat sensation.

Here, the intensity of the thermal feedback may be the amount of heat that the feedback device 1600 applies to the body part that is in contact with the contact surface 1641, or the amount of heat that the feedback device 1600 absorbs from the body part. Therefore, when thermal feedback is applied to a certain area for a certain period of time, the intensity of the thermal feedback can be expressed as the difference between the warmth of the target site to which the thermal feedback is applied or the temperature of the cold feeling.

On the other hand, human body temperature is usually between 36.5 and 36.9 ℃, and skin temperature varies from person to person, but it is known to be about 30 ~ 32 ℃ on average. The temperature of the palm is about 33 ℃, which is slightly higher than the average skin temperature. Of course, the temperature values described above may be somewhat different depending on the individual, and even the same person may vary to some extent.

According to one experimental example, it was confirmed that a sensation of neutral heat was felt when a warm feeling of about 40 ° C and a cold sensation of about 20 ° C were given to the palm of 33 ° C. This is due to the warmth of + 7 ° C and coldness of -13 ° C, based on the palm temperature, so the neutral ratio in terms of temperature may be equivalent to 1.86.

As can be seen from the above, in most people, when the warmth and cold sensation are continuously applied to the same sized body area, the skin sensation is expressed by the ratio of the temperature difference caused by the cold sensation to the sensible temperature difference The neutral ratio is in the range of about 1.5 to 5. In addition, the thermal sensation can be felt when the warmth is larger than the neutral ratio, and the cold sensation can be felt when the cold sensation is larger than the neutral ratio.

2.4.3.2. Thermal grill operation with voltage regulation

The feedback device 1600 may perform a thermal grill operation in a voltage regulated manner. The voltage regulating thermal grill operation can be applied to the feedback device 1600 in which the thermocouple array 1643 comprises a plurality of thermocouple groups 1644.

Specifically, in the voltage regulating thermal grill operation, the feedback controller 1645 performs a heat generating operation by applying a positive voltage to a part of the thermocouple group 1644, and applies an inverse voltage to another part to perform a heat absorbing operation, The thermal output module 1640 may be provided by providing both warm and cold feedback at the same time.

FIG. 42 is a diagram illustrating a voltage regulating type thermal grill operation according to an embodiment of the present invention. FIG.

Referring to Figure 42, a thermocouple array 1643 includes a plurality of thermocouple groups 1644 arranged to form a plurality of lines. Here feedback controller 1645 allows first thermocouple groups 1644 (e.g., odd-line thermocouple groups 1644) to perform a heating operation and second thermocouple groups 1644 (e.g., The even thermocouple groups 1644 of the even numbered lines) can apply power to perform the heat absorbing operation. If the thermocouple groups 1644 alternately perform the heat generating operation and the heat absorbing operation according to the line arrangement, the user can receive the warm feeling and the cold sensation at the same time, and as a result, the thermal grill feedback can be provided. Here, the distinction between the odd-numbered lines and the even-numbered lines is arbitrary, and vice versa.

Here, the feedback device 1600 controls the saturation temperature of the first thermocouple groups 1644 and the saturation temperature of the second thermocouples 1644 to follow the neutral ratio, Feedback can be provided.

Figure 43 is a table of voltages for providing neutral column grill feedback in a voltage regulation scheme according to an embodiment of the present invention.

For example, referring to FIG. 43, the feedback controller 1645 may apply five constant voltages and reverse voltages to the thermal output module 1640, respectively, and the thermal output module 1640 may thus generate a five- And assuming a feedback device 1600 in which the magnitude of the temperature change amount due to the heat-absorbing operation is the same and the magnitude of the temperature change amount between each grade is constant, the neutral ratio is set to 3 The feedback controller 1645 applies a constant voltage of the first grade to the first thermocouples group 1644 and a reverse voltage of the third class to the second thermocouples group 1644 The thermal output module 1640 may provide neutral thermal thermal feedback. Similarly, if the neutral ratio is 2.5, the feedback controller 1645 applies a second-order constant voltage to the first thermocouple group 1644 and a second thermocouple group 1644 to provide neutral thermal grill feedback, A reverse voltage of the fifth grade can be applied. Or the neutral ratio is 4, the feedback controller 1645 applies a first-level constant voltage to the first thermocouple group 1644 and a fourth-level reverse voltage to the second thermocouple group 1644 Neutral thermal grill feedback can be generated. Or if the neutral ratio is 2, the feedback controller 1645 provides a neutral heat trap by applying a constant voltage of the first class and a reverse voltage of the second class, or by applying a second class constant voltage and a fourth class reverse voltage. can do. At this time, the neutral neutrality of the electrons (when the first-level constant voltage and the second-class reverse voltage are used) is greater than the latter neutral heat conduction (when the second-class constant voltage and the fourth-class reverse voltage are used) It can be strong. That is, even in the case of thermal grill feedback, its strength can be adjusted. On the other hand, the above description regarding the manner of providing the neutral heat trapping is illustrative, and the present invention is not limited thereto. For example, it is not necessary that the number of classes of the thermal feedback is five, and the number of the cold heat and the heat grade may be different. Also, the temperature interval of each grade should not be constant, for example, the voltage interval of each grade may be constant.

The feedback controller 1645 may also provide the hot grill feedback by adjusting the constant voltage and reverse voltage to be below the neutral ratio, or by adjusting to be above the neutral ratio.

43, the feedback controller 1645 applies a first-level constant voltage to the first thermocouple group 1644 and a second-level constant voltage to the second thermocouple group 1644 when the neutral ratio is set to 3 When the first or second class reverse voltage is applied, the heat output module 1640 generates heat sensation and sensation at a rate lower than the neutral ratio, so that it is possible to provide the warm grill feedback that simultaneously senses warmth and sensation to the user. On the other hand, at this time, the constant voltage need not always be the constant voltage used for the neutral column grill feedback. In other words, the feedback controller 1645 may allow the thermal output module 1640 to provide thermal grill feedback using a fourth order of constant voltage and a fourth order of reverse voltage.

In the case of the cold grill feedback, when the feedback controller 1645 sets the neutral ratio to 3 (the first class, the fourth class) or (the first class and the fifth class) (the constant voltage and the reverse voltage) As shown in FIG.

However, in case of providing a hot grill feedback or a cold grill feedback, when the constant voltage and the reverse voltage are applied at a rate largely deviated from the neutral ratio, there is a problem that the user does not feel a sense of enthusiasm. Therefore, / It may be desirable to adjust the rating of the reverse voltage.

3. How to Provide a Thermal Experience

Hereinafter, a method of providing a thermal experience according to an embodiment of the present invention will be described. The following description will be made with reference to the thermal feedback providing operation by the thermal experience providing system 1000 and the thermal output module 1640 with respect to the thermal experience providing method according to the embodiment of the present invention. However, this is merely for convenience of explanation, and thus the method of providing thermal experience according to the embodiment of the present invention is not limited thereto.

3.1. Outline of the method of providing thermal experience

Figure 44 is a basic flowchart of a thermal experience providing method according to an embodiment of the present invention.

Referring to FIG. 44, a method for providing a thermal experience according to an embodiment of the present invention includes a step S1 of reproducing a multimedia content by a content reproducing device 1200, a step S1 of reproducing the multimedia content, (S3) of sending a thermal feedback signal to the feedback device (1600) in accordance with the thermal feedback information, and the feedback device (1600) receiving the thermal feedback signal according to the thermal feedback signal And performing a thermal feedback output operation (S4). The above-mentioned steps will be described in the foregoing.

First, the content reproduction device 1200 can reproduce the multimedia content (S1).

The multimedia content can be a video, a game, a virtual reality application, an augmented reality application, a sensible application, and the like. The controller 1260 of the content reproducing device 1200 can load the multimedia contents stored in the memory 1240 from the memory 1240 or receive the multimedia contents through the communication module 1220 and reproduce the multimedia contents.

For example, the controller 1260 of the content playback device 1200 can play multimedia content such as a game or a movie file stored in the memory 1240. Alternatively, the content reproduction device 1200 may receive and reproduce the multimedia content from the Internet through the communication module 1220 according to a downloading or streaming method.

The content reproduction device 1200 may acquire thermal feedback information according to the reproduction of the multimedia content (S2).

The multimedia content may include thermal feedback data or algorithms for processing thermal feedback. The controller 1260 of the content reproduction device 1200 may decode the thermal feedback data in accordance with the reproduction of the multimedia contents, or may perform the thermal feedback processing algorithm and obtain the thermal feedback information as the result.

Here, the thermal feedback information may include at least one of a thermal feedback object, a type of thermal feedback, a thermal feedback strength, and information on the time of providing thermal feedback.

The thermal feedback object may refer to the object to which thermal feedback is applied. For example, if a plurality of feedback devices 1600 are used in the thermal experience providing system 1000 (see FIG. 11), and the feedback device 1600 has a plurality of thermal output modules 1640 ) Or the case where the thermal output module 1640 is controlled on a region-by-region basis (see FIG. 33), the thermal feedback object may indicate an object to perform thermal feedback.

The type of thermal feedback can mean the kind of thermal feedback. For example, thermal feedback types may include warm feedback, cold feedback, and thermal grill feedback. The thermal grill feedback may include neutral thermal grill feedback, thermal grill feedback, and cold grill feedback.

The thermal feedback intensity can mean the intensity of the thermal feedback. In some cases, the thermal feedback intensity may include a thermal feedback kind. For example, the thermal feedback intensity is classified as 1 to 10, cool feedback is assigned to grades 1 to 5, and warm feedback is assigned to grades 6 to 10.

The thermal feedback providing time may mean the time to output the thermal feedback. The thermal feedback providing time may include a start time, an end time, a running time, and the like of the thermal feedback output.

The content reproducing device 1200 transmits a thermal feedback signal to the feedback device 1600 in accordance with the thermal feedback information (S3), and the feedback device 1600 receives the thermal feedback signal and performs a thermal feedback output operation in accordance with the received signal (S4).

Specifically, the controller 1260 may generate a thermal feedback signal based on the thermal feedback information and transmit the thermal feedback signal to the feedback device 1600 via the communication module 1220. In a thermal experience providing system 1000 having a plurality of feedback devices 1600, the controller 1260 may select a feedback device 1600 to transmit a thermal feedback signal based on the thermal feedback object information. The feedback controller 1645 may receive the thermal feedback signal via the communication module 1620 and perform a thermal feedback output operation in accordance with the thermal feedback signal.

The thermal feedback signal is a signal for controlling the output of the thermal feedback. The thermal feedback signal may include a thermal feedback start signal indicating the start of the thermal feedback output and a thermal feedback end signal indicating the end of the thermal feedback output.

The controller 1260 of the content playback device 1200 may transmit a start signal via the communication module 1220 and the feedback controller 1645 of the feedback device 1600 may receive the start signal via the communication module 1620 have. When the feedback device 1600 receives a start signal, the feedback controller 1645 may apply power to the thermocouple array 1643 in accordance with the start signal to cause the thermocouple array 1643 to perform a thermal feedback output operation .

The controller 1260 of the content playback device 1200 may send a termination signal via the communication module 1220 and the feedback controller 1645 of the feedback device 1600 may receive the termination signal via the communication module 1620 have. When the feedback device 1600 receives the termination signal, the feedback controller 1645 turns off the power to the thermocouple array 1643 according to the termination signal so that the thermocouple array 1643 can stop the thermal feedback output operation.

Here, the thermal feedback end signal is not essential. For example, if the start signal includes feedback providing time information, the feedback controller 1645 determines the output time of the thermal feedback according to the feedback providing time information, maintains the output of the thermal feedback during the output time, Since the output can be terminated, a termination signal may not be required. For another example, if the output time of the thermal feedback is set to the feedback device 1600 by default, the feedback controller 1645 may maintain the output of the thermal feedback for a predetermined time and then terminate the output of the thermal feedback The termination signal may also be unnecessary.

The feedback controller 1645 of the feedback device 1600 may forward the thermal feedback report signal to the content playback device 1200 that reports the operating status of the thermal output module 1640 via the communication module 1620. The feedback device 1600 may transmit the report signal periodically or in response to receipt of the thermal feedback signal to the content playback device 1200. The thermal feedback report signal may include information such as whether to output thermal feedback, the type or intensity of the thermal feedback being output, the temperature of the contact surface 1641, the user's bio information sensed by the sensing module, will be.

The thermal feedback output operation of the feedback device 1600 according to the thermal feedback signal can be done in various ways.

First, the start and end of the thermal feedback output operation of the feedback device 1600 can be accomplished as follows. In one example, the feedback device 1600 may perform a thermal feedback output operation only while the thermal feedback signal is received, and may stop the thermal feedback output operation if not received. As another example, the feedback device 1600 may output the thermal feedback for a predetermined time, by default, or a thermal feedback time included in the start signal upon receipt of the start signal, and then stop the output. As another example, the feedback device 1600 may output the thermal feedback for a time from the reception of the start signal to the reception of the end signal, and then stop the output.

Also, the thermal feedback signal may be provided as a simple ON / OFF signal, but may be provided in a form including all or a part of the thermal feedback information described above. When the feedback controller 1645 receives the thermal feedback signal, it can extract the information contained therein and control the thermal feedback output operation. For example, the feedback controller 1645 can determine which thermal output module 1640 will perform the thermal feedback output operation based on the thermal feedback object information. As another example, the feedback controller 1645 may determine whether to perform a heating operation, an endothermic operation, or a thermal grill operation based on the thermal feedback type information. For example, the feedback controller 1645 can determine the voltage value of the power source to be applied to the thermocouple array 1643 based on the thermal feedback intensity information. Again, for example, the feedback controller 1645 may determine the start and end points of the thermal feedback output based on the thermal feedback providing time information. Of course, at least one of the type / intensity / presentation time of the thermal feedback described above may be set to the thermal feedback device 1600 by default.

3.2. Application of Thermal Experiences

Traditionally, contents such as games and movies have been experienced in the form of audiovisual forms presented by video or audio. Also, in order to improve the immersion level of contents, the sense of tactile experience, which is represented by vibration feedback, and the sense of smell using the smell are supporting the existing style of audiovisual expression. In addition, recently, there have been developed solutions capable of experiencing the omnidirectional user experience such as virtual reality or augmented reality.

The thermal experience providing system 1000 implements a thermal reality (TR) by outputting thermal feedback in cooperation with various situations provided by the above-described conventional methods in allowing a user to experience contents, The user experience can be further enhanced.

In this regard, using the thermal experience providing method described above, the content device can output the thermal feedback by the feedback device 1600 through the thermal feedback signal in accordance with the reproduction of the multimedia content, It can provide a thermal experience.

Accordingly, the thermal experience providing method can be applied to various technical fields in which a user experience is requested. Hereinafter, a thermal experience providing system 1000 and some representative technical fields in which a thermal experience providing method can be utilized will be schematically described .

3.2.1. virtual reality

Virtual reality is a representative example of the field in which the thermal experience providing system 1000 can be utilized.

Virtual reality means creating a virtual environment or situation so that the user feels as if they are actually in virtual space. Generally, a virtual reality is implemented based on a three-dimensional image that dynamically changes according to a user's gaze using an HMD. Virtual reality is being actively developed for education and business aids including various games and movies.

Especially, with the development of smart devices and the release of Samsung Electronics' Gear VR (TM) TM, the VR devices are expected to be released in the future.

The thermal experience providing system 1000 of the present invention can be installed in such a virtual reality application to add a thermal sensation to an existing visual / auditory / tactile sense.

For example, the thermal experience providing system 1000 may provide a temperature to a specific object placed in a virtual space and provide warm feedback when an avatar, which is a user's private, touches the object in a virtual reality, Can be implemented.

Likewise, the thermal experience providing system 1000 provides an appropriate temperature sense to the virtual space given to the environment such as the desert or the polar regions, and outputs the warmth feedback or the cold feedback to the user accordingly, Can be improved.

3.2.2. Augmented reality

The augmented reality is also a representative example of the field in which the thermal experience providing system 1000 is utilized.

The augmented reality is a mixed reality because it combines the virtual environment in the real environment by providing the virtual object over the real world.

Compared to immersing the user into a full virtual space, the augmented reality basically enhances virtual objects or virtual additional information in the real world. Therefore, even if the HMD is used, A virtual image is enhanced on a glass-type transparent display, or a virtual image is synthesized in real time on a real image photographed using a camera 1480. [

Therefore, unlike virtual reality technology, augmented reality technology provides users with both real and virtual environment, which is advantageous in that they can interact with information in real environment and better realism.

Apple's iPhone and other smart devices are equipped with augmented reality capabilities, and recently, with HMD-type Microsoft's Hololens TM, which operates stand-alone, Interest is growing.

The thermal experience providing system 1000 may provide a thermal sensation associated with these augmented reality applications to assist the user in an existing visual / auditory experience.

For example, the thermal experience providing system 1000 may provide useful information to a user by outputting warm feedback as one of the enhancement elements when a hot object enters the user's field of view.

3.2.3. Game content

The thermal experience providing system 1000 may be utilized for game contents.

The user experience is very important because the game contents basically have the interactive elements as the multimedia contents based on the interaction between the elements and the users in the game.

The implementation of the game contents can be realized through the above-described virtual reality or augmented reality technique as well as the conventional technique reflecting the user's operation on the game screen output through the conventional TV or monitor. The thermal experience providing system 1000 may add thermal experience as part of improving game immersion in the game environment implemented through the techniques described above. For example, the thermal experience providing system 1000 may output thermal feedback according to a shot when shot by a gun or the like in a game of a first-person shooter genre.

3.2.4. Video content

In addition, the thermal experience providing system 1000 may be utilized for video contents and the like. The video content is based on an audiovisual expression style such as a video or a voice, and the thermal experience providing system 1000 can add thermal experience to multimedia contents by outputting thermal feedback corresponding to the video scenes represented by audiovisual . For example, the thermal experience providing system 1000 may output thermal feedback such as outputting thermal feedback in an explosion scene and outputting cold-heat feedback in a scene in which water is turned over.

Although the various application fields of the thermal experience providing system 1000 have been described above, the application fields of the thermal experience providing system 1000 are not limited to the above examples. In addition to the above-described technical fields, the thermal experience providing system 1000 can be used for various multimedia contents including education or learning contents or medical applications.

Accordingly, in the present invention, the thermal experience providing system 1000 should be construed as being unlimitedly applicable to any field capable of providing thermal feedback to improve the user experience.

4. Implementation of methods for providing thermal experiences

In the above, the thermal experience providing method can be used to improve the user experience in various technical fields. However, it may be important to output appropriate thermal feedback along with the playback of the multimedia content in order to provide a better thermal experience to the user. For example, it may be important to provide warm feedback in an explosion scene and cold feedback in a cold scene by interlocking the screen to be reproduced with thermal feedback at the time of moving picture reproduction.

Hereinafter, various embodiments of a method for providing a thermal experience capable of improving a user experience for each technical field will be described.

4.1. First embodiment

The first embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback to a video or audio during reproduction of moving picture contents.

When the thermal feedback is linked to the video or audio during reproduction of the moving image content, it may be important that the thermal feedback coincides with the synchronization of the thermal feedback with the specific scene or the specific sound to which the thermal feedback is to be linked. For example, in the case where warm-feeling feedback is felt during the reproduction of the explosion scene, it is preferable that the video-output timing of the explosion scene coincides with the sensation-feeling timing of the warm-feeling feedback, or the user experience may be deteriorated.

However, if the feedback controller 1645 applies the power for the thermal feedback output at the time of output of a specific scene, a time difference may occur between the output timing of the specific scene and the thermal feedback timing. This is because even though power is applied to the thermocouple array 1643, it takes some time to reach the temperature at which the contact surface 1641 can experience the user's thermal feedback. That is, since the power application time point and the user's feeling of thermal feedback may not coincide with each other, when the output time point of a specific scene is matched with the power application time point, the sync between the image and the thermal feedback is shifted. Hereinafter, the time taken from the start of thermoelectric conversion for thermal feedback to the bodily sensation of the thermal feedback will be referred to as a " delay time ".

In this embodiment, the synchronization between the video output and the thermal feedback output can be established to improve the user experience.

Hereinafter, a specific scene in which a user experience is improved by interlocking with thermal feedback will be referred to as a thermal event scene. A thermal event scene typically involves events in the real world that involve heat, such as an explosion or a gunshot, but it is not necessarily the case and may include all scenes that can be interlocked with thermal feedback to improve user engagement have. Likewise, a specific voice that is enhanced by the user experience by being interlocked with thermal feedback will be referred to as a thermal event voice.

45 is a flow chart of a first embodiment of a thermal experience providing method according to an embodiment of the present invention.

Referring to Figure 45, a first implementation of a thermal experience presentation method includes loading video content including thermal event scenes and thermal feedback data comprising thermal feedback interlaced with thermal event scenes A step S120 of outputting an image according to the image data, a step S130 of obtaining a time at which the thermal feedback is sensed (S130), a start timing of thermoelectric conversion for thermal feedback (S140) of outputting a thermal feedback start signal at the start of the thermal transfer operation (S150), and starting a thermal transfer operation for outputting thermal feedback in accordance with the thermal feedback start signal (S160) can do.

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may load video data including thermal event scenes and thermal feedback data including thermal feedback interlocked with a thermal event scene (S110).

Specifically, the controller 1260 may load the video content stored in the memory 1240 or receive the video content through the communication module 1220 in a downloading method or a streaming method.

The video content may include video data and thermal feedback data. Here, the moving picture content may be provided as one file including the video data and the thermal feedback data, but the moving picture content may be provided in a form including a moving picture file including the moving picture data and a separate file including the thermal feedback data have.

46 is a diagram illustrating an example of thermal feedback data used in the first embodiment of the thermal experience providing method according to the embodiment of the present invention.

According to one example, the thermal feedback data may be provided in a form similar to that of the subtitle file used to overlay the subtitles at the time of moving picture output, together with the moving picture file, similar to that shown in Fig.

Here, the type of thermal feedback or the correction time for each intensity may be defined in the section &quot; <HEADER> &quot;. The correction time may be set to a time interval corresponding to the delay time. For example, in the case of FIG. 46, the correction time from the first stage to the fifth stage is set for the thermal feedback and the cold feedback in the header portion, respectively.

Here, "<BODY>" indicates the time at which the thermal feedback should be sensed (this may be the same as the output timing of a specific scene linked with the thermal feedback, and may include start time and end time) The type of the thermal feedback to be output to the target thermocouple group 1643, and the information about the target device or the target thermocouple group 1643 for outputting the intensity and thermal feedback.

The video data includes information about the scene to be output at the time of reproducing the video content. Also, a thermal event scene may be included in a scene to be output.

The thermal feedback data includes information about thermal feedback to be output at the time of reproducing the moving image content, that is, thermal feedback information. For example, the thermal feedback information may include information about the thermal feedback object, the type of thermal feedback, the thermal feedback strength, and the timing of the thermal feedback reduction. Here, the thermal feedback braking time point may be set to be the same as the reproduction time point of the thermal event scene.

The content reproduction device 1200 can output an image according to the image data (S120). For example, the controller 1260 may decode video data using an image codec and output an image. Video output can be performed via an external or internal display.

The content reproduction device 1200 may acquire a point at which the thermal feedback is sensed (S130). Specifically, the controller 1260 can obtain a point at which the user should experience thermal feedback from the thermal feedback data. Here, the time of the thermal feedback feedback may be the same as the output time of the specific scene to be interlocked with the thermal feedback.

The content reproducing device 1200 may calculate the start time of the thermoelectric action for thermal feedback based on the sensed time of the thermal feedback and the corrected time (S140). Specifically, the controller 1260 can calculate the start time of the thermoelectric action for thermal feedback by subtracting the correction time from the time of the sensation of the thermal feedback.

Here, the correction time may be a time interval from a power application time point when the power is applied to the thermocouple array 1643 to a time point at which the temperature of the contact surface 1641 becomes a temperature at which the user can experience thermal feedback.

The controller 1260 can determine the correction time with reference to the correction time table stored in the memory 1240. Alternatively, when the image data includes information on the correction time, the controller 1260 can determine the correction time with reference to the image data.

The correction time may be a predetermined value irrespective of the type and intensity of the thermal feedback. Alternatively, the information on the correction time table or the correction time of the image data may include correction time based on the type of the thermal feedback, And may be set differently depending on the type and intensity of the light.

In this case, the controller 1260 can determine the correction time based on at least one of the type of the thermal feedback and the intensity of the thermal feedback.

For example, the type of the thermal feedback may be warm feedback and cold feedback, and the delay time from the start of the heat generation operation to the warm-up feedback sensation and the delay time from the start of the heat absorption operation to the cold- The controller 1260 can set the correction time differently depending on whether the thermal feedback is the warm-feeling feedback or the cold-feeling feedback. Specifically, in the case of warm feedback and cold feedback of the same strength, the time for the contact surface to reach the saturation temperature by the heat generating operation may be faster than the time for the contact surface to reach the saturation temperature by the heat absorbing operation, The delay time may be shorter.

As another example, the intensity of the thermal feedback can be classified into a plurality of grades, and the delay time from the start of the thermoelectric action to the bodily sensation of the thermal feedback in the thermal feedback of the strong intensity and the weak intensity may be different, 1260) can set different correction times according to the intensity of the thermal feedback. At this time, since the temperature change is slow at a weak intensity and the temperature change is fast at a strong intensity, a correction time can be set to a large value at a weak intensity. Or vice versa, the temperature required to experience strong thermal feedback is higher than the temperature required to experience weak thermal feedback, so the correction time may be set to be large at high intensity.

On the other hand, since the delay time required for sensing the thermal feedback may be an inherent characteristic of the feedback device 1600 outputting the thermal feedback, the controller 1260 may determine the delay time in consideration of the identification information of the feedback device 1600 have. For this purpose, the controller 1260 may receive and obtain the identification information of the feedback device 1600 via the communication module 1220. Or the feedback device 1600 itself is storing the correction time information, the controller 1260 may receive the correction time information from the feedback device 1600 and refer to it to set the correction time.

The content reproduction device 1200 may transmit a thermal feedback start signal at the start of the thermoelectric operation for thermal feedback (S150). When the start time of the thermoelectric conversion operation is determined, the controller 1260 controls the communication module 1220 to display the time when the current reproduction time (hereinafter referred to as 'reproduction time' A thermal feedback start signal may be transmitted to the feedback device 1600. [

Feedback device 1600 may initiate a thermal feedback output operation in accordance with the start signal of thermal feedback (S160).

47 is a diagram of a thermal feedback output operation of a first embodiment of a thermal experience providing method according to an embodiment of the present invention.

Specifically, the feedback controller 1645 applies power to the thermocouple array 1643 at the time of receipt of the start signal (which is substantially the same as the start time of the thermoelectric action). The thermocouple array 1643 performs an exothermic or endothermic operation from the time of power application. When the correction time elapses from the power application time point, the temperature of the contact surface 1641 reaches a temperature at which the user can feel the thermal feedback.

Accordingly, the user can feel the thermal feedback at the output timing of the thermal event scene at the playback time of the multimedia contents. In other words, the feedback device 1600, under the control of the content reproducing device 1200, applies power to the thermoelectric element at the start time of the thermoelectric action, which is set to a time point earlier than the output time point of the specific scene to be interlocked with the thermal feedback, And can allow the user to experience thermal feedback at the output of a particular front end.

In the above description, the synchronization of the image and the thermal feedback is described as a reference in the above embodiment, but it is also possible to synchronize the voice and the thermal feedback by replacing the image with voice. This can be easily understood by those skilled in the art by replacing the video data, the thermal event scene with the audio data, the thermal event audio. This can be similarly applied to another embodiment of the thermal experience providing method according to the embodiment of the present invention to be described later.

According to the above-described embodiment, since the audiovisual experience according to the video or voice and the thermal experience according to the thermal feedback are provided in harmony, the user experience on the video content can be improved.

4.2. Second embodiment

In some games or 4D movies of existing multimedia contents, vibration feedback is linked to video or audio output in order to improve user immersion. Therefore, in order to provide a thermal experience in the reproduction of the multimedia contents produced in the past until the multimedia contents providing the thermal experience are actively distributed on the market, the thermal feedback may be interlocked with the vibration feedback.

A second embodiment of the thermal experience providing method according to an embodiment of the present invention is a method of providing a thermal experience to a user by outputting a combined vibration feedback and thermal feedback.

Figure 48 is a flow chart of a second embodiment of a thermal experience providing method according to an embodiment of the present invention.

Referring to FIG. 48, a second embodiment of the thermal experience providing method includes the steps of reproducing (S210) multimedia contents including a vibration event, transmitting a vibration feedback start signal (S220) when a vibration event occurs, And performing a thermal feedback output operation in accordance with the vibration feedback start signal (S230).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may reproduce the multimedia content including the vibration event (S210). Specifically, the controller 1260 may load the multimedia content through the memory 1240 or the communication module 1220 and reproduce the multimedia content. For example, the content playback device 1200 may play back video content, a game application, a virtual reality application, or an augmented reality application.

Here, the multimedia contents may include vibration feedback data in addition to video data and voice data. The content reproduction device 1200 may determine whether a vibration event has occurred according to the playback of the multimedia content based on the vibration feedback data. The vibration event means an event that requires vibration feedback output during reproduction of the multimedia contents. For example, in the case of video contents, the vibration feedback data may be set as a vibration event requiring a vibration feedback output, such as a scene of a car collision of a video data or a shot shot scene. In another example, the game content may include a character's shooting event, a skill use event, or the like as a vibration event.

When a vibration event occurs, the content reproduction device 1200 transmits a vibration feedback start signal to the feedback device 1600 (S220), and the feedback device 1600 performs a thermal feedback output operation in accordance with the vibration feedback start signal (S230)

The controller 1260 may send a vibration feedback start signal to the feedback device 1600 via the communication module 1220 when it is determined that a vibration event has occurred. Also, the feedback controller 1645 may receive the vibration feedback start signal through the communication module 1620, and may apply power to the thermocouple array 1643 to perform a thermal feedback output operation.

On the other hand, if the feedback device 1600 includes the vibration module 1670, the feedback device 1600 may output vibration feedback along with the output of the thermal feedback through the vibration module 1670. [

Meanwhile, the present embodiment described above is a method for implementing thermal feedback in multimedia contents in which thermal feedback data is absent, and outputs thermal feedback using vibration feedback data instead of thermal feedback data. On the other hand, in this embodiment, it is also possible to utilize some other data included in the multimedia contents for the thermal feedback output instead of the vibration feedback data.

As an example, this embodiment can be modified to output thermal feedback in response to a screen shaking event instead of a vibration event. Some games, including FPS, use a screen shaking technique to shake a virtual camera in a game engine to shake the video when a shot or collision event occurs. Accordingly, the controller 1260 reproduces multimedia contents including a screen shaking event instead of the vibration event, and transmits a thermal feedback start signal to the feedback device 1600 through the communication module 1220 when a screen shaking event occurs during playback , The feedback controller 1645 may perform a thermal feedback output operation in accordance with the thermal feedback start signal.

As another example, this embodiment can be modified to output thermal feedback according to a specific voice instead of a vibration event. Specifically, when the controller 1260 reproduces multimedia contents and a specific voice is output during reproduction, the controller 1260 transmits a thermal feedback start signal to the feedback device 1600, and the feedback controller 1645 outputs a thermal A thermal feedback output operation may be performed according to the feedback start signal. Here, the specific voice may be, for example, a voice generated in a collision, a voice generated in an explosion scene, a screaming sound, or the like. The controller 1260 may determine the voice output as a specific voice when the voice output is equal to or higher than a predetermined volume, or may determine the voice as a specific voice if the voice output belongs to a predetermined frequency band.

According to this embodiment, it is possible to provide a thermal experience through thermal feedback even in the case of reproducing game contents outputting existing vibration feedback even when game contents using thermal experience are not produced in earnest.

4.3. Third embodiment

The third embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback to an element attribute of a skill at the time of game driving or a skill at the time of a game.

Here, the element attribute is an attribute given to the skill in the game. For example, an elemental attribute of a skill may include a fire attribute (or a flame attribute), an ice attribute (or a frost attribute), a wind attribute, a lightning attribute (or an electric attribute), and the like. The element attributes of a skill can be defined according to the game developer's skill attribute design, but in many games skill attributes include fire attribute, ice attribute, and lightning attribute.

On the other hand, in the present embodiment, the game should be understood as a comprehensive concept including both a conventional 2D game, a stereoscopic 3D game, a virtual reality technique, or a game using an augmented reality technique. This is true of other embodiments of the thermal experience providing method according to the embodiment of the present invention to be described later.

49 is a flowchart of a third embodiment of the thermal experience providing method according to the embodiment of the present invention.

Referring to FIG. 49, the third embodiment of the thermal experience providing method includes the steps of executing a game in which skills having a plurality of element attributes are implemented (S310), and when a skill activation event or a skill shooting event occurs during a game, (S320) of generating a thermal feedback start signal including thermal feedback type information corresponding to an element attribute of the thermal feedback signal (S320), transmitting a thermal feedback start signal (S330), and performing a thermal feedback output operation according to the thermal feedback start signal , And outputting thermal feedback corresponding to the thermal feedback type information (S340).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 can execute a game in which skills having a plurality of element attributes are implemented (S310). The controller 1260 may load and execute such a game.

Here, the skill may correspond to an operation such as an order used by a virtual character in a game, a shooting object shooting action, and the like. For example, firewalls, ice bolts, lightning chains, etc. may be representative examples of the skill. In another example, a representative example of a skill may include an action for wielding a weapon, an action for launching a projection, and the like. In this case, the attribute given to the weapon or the projection object is treated as an attribute of the skill . Here, the virtual character may include a player character controlled by the player or an enemy character attacking the player. Also, in the case of a first person game including VR / AR, a player character may substitute for a player character in a virtual reality environment or an augmented reality environment instead of a player character on the screen. Hereinafter, the expression 'player' should be construed as a generic term encompassing a virtual character (player character) controlled by the player, a user in the virtual space or augmented space, or an avatar thereof.

Skills in the game may have element attributes. For example, in the case of a fire ball, a flame attribute, an ice bolt in the case of an ice bolt, and an electric attribute in the case of a lightning chain may be given.

In addition, each skill may be given a skill level (skill level). For example, in a game, a skill may be implemented in a form that the skill of the skill increases as the skill level increases. For example, a level is assigned to a fireball skill, and a fireball 1 level is strengthened to a fireball 2 level It is an expression.

There is also an advantage over skills with homogeneous element attributes. That is, a skill may be given a skill tier. For example, the flame attribute may include fire bolts, fireballs, and firestorms, with fireballs rated at 1 level, fireballs at 2 levels, and fireballs at 3 levels have.

Or each skill can have a damage value. For example, a fireball's damage equals 100 to 200 damage.

 The content reproducing device 1200 may generate a thermal feedback start signal including a thermal feedback type information corresponding to an attribute of the skill in the case where a skill activation event or a skill shooting event occurs during execution of the game (S320).

The controller 1260 can detect that a skill is activated in the game as a skill activation event according to a user input that instructs the skill activation during game driving. Alternatively, the controller 1260 can determine the skill as a skill shooting event when the skill invoked in the game hits the user character.

When the controller 1260 detects a skill activation event or a skill shooting event, the controller 1260 can determine the type of thermal feedback corresponding to the element attribute by referring to the element attribute of the triggered skill or the shot skill. For example, as for the skill of the flame attribute, the kind of the thermal feedback can be determined by the warm feedback, and with respect to the skill of the ice property, the kind of the thermal feedback can be determined by the cold feedback. In addition, the type of thermal feedback can be set as thermal grill feedback for the electrical attribute skill.

At this time, the controller 1260 can determine the intensity of the thermal feedback based on at least one of the type of skill, the grade, the damage value, and the damage amount. For example, if you have fire bolts, fireballs, and firestorms in the skill of a flame attribute, and if you have a stronger skill in the latter, you will have a weak strength for fire bolts, medium strength for fireballs, The strength of the feedback can be determined. For another example, the intensity of the thermal feedback can be determined with a weak intensity for the first level of the fire ball, an intermediate intensity for the second level, and a strong intensity for the third level. As another example, the greater the damage value of a skill, the stronger the strength of the thermal feedback may be. As another example, when a hit event occurs, the intensity of the thermal feedback can be set to be stronger as the damage to the character increases when hit.

Additionally, the controller 1260 may also determine the time to maintain the thermal feedback. For example, a virtual character shot with a skill of a flame attribute may receive a flaming effect for a predetermined time, a virtual character shot by a skill of an ice property may receive a stop or a slow effect for a predetermined time, The character that is struck by the skill of the player can be paralyzed. The controller 1260 can determine the time for providing the thermal feedback according to the duration of the special effect caused by the character due to the skill.

These special effects may have a buff effect that has a beneficial effect on the target of the skill and a debuff effect that has a detrimental effect. When thermal feedback is to be output to a player for a shooting event, if a debuff effect is generated for a player according to a shooting event, thermal feedback may be output during the duration of the debuff effect. In addition, when the player desires to output thermal feedback on the skill activation event, it is possible to output the thermal feedback during the duration of the buff effect caused to the player according to the skill activation event.

Also, the controller 1260 may gradually decrease the intensity of the thermal feedback during the duration of the thermal feedback, which allows the user to know the end of the buff or debuff effect.

The controller 1260 may generate a thermal feedback start signal including information about the thermal feedback type. The thermal feedback start signal may also include information about the intensity of the thermal feedback. The thermal feedback start signal may also include information on the duration of the thermal feedback.

On the other hand, when the controller 1260 and the controller 1260 determine the kind of thermal feedback and the intensity of the thermal feedback, the controller 1260 controls the skill-thermal Can be determined by referring to the feedback table.

50 is a diagram of a skill-thermal feedback table used in a third embodiment of the thermal experience providing method according to an embodiment of the present invention.

50, an identifier of the skill, an element attribute of the skill, a kind of feedback according to the attribute of the element, a tier of skill, a level of skill, a strength of thermal feedback, a time interval to provide thermal feedback, and the like are described.

The content reproduction device 1200 may transmit a thermal feedback start signal (S330). The controller 1260 can send the generated thermal feedback start signal to the feedback device 1600 through the communication module 1220. [

The feedback device 1600 may perform a thermal feedback output operation in accordance with the thermal feedback start signal, and may output thermal feedback corresponding to the thermal feedback type information (S340).

When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal. For example, the controller 1260 can determine whether to perform a heating operation, an endothermic operation, or a thermal grill operation by referring to the kind of thermal feedback, and generate a power supply signal corresponding thereto. Further, the controller 1260 can determine the magnitude of the voltage of the power supply signal by referring to the intensity of the thermal feedback.

The controller 1260 may also determine the length of time to apply the power supply signal based on the duration or duration of the thermal feedback. At this time, the controller 1260 can output the thermal feedback of a certain size during the duration of the thermal feedback, but it is also possible to gradually decrease the intensity of the thermal feedback during the duration of the thermal feedback. For example, if a virtual character is hit by a skill for the first time, it outputs a strong-intensity thermal feedback, and after the predetermined time, a special effect (for example, paralysis or slowness) It is possible to output a weak intensity of thermal feedback during a sustained period of time. According to this, the user can judge whether or not he / she is hit by strong thermal feedback, can see that the virtual character is receiving the special effect by the weak thermal feedback, and the special effect And thus the intuitiveness of the game and the user's immersion into the game can be improved.

According to the above-described method, the feedback device 1600 applies a constant voltage to the thermoelectric element during the activation of the skill of the flame attribute or against the skill of the flame attribute, applies a reverse voltage to the thermoelectric element, It is possible to control the content reproducing device 1200 to apply the constant voltage and the reverse voltage in combination.

In the following description, the description will be made on the basis that the element attribute of the skill is composed of fire / ice / lightning. It should be noted, however, that this is for convenience of explanation and that the elemental attributes of the skill may be defined differently.

In the above description, the warmth / cold feel / thermal grill feedback is matched according to the element property, but the matching of the thermal feedback for each property can be freely changed according to the designer's choice. It is also possible to utilize the neutral grill feedback / thermal grill feedback / cool grill feedback of the thermal grill feedback during the thermal feedback. For example, it is possible to match the hot grill feedback to the flame attribute, the cold grill feedback to the cold attribute, and the neutral thermal grill feedback to the electrical attribute.

Although the above description is mainly focused on the attack and the activation of the skill, similar thermal feedback can be provided for other attack actions instead of the skill. For example, an attack action may include a weapon attack in addition to a skill attack. Weapon attacks can also include melee and ranged weapons attacks.

At this time, the element attribute of the attack action can be determined according to the element attribute of the skill attack or the element attribute of the weapon attack. The elemental attribute of a weapon attack can also be determined according to the attribute of the element attached to the weapon used in the weapon attack or the attribute of the element assigned to the launch vehicle (or projection) if the weapon is a ranged weapon. At this time, when elemental attributes are assigned to both ranged weapons and launch vehicles, one of the two elemental attributes can be prioritized to determine the elemental attribute of the weapon attack.

The intensity of the thermal feedback can be determined based on at least one of the skill's tiers on the skill tree including the skill level, the damage amount of the skill, and the plurality of skills having the same element attribute in the case of an attack attack And if the attacking action is a weapon attack, it may be determined based on at least one of the rating of the weapon, the attack power of the weapon, the rating of the launch vehicle, and the attack power of the launch vehicle.

In addition, the intensity of the thermal feedback may be determined based on at least one of the attack power of the attack action, the damage amount of the player according to the shot event, the ratio of damage to the player's total health points, and the remaining health points of the player.

It is also possible, for example, to match thermal feedback according to the type of weapon. For example, if the shot weapon is a cold sorter such as a knife or a spear, the hot grill feedback can be matched to the thermal grill feedback in the case of firearms such as guns, lasers, and cannons.

According to the above-described embodiment, it is possible to improve the user's enjoyment and immersion of the game by outputting thermal feedback suitable for the attribute of the skill according to the invocation or attack of the skill in the game.

4.4. Fourth embodiment

The fourth embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting the thermal feedback to the emotional expression of the character or the fingerprint selection while the game is running.

Here, the emotional expression of the character may include pleasure, angryness, fear, and the like. In some cases, an emotion state of a character is defined as a kind of attribute of a character in a game. In some cases, however, an attribute that directly reflects an emotion state is given to a character instead of a character. Emotional states can be expressed by creating facial expressions. In this embodiment, the emotional expression should be interpreted as a comprehensive meaning including a specific action or a specific expression in which a character expresses emotions, as well as an attribute directly indicating emotion.

Here, the fingerprint selection means selecting one of the fingerprints provided to the user during the progress of the game. For example, in a situation where a player character (PC: Playable Character) operated by a user is in conversation with a non-playable character (NPC), or in a situation in which a user must make a decision, Fingerprints can be presented, and the user can select any one of the fingerprints.

51 is a flowchart of a fourth embodiment of the thermal experience providing method according to the embodiment of the present invention.

Referring to FIG. 51, a fourth embodiment of the thermal experience providing method includes executing a game that includes a virtual character performing emotional expression or providing a fingerprint selected by a user (S410) (S430) generating a thermal feedback start signal including thermal feedback type information corresponding to the emotional expression or fingerprint selection when an event or a fingerprint presentation event is sensed, transmitting a thermal feedback start signal (S430) And performing a thermal feedback output operation according to the start signal, and outputting thermal feedback corresponding to the thermal feedback type information (S440).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may execute a game that includes a virtual character performing emotional expression or provides a fingerprint selected by the user (S410). The controller 1260 may execute a game that includes a virtual character performing emotional expression or provides a fingerprint selected by the user.

The content reproduction device 1200 may generate a thermal feedback start signal including a thermal feedback type information corresponding to the emotional expression or the fingerprint selection when the emotional expression event of the virtual character or the fingerprint presentation event is sensed (S420). The controller 1260 can sense the emotional expression event of the virtual character during the game progress. For example, a character's emotional expression event may be caused by user's inputting a specific action or a specific expression by a user, or may occur in a specific situation of a character's conversation. Also, the controller 1260 can detect a fingerprint presentation event. The fingerprint presentation event can be caused mainly by the player character performing the dialog action on the non-player character or during the progress of the story during the game progress.

When the emotional expression event or the fingerprint presentation event occurs, the controller 1260 can determine the type of the selected fingerprint according to the kind of the emotional expression or the fingerprint presentation event represented by the character. The controller 1260 can determine the type of thermal feedback according to the type of the determined emotion expression or the type of the selected fingerprint. Here, the controller 1260 can determine the type of thermal feedback by referring to the emotion / fingerprint-thermal feedback type table stored in the memory 1240 or the game program. The emotion / fingerprint-thermal feedback type table may define the type of thermal feedback depending on the emotion state and the type of fingerprint.

52 is a diagram related to a fingerprint presentation event provided in the fourth embodiment of the thermal experience providing method according to the embodiment of the present invention.

Referring to FIG. 52, fingerprints that the user can select from among the dialog between the playerble character and the non-player character are presented. The controller 1260 may receive user input from the input device via the communication module 1220 to select / select a particular fingerprint and thus determine the type of thermal feedback.

The content reproduction device 1200 may transmit a thermal feedback start signal (S430). The controller 1260 may transmit a thermal feedback start signal including the thermal feedback type information to the feedback device 1600 via the communication module 1220. [

The feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, and may output thermal feedback corresponding to the thermal feedback type information (S440).

When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal. For example, the controller 1260 can determine whether to perform a heating operation, an endothermic operation, or a thermal grill operation by referring to the kind of thermal feedback.

According to the above-described embodiment, it is possible to improve the user's game immersion degree by providing thermal feedback suitable for the emotion of the virtual character, such as outputting warm feedback when the virtual character is angry and outputting cold feedback when the user is frightened. Similarly, when the fingerprint of a virtual character is selected, appropriate thermal feedback is provided for each fingerprint in the game by outputting warm feedback to a fingerprint that makes a good decision and outputting cold feedback to a fingerprint that makes an evil decision, Can be improved.

4.5. Fifth embodiment

A fifth embodiment of the thermal experience providing method according to an embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback to a moving speed in a game while driving the game. Here, the movement speed may mean the movement speed of the player character in the virtual space in the game.

53 is a flow chart of a fifth embodiment of the thermal experience providing method according to the embodiment of the present invention.

Referring to FIG. 53, a fifth embodiment of the thermal experience providing method includes executing a game implementing a character moving within a virtual space and a virtual space (S510), calculating a thermal feedback corresponding to the moving speed Generating a thermal feedback start signal including intensity information (S520), transmitting a thermal feedback start signal (S530), and performing a thermal feedback output operation in accordance with the thermal feedback start signal, And outputting thermal feedback (S540).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may execute a game implementing a character moving within a virtual space and a virtual space (S510). The controller 1260 can execute a game including a character moving in a virtual space and a virtual space. Here, the character may be a virtual character controlled by the user of the game contents in the virtual space of the game. The virtual character is outputted on the screen in the game of the third person view, but not displayed on the screen in the first person game or only a part of the virtual character may be displayed on the screen. Alternatively, in a game using a virtual reality technique, a body of a user or an input device can be a character.

The content reproduction device 1200 may generate a thermal feedback start signal including thermal feedback intensity information corresponding to the moving speed of the character during movement (S520). The controller 1260 can sense the movement of the character in the virtual space of the game. For example, the movement of the character can be made according to a user input indicating movement of the character. The controller 1260 may acquire a user input from the input device through the communication module 1220 to direct the movement of the character so as to move the character or manipulate the movement of the character. In addition, a character may move on a ride provided in a virtual space of a game. For example, in a game such as a racing game or a plate simulation, an airplane or an automobile may correspond to a character, and may be moved according to a user's operation. The controller 1260 can determine the thermal feedback intensity according to the movement speed of the character in the virtual space. For example, the controller 1260 can increase the intensity of the thermal feedback as the moving speed of the character in the virtual space becomes faster. When the intensity is determined, the controller 1260 can generate a thermal feedback start signal including the thermal feedback intensity information.

The content reproduction device 1200 may transmit a thermal feedback start signal (S530). The controller 1260 may transmit a thermal feedback start signal including thermal feedback intensity information to the feedback device 1600 via the communication module 1220. [

The feedback device 1600 may perform a thermal feedback output operation in accordance with the thermal feedback start signal, and may output thermal feedback corresponding to the thermal feedback intensity information (S540).

When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal. For example, the controller 1260 can adjust the output intensity of the thermal feedback by adjusting the voltage value of the power supply by referring to the intensity of the thermal feedback.

In this embodiment, the thermal feedback is mainly output as cold feedback. As a result, it can be expressed as a thermal experience when the speed of movement is accelerated in the real world.

On the other hand, in this embodiment, it is also possible to output the warm feedback temporarily when the movement of the character ends. The controller 1260 generates a thermal feedback start signal including the thermal feedback information for indicating whether or not the movement of the character has been completed and which indicates the warm feedback when the movement is completed and transmits the thermal feedback start signal to the feedback device 1600 ). The feedback signal can thus output a warm feedback. According to such warm feedback, the user can experience the instantaneous feel of the body instantaneously when the movement is stopped in the real world.

4.6. Sixth embodiment

The sixth embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback in conjunction with a fitness point of a character at the time of game driving.

54 is a flowchart of a sixth embodiment of a method for providing a thermal experience according to an embodiment of the present invention.

54, a sixth embodiment of the thermal experience providing method includes a step (S610) of executing a game in which a virtual character having a physical strength point appears, a change of a physical strength point of the character, a remaining physical strength point or a maximum physical strength point (S620) generating a thermal feedback start signal including thermal feedback information corresponding to at least one of a ratio of the relative remaining power point to a relative remaining power point, transmitting (S630) a thermal feedback start signal including thermal feedback information And performing a thermal feedback output operation according to the start signal, and outputting thermal feedback corresponding to the thermal feedback information (S640).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 can execute a game in which a character having a health point appears (S610). The controller 1260 may execute a game including a character operated by the user. Stamina points can be assigned to characters. The health point may be information indicating the life force of the character in the game. For example, if the character's health points are exhausted, the character may die within the game. The health point can be increased or decreased depending on the event in the game. For example, a health point may be reduced if the character is hit, and a health point may be increased if the character uses a healing skill or a recovery item.

The content reproducing device 1200 may generate a thermal feedback signal including thermal feedback information corresponding to at least one of a change in the physical fitness point of the character, a remaining physical fitness point, or a ratio of remaining physical fitness points to a maximum physical fitness point (S620) .

The controller 1260 can generate the thermal feedback information according to the change of the fitness point when the fitness point is changed during the game progress.

In one example, the controller 1260 may determine the type of thermal feedback depending on whether the fitness point is reduced or increased. For example, the controller 1260 can determine the type of thermal feedback as cold feedback when the fitness point is reduced. As another example, the controller 1260 can determine the kind of thermal feedback as the warm feedback when the fitness point is increased.

As another example, the controller 1260 can determine the strength of the thermal feedback according to the magnitude of the variation of the fitness point. For example, the controller 1260 can strongly determine the intensity of the thermal feedback as the variation amount of the fitness point is larger.

Or the controller 1260 may determine the thermal feedback information according to the ratio of the change amount of the fitness point to the entire fitness point. For example, the controller 1260 can strongly determine the strength of the thermal feedback as the ratio of the amount of change in the physical strength to the whole fitness point is larger.

Further, the controller 1260 can determine the thermal feedback information according to the remaining fitness point. For example, the controller 1260 can determine the strength of the thermal feedback more strongly as the remaining fitness point is smaller. As another example, the controller 1260 may determine the type of thermal feedback based on the value of the remaining fitness point. For example, the cold feedback can be determined as the thermal feedback type when the value of the remaining health point is the first range, and the warm feedback can be determined as the thermal feedback type when the remaining range is the second range.

Or the controller 1260 may determine the thermal feedback information according to the ratio of the remaining fitness points to the total fitness points. For example, the controller 1260 can determine the strength of the thermal feedback more strongly as the fitness ratio is lower. As another example, the controller 1260 may determine the type of thermal feedback according to the fitness ratio. For example, cold feedback can be determined when the fitness ratio is in the first range, and warm feedback can be determined as the thermal feedback type when the fitness ratio is in the second range.

As such, when the thermal feedback information is determined, the controller 1260 can generate a thermal feedback start signal including thermal feedback information.

The content reproducing device 1200 may transmit a thermal feedback start signal including thermal feedback information (S630). The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [

The feedback device 1600 may perform a thermal feedback output operation in accordance with the thermal feedback start signal, and may output thermal feedback corresponding to the thermal feedback information (S640).

When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

Accordingly, when the change in the fitness point occurs, the feedback device 1600 outputs different thermal feedback depending on the change amount of the fitness point, the ratio of the change amount to the entire fitness point, the ratio of the remaining health point to the total health point, Can be output.

In the above description, it is described that the thermal feedback information is determined so as to correspond to the fitness point, but it is also possible that the thermal feedback information corresponds to the other points implemented in the game. For example, in the case of a racing game, it is also possible to link fuel amount points to thermal feedback instead of fitness points. As another example, it is also possible to couple thermal feedback to mana points used when using magic techniques. That is, this embodiment is applicable to resource points that are increased or decreased in association with characters in the game.

Meanwhile, in the present embodiment, when a plurality of resources to be increased or decreased in association with a character are provided, it is also possible to assign different types of thermal feedback to each resource. For example, the controller 1260 drives a game for operating a character having a resource point that is increased or decreased in a game including a physical strength point and a mana point, and controls a change amount of a resource point, a change in a resource point, Generates thermal feedback information corresponding to at least one of a ratio of resource points of the remaining resource points to a resource point, and transmits a thermal feedback start signal including the generated information to the feedback device 1600 through the communication module 1220, The controller 1645 may output a thermal feedback operation in accordance with the thermal feedback information. At this time, the controller 1260 can determine the type of thermal feedback to correspond to the type of resource. For example, warm feedback can be determined for a fitness point and cold feedback for a mana point can be determined by thermal feedback.

According to the above-described embodiment, it is possible to provide the user with information on the physical condition of the character in the game through thermal feedback, thereby providing an intuitive understanding of the game to the user, and improving the immersion of the game.

4.7. Seventh embodiment

A seventh embodiment of the thermal experience providing method according to an embodiment of the present invention is a method of providing a thermal experience to a user by interlocking and outputting thermal feedback reflecting user input timing at the time of game driving.

55 is a flowchart of a seventh embodiment of the thermal experience providing method according to the embodiment of the present invention.

55, a seventh embodiment of the thermal experience providing method includes a step (S710) of executing a game in which a timing action for outputting a different result according to an input timing is provided (S710), a thermal Generating a thermal feedback start signal including feedback information (S720), transmitting a thermal feedback start signal including thermal feedback information (S730), and performing a thermal feedback output operation in accordance with the thermal feedback start signal, And outputting thermal feedback corresponding to the feedback information (S740).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may execute a game in which a timing action is output to output a different result according to the input timing (S710).

The controller 1260 can execute the game. Here, the game executed in this embodiment may include a timing action. Here, the timing action means an operation of outputting a different result according to the input timing of the user.

Figure 56 is a diagram of a game providing a timing action according to a seventh embodiment of a method for providing a thermal experience according to an embodiment of the present invention.

56 is an example of a game including a timing action, which is a screen of a game in which an arrow is fired in a virtual space. In the game according to FIG. 56, the arrow firing distance can be increased in proportion to the time of pulling the arrow. When the user presses the button to which the arrow firing action is assigned, the action of pulling the arrow starts. When the button is continuously pressed, the arrow protrusion is continuously pulled out gradually. When the button is released, the arrow may be fired. 56 is provided with a gauge that reflects the extent to which the arrow protrusion has been pulled, allowing the user to play the game while visually confirming the timing for the arrow firing. Other examples of timing actions are shooting actions that continuously increase the intensity of shoots in a soccer game, and actions that request user input in accordance with music notes in a rhythm game.

The content reproduction device 1200 may generate a thermal feedback start signal including thermal feedback information corresponding to the input timing at the time of performing the timing action (S720).

For example, the controller 1260 may count the elapsed time from the point of time when a timing action occurs during game progress, and determine the strength of the thermal feedback according to the elapsed time. For example, the larger the elapsed time, the greater the thermal feedback strength can be determined.

As another example, the controller 1260 may determine the thermal feedback strength according to the magnitude of the time interval between a predetermined specific time and the elapsed time. For example, the closer the elapsed time is to a particular time, the greater the intensity of the thermal feedback can be determined.

As another example, the controller 1260 may determine the thermal feedback strength according to whether the elapsed time has passed a predetermined, predetermined time. For example, the larger the elapsed time is, the larger the thermal feedback intensity is determined until the elapsed time passes the specific time, and the thermal feedback is not output when the elapsed time exceeds a certain time.

As another example, the controller 1260 may determine the type of thermal feedback depending on whether the elapsed time has passed a predetermined specific time. For example, the warm feedback is determined as the thermal feedback type until the elapsed time passes the specific time, and the cold feedback can be determined as the thermal feedback type when the specific time passes.

As such, when the thermal feedback information is determined, the controller 1260 can generate a thermal feedback start signal including thermal feedback information.

The content reproduction device 1200 may transmit a thermal feedback start signal including thermal feedback information (S730). The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [

The feedback device 1600 may perform a thermal feedback output operation according to the thermal feedback start signal, and may output thermal feedback corresponding to the thermal feedback information (S740). When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

According to the above-described embodiment, the input timing can be informed to the user through the thermal feedback, thereby giving the user intuitiveness to the game.

4.8. Eighth embodiment

The eighth embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback according to attributes of a virtual space in a game.

57 is a flowchart of an eighth embodiment of the thermal experience providing method according to the embodiment of the present invention.

Referring to FIG. 57, the eighth embodiment of the thermal experience providing method includes the steps of executing a game in which a temperature attribute is given to a virtual space (S810), calculating a thermal feedback information (S820) generating a thermal feedback start signal including the thermal feedback start signal, transmitting a thermal feedback start signal (S830), and performing a thermal feedback output operation according to the thermal feedback start signal, (Step S840).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 can execute a game in which a temperature attribute is assigned to a virtual space (S810). The controller 1260 can execute the game. The virtual space in the game may be given a temperature attribute. For example, the area-temperature property table may be stored in the memory 1240 or the game program, and the area-temperature property table may have a temperature property matched to each area.

58 is a view showing a virtual space in a game in the eighth embodiment of the thermal experience providing method according to the embodiment of the present invention.

58, the virtual space in the game may include a flame area, a glacier area, a plains area, a lake area, and the like as a global area. Here, the flame region is given a thermal property, and the glacier region may have a cold property.

The content reproducing device 1200 may generate a thermal feedback start signal including thermal feedback information corresponding to a temperature attribute of the virtual space upon entering the virtual space (S820).

The controller 1260 can check the location of the user in the virtual space in the player character or the virtual reality game in real time to determine the presently located area. Or the controller 1260 can determine the entry area when the player character or the user in the virtual space enters a specific area. If the current area or the entry area is determined, the controller 1260 can determine the thermal feedback information according to the temperature property of the corresponding area with reference to the area-temperature table.

For example, the type of thermal feedback can be determined according to the temperature property. For example, the kind of the thermal feedback can be determined as warm-feeling feedback in the case of a thermal property and cold feedback in the case of a cold-heat property.

As another example, the intensity of the thermal feedback can be determined according to the temperature property. For example, the temperature attribute may include a value corresponding to the temperature value, and the controller 1260 may determine the intensity of the thermal feedback according to the value.

Once the thermal feedback intensity is determined, the controller 1260 may generate a thermal feedback start signal including thermal feedback intensity information.

The content reproduction device 1200 transmits a thermal feedback start signal including thermal feedback information (S830), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S840).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

On the other hand, in this embodiment, the user can be located in a plurality of areas in the player character or the lyric reality. A region that is implemented in the virtual space may have a class, and an upper class region may include a lower class region. For example, the virtual space may be a global area which is the largest area class, a local area included in the global area as a sub area of the global area, a sub-local area included in the local area as a sub area of the local area, or the like. Referring to FIG. 58, a flame area includes a volcanic area, a lake area includes a mountain area and a lake area, a plains area includes a lake area and a village area, and a glacier area may include a hot spring area and a village area have. Here, if a flame region, a plain region, a lake region, and a glacier region are local regions, the subregion may be a sub-local region.

Here, when the player is in the glacier area, the glacier area is assigned cold feedback, but the sub area of the glacier area may be assigned warm feedback to the hot zone. At this time, if the player is in the hot zone, the player is present in the ice zone and the hot zone at the same time. At this time, the thermal feedback assigned to the lower region can be applied to the upper region. In other words, it provides gentle feedback in the hot springs area, and gives cold feedback according to the glacier area when it comes out from the hot springs area to the glacier area again. In addition, weak thermal feedback in the flame region and strong thermal feedback in the volcanic region can give weak thermal feedback in the flame region except for the volcanic region and strong thermal feedback in the volcanic region.

As such, when the user is located in a plurality of areas, the content reproducing device 1200 can determine which position to provide the thermal experience. Specifically, the controller 1260 can determine the area to be associated with the thermal experience according to the grade of the area. For example, the controller 1260 may determine a narrower region, that is, a lower region of a lower rank among the plurality of regions, as a target region, and includes thermal feedback information corresponding to the temperature property of the target region A thermal feedback start signal can be generated.

According to the above-described embodiment, when a player character enters the virtual space, or when the user enters the virtual space in the virtual reality, the user can provide a realistic thermal experience by outputting thermal feedback suitable for the environment of the region can do.

4.9. Ninth embodiment

The ninth embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback according to a shot event in the game.

59 is a flowchart of a ninth embodiment of a thermal experience providing method according to an embodiment of the present invention.

59, a ninth embodiment of a method for providing a thermal experience includes a step (S910) of executing a game using a physics engine that supports collision events and trigger events for processing a shot event by a virtual object (S910) Generating a thermal feedback start signal including thermal feedback information determined so as to correspond to whether a processing event is a collision event or a trigger event when a shot event is generated by a virtual object for a user in a virtual character game or a virtual reality game ), Transmitting a thermal feedback start signal (S930), and outputting thermal feedback corresponding to the thermal feedback information (S940), performing a thermal feedback output operation according to the thermal feedback start signal.

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may execute a game using a physical engine supporting collision event and trigger event for processing a shot event by a virtual object (S910).

The controller 1260 can execute the game. The game executed in this embodiment may be a game for processing a shooting event by a virtual object occurring in a virtual space using a physical engine.

Here, the physical engine is software used to simulate physical phenomena in the fields of computer graphics, video games, movies, and the like. The physics engine is mainly utilized in the above-mentioned field for realizing image processing, and is provided as a middleware for computing physical phenomena in real time in the game field. Representative functions of the physical engine include conflict processing between virtual objects, light source processing, and the like.

In addition, the hit event means a player character operated by a user or a user in a virtual reality hit by a virtual object (get hit). In this implementation, the game may process the hit event as a collision event or a trigger event using the physical engine.

Specifically, the physical engine can give the collision determination attribute to the virtual object. The collision determination attribute may include a collision attribute and a trigger attribute. In a virtual space implemented by a physical engine, a virtual object to which a collision attribute is assigned is processed to be able to collide with another virtual object. Conversely, a virtual object to which a trigger attribute is assigned is handled as not colliding with another virtual object.

Thus, if at least some of the two virtual objects are located at the same coordinates in the virtual space, if both attributes of the two virtual objects are collisions, the physical engine treats them as collision events and at least one of the two virtual objects The physical engine can treat it as a trigger event. Here, according to the collision event, the spaces of two virtual objects do not overlap with each other but react as if they are collided with each other in a real world. According to a trigger event, spaces of two virtual objects overlap each other, .

Since the player character or the user of the virtual reality mainly has the collision attribute, when the collision determination attribute of the hit object, that is, the player object or the virtual object to which the user of the virtual reality is hit, is collision property, the collision event And in the case of a trigger attribute, a trigger event can be generated.

For example, when a player character falls from a high ground to a ground, the ground has mainly collision attributes, so collision events can occur. Similarly, other characters and vehicles in the game also have collision attributes, which can cause collision events when they are hit. In another example, in a shooting game, a bullet is mainly given a trigger attribute, so a trigger event occurs when a character is hit by a bullet.

The content reproduction device 1200 may include thermal feedback information including thermal feedback information determined to correspond to whether a processing event is a collision event or a trigger event when a shot event is generated by a virtual object for a user in a player character or a virtual reality game A start signal can be generated (S920).

The controller 1260 can determine whether the processing method is a collision event or a trigger event when a shot event occurs. This can be judged based on the hit determination attribute of the hit. The controller 1260 may determine the strength of the thermal feedback in a different manner for the collision event and the trigger event.

In one example, the controller 1260 may determine the strength of the thermal feedback based on the amount of impact computed in the physics engine if the hit event is a collision event. For example, the larger the impact amount, the stronger the thermal feedback strength can be set. At this time, the impulse amount in the physical engine can be calculated based on the relative speed of the virtual object and the mass value given to the virtual object. That is, as the mass of the impacted object is large and the relative velocity to the character is high, the intensity of the thermal feedback can be strongly determined.

As another example, when the shot event is a trigger event, the controller 1260 does not calculate the amount of impact in the physical engine at the time of the trigger event. Therefore, the controller 1260 calculates the intensity of the thermal feedback according to the speed of the virtual object, the type of the virtual object, Can be determined. For example, if hit by a bullet having a trigger attribute, the controller 1260 can strongly determine the strength of the thermal feedback as the absolute velocity of the bullet in the virtual space is greater. In another example, if hit by a bullet with a trigger attribute, the controller 1260 may determine the intensity of the thermal feedback according to the type of bullet. For another example, if hit by a bullet with a trigger attribute, the controller 1260 can determine the intensity of the thermal feedback according to the type of weapon that fired the bullet. At this time, the controller 1260 can refer to the table in which the thermal feedback intensity is set for each type of the weapon. For example, the stronger the weapon, the stronger the thermal feedback strength. Here, in order to set the intensity of the thermal feedback according to the type of the bullet or the weapon, the controller 1260 can refer to the table in which the thermal feedback intensity for each type of bullet / launch vehicle is set.

The content reproducing device 1200 transmits a thermal feedback start signal including thermal feedback information (S930), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S940).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

According to the above-described embodiment, realistic thermal feedback on a shooting event occurring on a virtual space can be output to give a sense of reality to a user. Particularly, in the case of being hit by the virtual object of the collision attribute, the thermal feedback corresponding to the actual reality can be obtained by adjusting the intensity of the thermal feedback using the amount of impact calculated by the physical engine. In addition, since the virtual object of the trigger attribute has difficulty in calculating the amount of impact, it is possible to use other appropriate parameters instead of the amount of impact in order to simplify and realistically process the amount of calculation according to the shot.

4.10. Tenth embodiment

The tenth embodiment of the thermal experience providing method according to an embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback interlocked according to thermal transfer properties of a virtual object in a game.

60 is a flowchart of a tenth embodiment of the thermal experience providing method according to the embodiment of the present invention.

Referring to FIG. 60, a tenth embodiment of a thermal experience providing method includes a step of executing a game including a virtual object to which a heat transfer attribute is imparted (S1010), a step of acquiring thermal feedback information (S1030) of generating a thermal feedback start signal including the thermal feedback start signal, transmitting a thermal feedback start signal (S1030), and performing a thermal feedback output operation in accordance with the thermal feedback start signal, (Step S1040).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may execute a game including a virtual object to which a heat transfer attribute is assigned (S1010).

The controller 1260 can execute the game. Meanwhile, in this embodiment, the game includes a virtual object, and the virtual object may be given a heat transfer attribute. Here, the heat transfer attribute may indicate how the virtual object delivers the heat to the user.

The virtual object to which the heat transfer attribute is assigned can be treated as a heat source in the game. The heat source may include a conduction heat source and a radiation heat source. The conduction heat source can transfer heat only when it is in substantial contact with the user (or player character). The radiant heat source can transmit heat even when away from the user (or playerable character).

The content reproducing device 1200 may generate a thermal feedback start signal including thermal feedback information in consideration of the thermal transfer property of the virtual object (S1020).

The controller 1260 may generate a thermal feedback start signal including thermal feedback information in consideration of the thermal transfer property of the virtual object.

For example, the controller 1260 can determine whether the user (or the player character) and the virtual object are in contact with each other when the heat transfer attribute of the virtual object is the conductive heat source. Controller 1260 may generate a thermal feedback start signal when contacted by the user (or player character) with respect to the conductive heat source. At this time, the controller 1260 can determine the type of thermal feedback and the strength of the thermal feedback based on the temperature imparted to the conduction heat source. Conversely, the controller 1260 may not generate a thermal feedback start signal when the conductive heat source is spaced apart from the user (or playerable character).

In another example, the controller 1260 may generate a thermal feedback start signal even when the user (or the player character) and the virtual object are spaced apart when the thermal transfer attribute of the virtual object is a radiation heat source. At this time, the controller 1260 can determine the type of thermal feedback based on the temperature imparted to the radiant heat source. The controller 1260 may also determine the thermal feedback strength according to the temperature imparted to the heat source.

On the other hand, when determining the thermal feedback information for the radiant heat source, the controller 1260 may further consider the type of radiant heat source and the distance between the user (or playerable character) and the radiant heat source.

Radiation heat sources can be divided into several types depending on the relationship between heat source distance and heat transfer. For example, a radiant heat source may include a radiant heat source, a directional heat source, and an area heat source. Here, the radiant heat source is a heat source in which the transmitted heat becomes weaker as the distance from the heat source increases. A direct heat source is a heat source that always transmits a constant heat regardless of the distance from the heat source. The area heat source is a heat source that transfers heat only to a region within a predetermined distance from a heat source and does not transmit heat to a region beyond a predetermined distance. Also, the area heat source can be set to always transmit a constant heat source for an area within a set distance, or to transmit a weak heat as the distance increases.

Accordingly, in the case where the radiation heat source is a radiation heat source, the controller 1260 can set the thermal feedback intensity to be stronger as the distance from the user (or the playerable character) becomes closer. On the contrary, the controller 1260 can set the thermal feedback intensity in consideration of the temperature of the heat source regardless of the distance to the user (or the playerable character) when the radiation heat source is a direct heat source. If the radiating heat source is an area heat source, the controller 1260 may determine the thermal feedback intensity according to the temperature of the heat source when the user (or the player character) is within a predetermined area from the heat source, The thermal feedback strength can be determined in consideration of the distance of the heat source to the heat source and the temperature of the heat source, and the thermal feedback start signal can be not generated when the user (or the playerable character) is outside the predetermined region.

Meanwhile, in order to calculate the heat transmitted by the heat source in the game, the game of this embodiment may use the physical engine described in the thermal experience providing method according to the embodiment of the present invention.

When the thermal feedback information is determined, the controller 1260 can generate a thermal feedback start signal including the thermal feedback information.

The content reproduction device 1200 transmits a thermal feedback start signal including thermal feedback information (S1030), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S1040).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

According to the above-described embodiment, the heat transmitted to the user or the player character can be calculated according to the distance of the heat source on the virtual space, and the corresponding thermal feedback can be outputted to give the user a sense of reality.

4.11. 11th embodiment

An eleventh embodiment of the thermal experience providing method according to an embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback interlocked according to thermal conductivity of a virtual object in a game.

61 is a flowchart of an eleventh embodiment of the method for providing thermal experience according to the embodiment of the present invention.

Referring to FIG. 61, an eleventh embodiment of a thermal experience providing method includes: executing a game including a virtual object to which surface attributes related to thermal conduction are imparted (S1110); determining whether a user or a playerable character (S1120) generating a thermal feedback start signal including thermal feedback information determined in association with a surface property when a touch event or a grip event occurs; transmitting a thermal feedback start signal (S1130) And performing a thermal feedback output operation, and outputting thermal feedback corresponding to the thermal feedback information (S1140).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproducing device 1200 may play a game including a virtual object to which a surface attribute related to thermal conduction is imparted, in an eleventh embodiment of the thermal experience providing method (S1110).

The controller 1260 can execute the game. Meanwhile, in this embodiment, the game includes a virtual object, and the virtual object may be given a surface attribute related to thermal conduction. Here, the surface property (material property or texture property) defines the size of a column transmitted from the virtual object to the user (or the player character) when the user (or the player character) grips or touches the virtual object.

The content playback device 1200 may generate a thermal feedback start signal that includes thermal feedback information that is determined in association with a surface attribute of a virtual object upon a touch event or a grip event of a user or player character for the virtual object S1120).

The controller 1260 may generate a thermal feedback start signal when a touch event or a grip event occurs. Here, the controller 1260 can determine the thermal feedback information to be included in the thermal feedback start signal.

As an example, the type of thermal feedback can be determined based on the temperature imparted to the virtual object. For example, the type of thermal feedback among the temperature and warm feedback, cold feedback and thermal grill feedback given to the virtual object can be selected. The controller 1260 may also determine the strength of the thermal feedback based on the temperature of the heat source.

When the thermal feedback information is determined, the controller 1260 can generate a thermal feedback start signal including the thermal feedback information.

The content reproduction device 1200 transmits a thermal feedback start signal including thermal feedback information (S1030), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S1040).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

The content reproduction device 1200 transmits a thermal feedback start signal including thermal feedback information (S1130), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S1140).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

According to the above-described embodiment, the user can give a sense of reality to the user by outputting thermal feedback corresponding to the touch or grip between the virtual object and the user in the virtual space.

4.12. 12th embodiment

A twelfth embodiment of the thermal experience providing method according to an embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback interlocked in consideration of the priority of a thermal event when a thermal event occurs in a game.

In a multimedia environment, including games, thermal events can occur simultaneously.

Here, a thermal event means an event that induces the output of thermal feedback. Examples of the thermal event include a change in the fitness point in the sixth embodiment of the thermal experience providing method described above, an entry into the temperature-imparted area in the eighth embodiment of the thermal experience providing method described above, In the ninth embodiment of the thermal experience providing method described above, a shot event or the like may be included.

For example, a shooting event may be generated in which the warm-feeling feedback is induced in a state in which the player character enters the area for inducing cold feedback.

At this time, the content playback device 1200 may determine the priority of the thermal events, and may cause the priority to output thermal feedback for the preceding thermal event.

For example, in the case of a bullet which induces warm feedback in a lake area inducing cold feedback, the priority according to the entering of the lake area and the priority according to the shot bullet are determined, and the priority according to the shot bullet is determined If it is high, warm feedback will be output first.

Specifically, the controller 1260 outputs the output of the thermal feedback according to the shot event until the end of the thermal feedback according to the shot event when the shot event inducing the thermal feedback occurs in the state that the controller 1260 enters the region to induce the thermal feedback. And transmits it to the feedback device 1600 via the communication module 1220 so that the feedback controller 1645 can generate a thermal feedback signal based on the thermal feedback information, Thereby performing a feedback output operation.

In summary, when there is an area event entering the thermal event and an object event interacting with the virtual object by the player, the thermal feedback based on the object event can be prioritized over the thermal feedback according to the area entry event will be.

Specifically, thermal feedback based on an area event is output in an area entry state, and when an object event occurs in this state, thermal feedback according to an object event is output. When the object event ends, the thermal event according to the area event can be resumed.

4.13. Thirteenth Embodiment

The twelfth embodiment of the thermal experience providing method according to the embodiment of the present invention described above relates to which thermal event should be prioritized when a thermal event occurs at the same time.

However, it is also possible to combine two thermal events for a thermal event occurring at the same time to perform thermal feedback output.

For example, when warm feedback and cold feedback are output at the same time, thermal grill feedback can be output. At this time, if the intensity of the warm-feeling feedback is stronger than the intensity of the cold feedback, the content reproducing device 1200 may output the hot grill feedback, and in the opposite case, output the cold grill feedback.

That is, the controller 1260 may generate a thermal feedback start signal so that the thermal event that derives the warm feedback and the thermal event that derives the cold feedback simultaneously output the thermal grill feedback. Further, the controller 1260 can determine the type of the thermal grill feedback by comparing the intensity of the warm feedback and the intensity of the cold feedback. For example, when the strength of the warm feedback is strong, the thermal grill feedback is obtained. When the strength of the cold feedback is strong, the type of the thermal feedback can be determined by the cooling grill feedback.

The controller 1260 then transmits the thermal feedback start signal generated through the communication module 1220 to the feedback device 1600. The feedback device 1600 refers to the thermal feedback information included in the thermal feedback start signal, Output operation can be performed.

4.14. 14th embodiment

The fourteenth embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback interlocked in consideration of a thermal resistance of a character when a thermal event occurs in a game.

62 is a flowchart of a fourteenth embodiment of a method for providing a thermal experience according to an embodiment of the present invention.

Referring to FIG. 62, a fourteenth embodiment of a method for providing a thermal experience includes a step (S1410) of executing a game in which a player character or a player in a virtual space is given a thermal resistance degree (S1410) (S1420) generating a thermal feedback start signal including the determined thermal feedback intensity information, transmitting a thermal feedback start signal (S1430), and performing a thermal feedback output operation in accordance with the thermal feedback start signal, And outputting the corresponding thermal feedback (S1440).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 can execute a game in which a player character or a player in the virtual space is given a thermal resistance degree (S1410).

The controller 1260 can execute the game. Here, in the game executed in this embodiment, thermal resistance can be given to the player character or the user avatar in the virtual reality. Thermal resistance can be assigned to a character or avatar in the form of a stamina. In addition, if a character or an avatar is equipped with such equipment, it is possible to add thermal resistance of the form and the thermal resistance of the equipment to the weapon or armor that the character or avatar can mount in the game. The thermal resistance of the character can be determined.

The content reproducing device 1200 may generate a thermal feedback start signal including thermal feedback intensity information determined in consideration of thermal resistance in the occurrence of a thermal event (S1420).

The controller 1260 can process the thermal feedback information according to the thermal event when the thermal event occurs. At this time, if the character is given a thermal resistance, the controller 1260 can adjust the intensity of the thermal feedback in consideration of the thermal resistance of the character. For example, the higher the thermal resistance, the lower the intensity of the thermal feedback.

On the other hand, the thermal resistance may be classified into a warmth resistance / a cold resistance / a sensory resistance. In this case, when a thermal event occurs, the controller 1260 determines the type of thermal feedback induced according to the thermal event, selects the type of thermal resistance to be considered according to the type of thermal feedback, The intensity of the thermal feedback can be adjusted.

The content reproduction device 1200 transmits a thermal feedback start signal including thermal feedback information (S1430), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S1440).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

According to the above-described embodiment, since the intensity of the thermal feedback is adjusted according to the thermal resistance in the virtual space, it is possible to provide a thermal experience reflecting the degree of equipment and growth of the character in a role playing game (RPG) have.

4.15. 15th embodiment

The fifteenth embodiment of the thermal experience providing method according to the embodiment of the present invention is a method for providing thermal experience by correlating thermal feedback in consideration of the size of an image related to a thermal event displayed in a field of view (FOV) Thereby providing a user with a thermal experience.

63 is a flowchart of a fifteenth embodiment of a thermal experience providing method according to an embodiment of the present invention.

Referring to FIG. 63, a fifteenth embodiment of a thermal experience providing method includes executing a game including a thermal event (S1510), calculating a thermal feedback determined by an area occupied by the image related to a thermal event in the FOV (S1520) generating a thermal feedback start signal including the intensity information, transmitting a thermal feedback start signal (S1530), and performing a thermal feedback output operation in accordance with the thermal feedback start signal, And outputting feedback (S1540).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 may execute a game including a thermal event (S1510). This can be performed by the controller 1260. Also, the controller 1260 can output a video signal during the game, which may be a video signal according to the FOV of the virtual camera 1480 in the virtual space.

The content reproducing device 1200 may generate a thermal feedback start signal including thermal feedback intensity information determined according to an area occupied by an image related to a thermal event at the time of occurrence of a thermal event in the FOV S1520.

The controller 1260 can calculate the area occupied by the image related to the thermal event within the FOV. The controller 1260 may then determine the thermal feedback intensity information according to the area of charge and include it to generate a thermal feedback start signal. For example, as the number of pixels occupied by an image associated with a thermal event increases, the intensity of the thermal feedback can be increased.

The content reproduction device 1200 transmits a thermal feedback start signal including thermal feedback information (S1530), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S1540).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

According to the above-described embodiment, even when the same thermal event is generated, when the user zooms in on the visual field in the thermal event direction, weak thermal feedback can be output when strong thermal feedback is output or zoomed out. Similarly, turning the FOV so that the user moves the thermal event out of the screen can weaken the thermal feedback, and thermal events can enter the FOV and the thermal feedback can become stronger. Thus, the thermal experience of the user can be further improved.

4.16. 16th embodiment

The sixteenth embodiment of the thermal experience providing method according to the embodiment of the present invention is a method of providing a thermal experience to a user by outputting thermal feedback to the augmented reality in the game and outputting it.

Figure 64 is a flow chart of a sixteenth embodiment of a thermal experience providing method according to an embodiment of the present invention.

Referring to FIG. 64, a sixteenth embodiment of the thermal experience providing method includes a step S1610 of sensing a real world, a step S1620 of detecting a column object in the user's FOV based on the sensed image, (S1630) generating thermal feedback information according to the object, transmitting a thermal feedback start signal including thermal feedback information (S1650), and performing a thermal feedback output operation according to the thermal feedback start signal, And outputting the corresponding thermal feedback (S1650).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 can capture the real world through the camera 1480 (S1610). At this time, the content reproduction device 1200 may be provided in the form of an HMD including a camera 1480. Alternatively, the content reproducing device 1200 may be provided as a console device, and an HMD that is interlocked with the console device may acquire an image of a real world through a camera through a communication module 1220.

The content reproduction device 1200 may sense a column object in the user's FOV based on the sensed image (S1620). The controller 1260 can identify the column object included in the sensed image through the image recognition algorithm. Here, the column object may be a real object or a virtual object.

The content reproducing device 1200 may generate thermal feedback information according to the sensed heat object (S1630), and the controller 1260 may acquire the temperature attribute assigned to the heat object using the identification result of the heat object . Further, the controller 1260 can determine the thermal feedback type according to the temperature property.

The content reproducing device 1200 transmits a thermal feedback start signal including thermal feedback information (S1640), and the feedback device 1600 performs a thermal feedback output operation in accordance with the thermal feedback start signal, Thermal feedback can be output (S1650).

The controller 1260 may transmit a thermal feedback start signal including thermal feedback information to the feedback device 1600 via the communication module 1220. [ When the thermal feedback start signal is received, the feedback controller 1645 may apply power to the thermocouple array 1643 to perform a thermal feedback output operation. At this time, the feedback controller 1645 may generate the power supply signal according to the information included in the thermal feedback start signal.

4.17. 17th embodiment

The seventeenth embodiment of the thermal experience providing method according to the embodiment of the present invention is characterized in that thermal feedback is performed in consideration of the position of a character with respect to a field of view (FOV) or a point at which a thermal event occurs, Thereby providing a thermal experience to the user.

This embodiment will be described based on the case where the user uses two feedback devices 1600 in both hands.

65 is a flowchart of a seventeenth embodiment of the method for providing thermal experience according to the embodiment of the present invention.

Referring to FIG. 65, a seventeenth exemplary embodiment of a method for providing a thermal experience includes the steps of reproducing multimedia content (S1710), generating a thermal event during multimedia content playback (S1720), generating thermal feedback (S1730) of transmitting a thermal feedback start signal according to a thermal feedback object (S1740); and performing a thermal feedback output operation in response to receiving the thermal feedback start signal, the thermal feedback output corresponding to the thermal feedback information (S1750). &Lt; / RTI &gt;

Hereinafter, each step of the above-described embodiment will be described in more detail.

The content reproduction device 1200 can reproduce the multimedia content (S1710). Here, the multimedia content may include thermal events. The content reproduction device 1200 can also communicate with a first feedback device 1600 (gripped by the right hand) and a second feedback device 1600 (gripped by the left hand) that are respectively gripped by both hands of the user.

The content reproduction device 1200 may generate a thermal event according to the reproduction of the multimedia content (S1720). Here, the thermal event may include all the thermal events described in the thermal experience providing method according to the embodiment of the present invention described above.

When a thermal event occurs, the content reproducing device 1200 may determine a thermal feedback object according to the direction of the occurrence of the thermal event (S1730).

The controller 1260 can determine the direction of occurrence of a thermal event. Specifically, the direction of occurrence of the thermal event may be the position of the point where the thermal event occurs based on the FOV of the image in the case of the first-person view multimedia contents including the virtual reality application or the augmented reality application. In addition, in the third person application, the direction of the thermal event can be determined based on the player character in the game.

When the direction of the occurrence of the thermal event is determined, the controller 1260 can determine the thermal feedback object according to the generation direction.

FIG. 66 is a view showing a thermal feedback object according to a point of occurrence of a thermal event in a first person game according to a seventeenth embodiment of the thermal experience providing method according to the embodiment of the present invention. FIG.

For example, referring to FIG. 66, when a thermal event occurs at the central portion based on the FOV in the first-person-point-of-view application, the controller 1260 outputs the thermal feedback output object to the first feedback device 1600 and the second feedback device 1600). Also, the controller 1260 can determine the thermal feedback output target to be the first feedback device 1600 when a thermal event occurs on the right side based on the FOV. On the contrary, the controller 1260 may determine the thermal feedback output target to be the second feedback device 1600 when a thermal event occurs from the left side based on the FOV.

The content reproduction device 1200 may transmit a thermal feedback start signal in accordance with the thermal feedback object (S1740).

Once the thermal feedback object is determined, the controller 1260 may transmit a thermal feedback start signal to the feedback device 1600 corresponding to the thermal feedback object determined via the communication module 1220. [

The feedback device 1600 having received the thermal feedback start signal may include a step of performing a thermal feedback output operation in response to the reception of the thermal feedback start signal, and outputting thermal feedback corresponding to the thermal feedback information (S1750).

On the other hand, in this embodiment, as the point of occurrence of the thermal event moves, the feedback device 1600 outputting the thermal feedback may be changed as the present embodiment is applied in real time. For example, if a user moves the FOV while a thermal event occurs on the right side of the FOV, the point where the thermal event occurs can move to the left side through the center. At this time, the thermal feedback object may be changed in the order of the right feedback device 1600, the feedback devices 1600, and the left feedback device 1600.

Although the present embodiment has been described above as being performed in an environment using a plurality of feedback devices 1600, it is not necessarily so. For example, the present embodiment can be applied even when a single feedback device 1600 is used, even when there are a plurality of thermal output modules 1640 such as a gaming controller gripped by both hands. In this case, instead of selecting the first feedback device 1600 and the second feedback device 1600 as the thermal feedback target, the first column output module 1640 and the second column output module 1640 can be selected, The feedback controller 1645 of the feedback device 1600 may determine which thermal output module 1640 to output thermal feedback by sending thermal feedback target information to the signal. As another example, even in the case of the feedback device 1600 having only one thermal output module 1640, even if the thermocouple array 1643 is composed of a plurality of thermocouple groups 1644, An example can be applied. In this case, it is possible to determine which of the center / right / left / whole of the contact surface 1641 held in the user's hand will output the thermal feedback.

The methods of providing thermal feedback according to the embodiments of the present invention described above can be used alone or in combination with each other. In addition, since each of the steps described in each of the thermal feedback methods is not essential, the method of providing thermal feedback can be performed including all of the steps as well as a part of the steps. Also, since the order in which the steps are described is merely for convenience of explanation, the steps in the method of providing thermal feedback are not necessarily performed in the order described.

Further, in the method of providing thermal feedback according to the embodiment of the present invention described above, the step of performing no specific reference to the performing entity may be performed by at least one of the application controller and the feedback controller 1645 of the feedback device 1600 . In addition, in the above description, what has been described as being performed by the application controller may be performed by the application controller, as needed, as described by the feedback controller 1645, or vice versa, performed by the feedback controller 1645 It is also possible. In addition, it is also possible that the items described above to be performed by the application controller or the feedback controller 1645 are performed by cooperation of the application controller and the feedback controller 1645. Again, it should be noted that the application controller and feedback controller 1645 may be implemented as a single controller 1260.

5. How to create multimedia contents

Hereinafter, a method of generating multimedia contents used in the thermal experience providing method will be described. The method of generating multimedia contents according to an exemplary embodiment of the present invention may include a method of generating video contents and a method of generating a game or a sensible application.

5.1. Electronics

The method for generating multimedia contents according to an embodiment of the present invention may be performed by the electronic device 2000. Typical examples of the electronic device 2000 include a PC and a workstation, and the electronic device 2000 may include a notebook, a tablet, a smart phone, and the like.

67 is a block diagram of an electronic device 2000 according to an embodiment of the present invention.

67, the electronic device 2000 may include an input module 2200, an output module 2400, a memory 2600, and a controller 2800.

Input module 2200 may receive user input from a user. The user input may be in various forms including key input, touch input, and phonetic lunar power. Examples of the input module 2200 include a general type of keypad, a keyboard, a mouse, a touch sensor for sensing a user's touch, and various types of input means for sensing or receiving various types of user input. . Also, the input module 2200 may be implemented in the form of an input interface (USB port, PS / 2 port, etc.) that connects an external input device that receives user input to the electronic device, instead of a device that detects the user input .

The output module 2400 can output various information and provide it to the user. The output module 2400 is a comprehensive concept including a display for outputting images, a speaker for outputting sound, a haptic device for generating vibration, and various other types of output means. In addition, the output module 2400 may be implemented in the form of a port type output interface for connecting the above-described individual output means to the electronic device 2000.

The memory 2600 may store various types of information. Memory can store data temporarily or semi-permanently. Examples of the memory include an HDD, an SSD, a flash memory, a ROM, and a RAM. The memory 2600 may be provided in a form embedded in the electronic device 2000 or in a detachable form. The memory 2600 may store various data necessary or used to drive the electronic device 2000 including the OS for driving the electronic device 2000. [

The controller 2800 controls the overall operation of the electronic device 2000. That is, the controller 2800 may perform operations and processing of various information and control the operation of other components of the electronic device. The controller may be implemented as a computer or similar device depending on the hardware software or a combination thereof. In hardware, the controller may be provided in the form of an electronic circuit that performs control functions by processing an electrical signal, and may be provided in the form of a program that drives a hardware controller in software. The operation of the electronic device 2000 may be interpreted to be performed by the controller 2800, unless otherwise noted in implementations of the method of generating multimedia content that provide the thermal experience described below.

5.2. First embodiment

Hereinafter, a first embodiment of a method for generating multimedia contents according to an embodiment of the present invention will be described. This embodiment relates to a method for generating video content among multimedia contents.

In the first embodiment of the thermal experience providing method described above, in the case of reproducing the moving picture contents set so that the thermal event scene reproduction time coincides with the thermal feedback reproduction time, the thermal feedback start time in the content reproduction device is shorter than the thermal feedback reproduction time By pulling forward, the user can feel the thermal feedback at the time of the reproduction of the thermal event image.

Alternatively, when generating the thermal feedback data, it is also possible to set the reproduction time point of the thermal feedback in consideration of the time difference between the power application time point and the temperature reduction time of the thermal feedback in advance. The method for generating multimedia contents providing a thermal experience according to the embodiment of the present invention is characterized in that even if the thermal experience providing system 1000 performs a thermal feedback output operation at the reproduction time of the thermal feedback according to the thermal feedback data of the moving picture contents, And to a method for generating thermal feedback data of video content to be linked to video or audio.

68 is a flowchart of a first embodiment of a method of generating multimedia contents according to an embodiment of the present invention.

68, a first embodiment of a method for generating multimedia contents includes a step of obtaining a reproduction time point of a thermal event scene (S1810), calculating a thermal feedback reproduction time point based on a reproduction time point and a correction time of a thermal event scene Step S1820 and generating thermal feedback data based on the thermal feedback regeneration point (S1830).

Hereinafter, each step of the above-described embodiment will be described in more detail.

The electronic device 2000 can obtain the output time point of the thermal event scene (S310). The controller 2800 can receive a user input relating to a playback timing of a thermal event scene to be interlocked with thermal feedback through the input module 2200.

At this time, the electronic device 2000 may provide a UI screen that allows a user to easily input a playback point of a thermal event scene through an output module 2400 such as a display. The UI screen may be provided somewhat similar to the screen provided by the conventional image editing program.

The UI screen includes a progressive bar reflecting the reproduction time point of the moving picture content, an indicator disposed on the progressive bar, and a video window for outputting a scene corresponding to a point of time indicated by the indicator . The UI screen may include a control panel for controlling playback of the moving image content. Here, the user can move the indicator on the progressive bar or play the video content using the control panel, and view the scene output through the video window during this process. When a scene desired to be a thermal event scene is displayed in the image window, the user can select a point at which the indicator on the progressive bar corresponding to the scene is positioned as the reproduction time point of the thermal event scene. At this time, the UI screen may be provided with a menu for further selecting the object, type, strength, and duration of the thermal feedback.

The user can search for a scene to be linked with thermal feedback through the image window through the UI window and input a user input for selecting a point of time when a desired scene is output to the image window as the output point of a specific scene to be interlocked with thermal feedback have. The controller 2800 can obtain the output time of a specific scene by receiving a user input through the input module 2200. [

The electronic device 2000 calculates the power application time point for the thermal feedback based on the output timing and the correction time of the thermal event scene (S1820).

Here, the correction time may be a delay time from when the power is applied to the thermoelectric element to start the output of the thermal feedback to when the user senses the thermal sensation through the contact surface. The correction time has already been described in detail in the first embodiment of the thermal experience providing method.

The controller 2800 can calculate the power application time point for starting the output of the thermal feedback by subtracting the correction time from the obtained output time point.

When the power application time point is calculated, the electronic device 2000 can generate thermal feedback data based on the power point-in-time (S1830). The thermal feedback data may include information about the type of thermal feedback, information about the intensity, and information about a power application time point for starting the output of the thermal feedback. The thermal feedback data may further include information about the feedback device to which the thermal feedback is to be output in the case of the thermal experience providing system 1000 using the plurality of feedback devices 1600. [ For example, the information about the target feedback device may be information on which gaming controller to output thermal feedback in a VR system using two bar type gaming controllers. Also, in the thermal experience providing system 1000, when the thermoelectric elements of the feedback device 1600 are provided in a thermocouple array 1644 comprising a plurality of individually controllable thermocouple groups 1644, Group 1644, i.e., object zone information indicating the action group.

The thermal feedback data generated in this way can be used to output thermal feedback associated with the moving image output, which is referred to when reproducing the moving image content. To this end, the thermal feedback data may be provided as a separate file from the video file, such as a subtitle file providing subtitles during video output. Or alternatively it may be provided as a single file in which thermal feedback data and moving image data are integrated.

When the thermal feedback data is generated in consideration of the delay time required for the user to feel the thermal feedback from the power application time point for starting the output of the thermal feedback as in the present embodiment, The content reproducing apparatus 1200 does not need to correct the output timing of the thermal feedback in consideration of the delay time, which is advantageous in reducing the amount of computation when reproducing the multimedia contents.

On the other hand, the method of the first embodiment of the thermal experience providing method is advantageous in that it has higher compatibility than the present embodiment. For example, the delay time taken by the user of the feedback device 1600 from the power application time point to the start of the thermal feedback output to the user's sensation of thermal sensation may be somewhat different. In the first embodiment of the thermal experience providing method This is because the correction time can be adaptively processed for each situation in consideration of the type of the feedback device 1600.

In the above description of the embodiment, the multimedia content is video content. However, the present embodiment can be applied to a multimedia content such as a game or a haptic application. For example, this embodiment can be used for a scene in which a video cut scene appears during the progress of a game. This is also true of the first embodiment of the thermal experience providing method according to the embodiment of the present invention.

The first embodiment of the present embodiment and the thermal experience providing method may have a small effect when the response time of the thermoelectric element is high. However, in order to improve the grip of the user in the gaming controller or the like, Is treated with a material such as rubber, the time required for heat transfer from the thermoelectric element to the contact surface (1641) may become large. In such a case, the advantage is expected to be further exerted.

5.3. Second embodiment

Hereinafter, a second embodiment of a method of generating multimedia contents according to an embodiment of the present invention will be described. This embodiment relates to a method of generating multimedia contents provided in the form of a game or a sensible application among multimedia contents.

In a second embodiment of the thermal experience providing method described above, it may include generating a virtual object and imparting thermal characteristics to the generated virtual object.

Here, the virtual object refers to an object that can interact with a player inside a game, a sensible game application, or the like.

When a virtual object is created, the generated virtual object can be given a thermal characteristic.

The thermal properties are directly or indirectly related to the type and intensity of the thermal feedback.

In addition, various thermal properties can be defined. Some simple examples are temperature values, material values, resistance values, and the like. In concrete examples, in the thermal experience providing method of the present invention, all the information in which the determination of the strength / type / target device of the thermal feedback is used may be the thermal stability of the object.

As an example, the virtual object is assigned an element attribute so that the type of thermal feedback can be determined accordingly. This is described in detail in the third embodiment of the thermal experience providing method according to the embodiment of the present invention.

In another example, a heat transfer scheme may be imparted to the object as a thermal attribute, which is illustrated in a tenth embodiment of a method for providing a thermal experience according to an embodiment of the present invention.

Also, this embodiment can be utilized in a game production engine. For example, an existing game production engine mainly includes a physical engine that processes an object collision and a light path, and it can be understood that a thermal processing function is added to such a physical engine.

The multimedia content generation methods providing the thermal experience according to the embodiments of the present invention described above can be used alone or in combination with each other. In addition, since each of the steps described in each multimedia content creation method is not essential, the multimedia content creation method may include all of the steps and may be performed only partially. Also, since the order in which the steps are described is merely for convenience of description, the steps in the method of generating multimedia contents are not necessarily performed in the order described.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments of the present invention described above can be implemented separately or in combination.

Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

1000: thermal experience providing system 1200: content reproducing device
1220: communication module 1240: memory
1260: Controller 1400: Audio-visual device
1420: Communication module 1440: A / V module
1442: video module 1444: audio module
1600: feedback device 1620: communication module
1640: heat output module 1641: contact surface
1642: substrate 1643: thermocouple array
1647: power terminal 1648: feedback controller

Claims (46)

1. A method for providing a thermal experience for an electronic game, the method being performed by a content playback device operable in conjunction with a feedback device for driving electronic games and outputting thermal feedback using thermoelectric elements,
Executing an electronic game including an enemy character attacking the player by performing an attacking action having an element attribute including a player and a flame attribute, a cold attribute and an electric attribute;
Determining a type of the thermal feedback based on the element attribute of the attack action when a shooting event in which the player is shot by the attack action occurs in the electronic game, The kind of the thermal feedback is determined as the warm feedback, and the type of the thermal feedback is determined as the cold feedback for the shot event by the attack action of the cool air attribute, and for the shot event by the attack action of the electric attribute, Determining the type of thermal feedback as thermal sensory feedback; And
Controlling the feedback device so that the thermal feedback according to the shot event is output together with the shot graphic, wherein when the thermal feedback is the warm feedback, the thermoelectric element is controlled to start the heat operation, and the thermal feedback is the cold feedback And controlling the thermoelectric element to initiate a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined when the thermal feedback is the heat trap feedback
Providing a thermal experience.
The method according to claim 1,
Determining the strength of the thermal feedback based on at least one of an attack power of the attack action, a damage amount of the player according to the shot event, a ratio of the damage amount to the total physical strength points of the player, and remaining physical strength points of the player ; &Lt; / RTI &gt;
Controlling the feedback device so that the thermal feedback is output in accordance with the determined intensity
Providing a thermal experience.
The method according to claim 1,
When the attacking action uses the skill, the elemental attribute of the attacking action is determined by the attribute of the element assigned to the skill
Providing a thermal experience.
The method of claim 3,
Obtaining the strength of the thermal feedback set based on at least one of the tiers of the skill on a skill tree including a plurality of skills having a level of the skill, a damage amount of the skill, and the same element attribute,
Controlling the feedback device so that the thermal feedback is output in accordance with the determined intensity
Providing a thermal experience.
The method according to claim 1,
When the attacking action uses a melee weapon, the elemental attribute of the attacking action is determined by an element attribute assigned to the melee weapon
Providing a thermal experience.
6. The method of claim 5,
Obtaining the strength of the thermal feedback set based on at least one of the rating of the melee weapon and the attack power of the melee weapon,
Controlling the feedback device so that the thermal feedback is output in accordance with the determined intensity
Providing a thermal experience.
The method according to claim 1,
If the attack action uses a ranged weapon, the element attribute of the attack action is determined by at least one of an element attribute assigned to the ranged weapon and an element attribute assigned to the projectile launched by the ranged weapon
Providing a thermal experience.
8. The method of claim 7,
The element attribute of the attack action is determined by an element attribute of the projectile when an element attribute is given to the projectile, and when an element attribute is not assigned to the projectile, the element attribute of the attack action is determined by the element attribute of the ranged weapon
Providing a thermal experience.
8. The method of claim 7,
Obtaining the strength of the thermal feedback set based on at least one of the rating of the ranged weapon, the attack power of the ranged weapon, the rating of the projectile, and the attack power of the projectile,
Controlling the feedback device so that the thermal feedback is output in accordance with the determined intensity
Providing a thermal experience.
The method according to claim 1,
Further comprising: causing a debuff effect on the player by the shot event in the game,
And controlling the feedback device to output the thermal feedback during the duration of the debuff effect
Providing a thermal experience.
11. The method of claim 10,
Controlling the feedback device to control the intensity of the output thermal feedback to decrease during the duration of the debuff effect
Providing a thermal experience.
The method according to claim 1,
The electronic game includes a 2D game, a VR game, and an AR game
Providing a thermal experience.
A content reproducing device operable in conjunction with a feedback device for outputting thermal feedback using a thermoelectric element,
A memory for storing data;
A communication module for communicating with an external device; And
Executing an electronic game including an enemy character attacking the player by performing an attacking action having an element attribute including a player and a flame attribute, a freezing attribute, and an electric attribute, and causing the player to execute an attacking action The type of the thermal feedback is determined based on the element attribute of the attack action when the shot event is shot, and the type of the thermal feedback is determined as the warm feedback for the shot event by the attack action of the flame attribute Determining a type of the thermal feedback as the cold feedback for the shot event by the attack action of the cool air attribute and determining the type of the thermal feedback as the thermal sensory feedback for the shot event by the attack action of the electrical attribute, An image according to the shot event Controlling the feedback device through the communication module so that thermal feedback is output together with the shot graphics, and controlling the thermoelectric element to start a heating operation when the thermal feedback is the warm feedback, and when the thermal feedback is the cold feedback And a controller for controlling the thermoelectric element to initiate a heat absorbing operation and for controlling the thermoelectric element to initiate a thermal grill operation in which the thermoelectric element and the heat absorbing element are combined when the thermal feedback is the thermal percolation feedback
A content playback device.
14. The method of claim 13,
Wherein the electronic game is installed in the memory,
Wherein the controller is configured to load and execute the electronic game from the memory
A content playback device.
14. The method of claim 13,
Wherein the controller loads and executes the electronic game from the game server through the communication module
A content playback device.
14. The method of claim 13,
And a recording medium drive for reading the recording medium storing the electronic game,
Wherein the controller is configured to load and execute the electronic game from the recording medium drive
A content playback device.
14. The method of claim 13,
And a display for outputting an image,
Wherein the controller is adapted to output a graphic relating to the game through the display
A content playback device.
14. The method of claim 13,
The controller controls the external display to output a graphic relating to the game through the communication module
A content playback device.
14. The method of claim 13,
The controller calculates the intensity of the thermal feedback based on at least one of an attack power of the attack action, a damage amount of the player based on the shot event, a ratio of the damage amount to the entire physical strength points of the player, And controls the feedback device to output the thermal feedback according to the determined intensity through the communication module
A content playback device.
14. The method of claim 13,
When the attacking action uses the skill, the elemental attribute of the attacking action is determined by the attribute of the element assigned to the skill
A content playback device.
21. The method of claim 20,
Wherein the controller obtains the strength of the thermal feedback set based on at least one of the tiers of the skill on a skill tree including a plurality of skills having the level of the skill, the amount of damage of the skill, and the same element attribute, Through the module, the feedback device controls to output the thermal feedback according to the determined intensity
A content playback device.
14. The method of claim 13,
Wherein the controller gives a debuff effect by the shot event to the player in the game and controls the feedback device to output the thermal feedback during the duration of the debuff effect through the communication module
A content playback device.
23. The method of claim 22,
The controller controls, via the communication module, to cause the feedback device to reduce the intensity of the output thermal feedback during the duration of the debuff effect
A content playback device.
14. The method of claim 13,
The electronic game includes a 2D game, a VR game, and an AR game
A content playback device.
The heat generated by the thermoelectric action including the heat generating operation, the heat absorbing operation, and the heat grill operation in which the heat generating operation and the heat absorbing operation are combined is transmitted to the user through the contact surface contacting the user's body part Thereby providing a thermal feedback performed by a feedback device that outputs thermal feedback,
And playing an electronic game including an enemy character attacking the player by performing an attacking action having an element attribute including a flame attribute, a frost attribute, and an electric attribute;
Outputting a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when the player is hit by the attacking action having the flame attribute in the game;
Applying a reverse voltage for the heat absorbing operation to the thermoelectric element to output cold feedback when the player is hit by the attack action having the cold air attribute in the game; And
Simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation when the player is shot by the attacking action having the electric attribute in the game to output heat trap feedback Containing
Providing a thermal experience.
In association with a content playback device that executes an electronic game including an enemy character attacking the player by performing an attack action having an element attribute including a player, a flame attribute, a cold attribute, and an electric attribute, A feedback device for outputting a thermal feedback corresponding to an element attribute of the attack action upon occurrence of a shooting event,
A thermoelectric element for performing a thermoelectric operation including a heat generating operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined, a power supply terminal for supplying power to the thermoelectric element, A thermal output module including a contact surface contacting the body part of the user and outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface; And
And outputs a warm-up feedback by applying a constant voltage for the heat-generating operation to the thermoelectric element when the shooting event occurs due to the attacking action having the flame attribute, and when the shooting event has occurred due to the attack action having the cold- And outputs a cold feedback to the thermoelectric element by applying a reverse voltage that is opposite to the positive voltage and the power application direction for the heat absorbing operation to output cold feedback. When the hit event occurs due to the attack action having the electrical attribute, And a feedback controller for simultaneously or alternately applying the constant voltage and the reverse voltage for the thermal grill operation to output heat sensation feedback
Feedback device.
27. The method of claim 26,
Wherein the thermoelectric element is provided in a thermocouple array including a plurality of individually thermocouple controllable thermo couple groups,
Wherein the feedback controller applies the constant voltage to a first group which is a part of the thermo couple group when the shooting event occurs due to the attack action having the electric attribute, and applies the constant voltage to the second group, which is another part of the thermo pair group, To apply
Feedback device.
A thermal experience providing system comprising a content reproducing device for driving an electronic game, a display for outputting the image of the electronic game, and a feedback device for interfacing with the content reproducing device and outputting thermal feedback using a thermoelectric element,
The content reproduction device includes:
A first communication module in communication with the feedback device;
Player executes an electronic game including an enemy character attacking the player by performing an attack action having an element attribute including a flame attribute, a cold attribute, and an electric attribute, and the player performs an attack action The type of the thermal feedback is determined based on the element attribute of the attack action, and the type of the thermal feedback is determined as the warm feedback for the shot event by the attack action of the flame attribute And determines the type of the thermal feedback as the cold feedback, and determines the type of the thermal feedback as the thermal sensation feedback for the shot event by the attack of the electrical attribute , The first communication module Transmitting a type of the thermal feedback as to the feedback device, and includes a controller for outputting a shot corresponding to the shot graphics event via the display,
The feedback device comprising:
A thermoelectric element for performing a thermoelectric operation including a heat generating operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined; a power supply terminal for supplying power to the thermoelectric device to the thermoelectric device; A thermal output module provided on one side and including a contact surface in contact with a body part of the user, for outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface,
A second communication module for communicating with the content reproduction device;
Receiving the kind of the thermal feedback through the second communication module and applying the power to the thermoelectric element so that the received kind of thermal feedback is outputted, And applies a reverse voltage for the heat absorbing operation to the thermoelectric element when the cold feedback is received and outputs the constant voltage and the reverse voltage to the thermoelectric element when the thermo sensor feedback is received, And a feedback controller for applying a voltage simultaneously or alternately
Thermal experience providing system.
1. A method for providing a thermal experience for an electronic game, the method being performed by a content playback device operable in conjunction with a feedback device for driving electronic games and outputting thermal feedback using thermoelectric elements,
Executing an electronic game including a player performing an action having an element attribute including a flame attribute, a frost attribute, and an electrical attribute;
The player activating the action according to a user input indicating the action;
Outputting a graphic for the action;
Determining a kind of the thermal feedback based on the element attribute of the action, determining the type of the thermal feedback as the warm-feeling feedback with respect to the action of the flame attribute, and determining the type of the thermal feedback as the cold- Determining the type of thermal feedback as thermal feedback feedback for the action of the electrical attribute; And
Controlling the feedback device such that the thermal feedback is output together with the graphic of the action, wherein when the thermal feedback is the warm feedback, control is performed so that the thermoelectric element starts a heat generation operation, and when the thermal feedback is the cold feedback, Controlling the element to initiate an endothermic operation and controlling the thermoelement to initiate a thermal grill operation in which the thermoelectric element and the heat absorbing element are combined if the thermal feedback is the thermal sensory feedback
Providing a thermal experience.
30. The method of claim 29,
Wherein the action includes at least one of an attacking action to attack an enemy character and a buff action to help the player
Providing a thermal experience.
30. The method of claim 29,
The action is an attack action for attacking enemy characters,
And obtaining the strength of the thermal feedback based on at least one of the attack power of the attack action, the attribute of the skill associated with the attack action, and the attribute of the weapon associated with the attack action,
Controlling the feedback device to output the thermal feedback in accordance with the determined intensity,
Wherein the attribute of the skill includes a tier of the skill on a skill tree including a plurality of skills having the level of the skill, the damage amount of the skill, and the same element attribute,
Wherein the attribute of the weapon includes at least one of a rating of the weapon, an attack power of the weapon, a rating of the projectile fired by the weapon,
Providing a thermal experience.
30. The method of claim 29,
And controlling the feedback device to output the thermal feedback during the casting time when a casting time is required during the action in the game
Providing a thermal experience.
33. The method of claim 32,
Controlling the feedback device to control the intensity of the output thermal feedback to be increased during the casting time
Providing a thermal experience.
30. The method of claim 29,
Controlling the feedback device so as to output the thermal feedback during the holding time when the result of the action is maintained during the holding time when the action is triggered in the game
Providing a thermal experience.
35. The method of claim 34,
Controlling the feedback device such that the intensity of the output thermal feedback during the holding time is reduced
Providing a thermal experience.
30. The method of claim 29,
The electronic game includes a 2D game, a VR game, and an AR game
Providing a thermal experience.
A content reproducing device operable in conjunction with a feedback device for outputting thermal feedback using a thermoelectric element,
A memory for storing data;
A communication module for communicating with an external device; And
Executing an electronic game including a player performing an action having an element attribute including a flame attribute, a freezing attribute, and an electric attribute, causing the player to play the action according to a user input instructing the action, A type of the thermal feedback is determined based on the element attribute of the action, and the type of the thermal feedback is determined as the warm feedback for the action of the flame attribute, The type of the thermal feedback is judged as the cold feedback for the action, the type of the thermal feedback is judged as the thermal sensation feedback for the action of the electric attribute, and the thermal feedback is outputted together with the graphic of the action. Said feedback device comprising: Controlling the thermoelectric element to start a heat generating operation when the thermal feedback is the warm feedback, controlling the thermoelectric element to start the heat absorbing operation when the thermal feedback is the cold feedback, and when the thermal feedback is the thermal sensation feedback And a controller for controlling the thermoelectric element to initiate a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined
A content playback device.
39. The method of claim 37,
Wherein the action includes at least one of an attacking action to attack an enemy character and a buff action to help the player
A content playback device.
39. The method of claim 37,
The action is an attack action for attacking enemy characters,
Wherein the controller obtains the strength of the thermal feedback based on at least one of the attack power of the attack action, the attribute of the skill associated with the attack action, and the attribute of the weapon associated with the attack action, Controls the thermal feedback to be output in accordance with the determined intensity,
Wherein the attribute of the skill includes a tier of the skill on a skill tree including a plurality of skills having the level of the skill, the damage amount of the skill, and the same element attribute,
Wherein the attribute of the weapon includes at least one of a rating of the weapon, an attack power of the weapon, a rating of the projectile fired by the weapon,
A content playback device.
39. The method of claim 37,
Wherein the controller controls the feedback device to output the thermal feedback during the casting time when a casting time is required at the time of invoking the action in the game
A content playback device.
41. The method of claim 40,
The controller controls the intensity of the output thermal feedback to be increased during the casting time
A content playback device.
39. The method of claim 37,
The controller controls the feedback device to output the thermal feedback during the holding time when the result of the action is maintained during the holding time when the action is triggered in the game
A content playback device.
43. The method of claim 42,
The controller controls the intensity of the output thermal feedback to be decreased during the holding time
A content playback device.
The heat generated by the thermoelectric action including the heat generating operation, the heat absorbing operation, and the heat grill operation in which the heat generating operation and the heat absorbing operation are combined is transmitted to the user through the contact surface contacting the user's body part Thereby providing a thermal feedback performed by a feedback device that outputs thermal feedback,
Interlocking with a content reproducing device for executing an electronic game including a player performing an attacking action having an element attribute including a flame attribute, a frost attribute and an electrical attribute;
When the player performs the attacking action with the flame attribute in the game, applying a constant voltage for the heat generating operation to the thermoelectric element to output a warm-feeling feedback;
When the player performs the attacking action with the cool air attribute in the game, applying a reverse voltage for the heat absorbing operation to the thermoelectric element to output cold feedback; And
When the player performs the aggressive action with the electric attribute in the game, if the shot is shot, the constant voltage and the reverse voltage are simultaneously or alternately applied to the thermoelectric element for the thermal grill operation, And outputting
Providing a thermal experience.
When the player performs the attacking action in cooperation with a content reproducing device that executes an electronic game including a player who performs an attacking action having an element attribute including a flame attribute, a freezing attribute, and an electric attribute, A feedback device for outputting thermal feedback corresponding to an attribute,
An input module for obtaining user input;
A thermoelectric element for performing a thermoelectric operation including a heat generating operation, an endothermic operation, and a thermal grill operation in which the heat generating operation and the heat absorbing operation are combined, a power supply terminal for supplying power to the thermoelectric element, A thermal output module including a contact surface contacting the body part of the user and outputting the thermal feedback by transmitting heat generated by the thermoelectric action to the user through the contact surface; And
And when a user input indicating the attack action having the flame attribute is obtained through the input module, a constant voltage for the heating operation is applied to the thermoelectric element to output a warm-feeling feedback, and the cool- Wherein the controller is configured to output a coolant feedback signal to the thermoelectric element by applying a reverse voltage that is opposite to the positive voltage and the power supply direction for the heat absorbing operation when the user input indicating the attack action is obtained, And a feedback controller for simultaneously or alternately applying the constant voltage and the reverse voltage to the thermoelectric element for the thermal grill operation when the user input indicating the attack action is obtained
Feedback device.
46. The method of claim 45,
Wherein the thermoelectric element is provided in a thermocouple array including a plurality of individually thermocouple controllable thermo couple groups,
Wherein the feedback controller applies the constant voltage to a first group which is a part of the thermocouple group when the shot event occurs when a user input indicating the attack action having the electric attribute is obtained, The second group, which is a part of the second group,
Feedback device.

Images