KR102311788B1 - Feedback device, content reproduction device, system and method for providing thermal experience - Google Patents

Abstract

The present invention provides a feedback device that outputs thermal feedback by transferring heat generated by a thermoelectric operation including at least one of a heating operation and an endothermic operation of a thermoelectric element to which power is applied to the user through a contact surface in contact with the user's body part. A method of controlling a control unit to provide thermal feedback control data to a control unit, wherein when a thermal event causing the thermal feedback occurs in an application providing a thermal experience through thermal feedback, the thermal feedback caused by the thermal event is acquiring thermal feedback data including information on at least one of a type, an intensity, and an output region; obtaining the thermal feedback control data configured in a format understandable to the feedback device based on the thermal feedback data; and providing the thermal feedback control data to the feedback device so that the feedback device outputs the thermal feedback according to information on at least one of a type, intensity, and output region of the thermal feedback included in the thermal feedback data. may include.

Description

FEEDBACK DEVICE, CONTENT REPRODUCTION DEVICE, SYSTEM AND METHOD FOR PROVIDING THERMAL EXPERIENCE

The present invention relates to a feedback device, a content playback device, a system for providing a thermal experience, and a method for providing a thermal experience.

In recent years, as technology for virtual reality (VR) or augmented reality (AR, Augmented Reality) develops, there is an increasing demand for providing feedback through various senses in order to increase user immersion in content. In particular, at the Consumer Electronics Show (CES) in 2016, virtual reality technology was mentioned as one of the promising future technologies. In line with this trend, research to provide a user experience for all human senses, including smell and touch, is being actively conducted in the future, away from user experience (UX: User eXperience) that is mainly limited to sight and hearing.

A thermoelectric element (TE: ThermoElement) is a device that generates an exothermic reaction or an endothermic reaction by receiving electric energy by the Peltier effect, and has been expected to be used to provide thermal feedback to the user. The thermoelectric element of a user has been limited in its application because it is difficult to adhere to the user's body part.

However, as the development of a flexible thermoelectric element (FTE) has recently reached a successful stage, it is expected that the problem of the conventional thermoelectric element can be overcome and thermal feedback can be effectively delivered to the user.

An object of the present invention is to provide a feedback device for providing thermal feedback to a user and a method for providing thermal feedback using the same.

Another object of the present invention is to provide a method for providing thermal feedback that improves compatibility between a content reproducing device that reproduces multimedia content and a feedback device that provides thermal feedback to a user.

Another object of the present invention is to provide a method for providing thermal feedback for outputting thermal feedback without error from the plurality of feedback devices even if the plurality of feedback devices have different command systems.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and the problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. .

According to an aspect of the present invention, heat generated by a thermoelectric operation including at least one of a heating operation and an endothermic operation of a thermoelectric element to which power is applied is transferred to the user through a contact surface in contact with the user's body part, thereby providing thermal feedback. A control method of a control unit that provides thermal feedback control data to a feedback device that outputs obtaining thermal feedback data including information on at least one of a type, intensity, and output region of the thermal feedback; obtaining the thermal feedback control data configured in a format understandable to the feedback device based on the thermal feedback data; and providing the thermal feedback control data to the feedback device so that the feedback device outputs the thermal feedback according to information on at least one of a type, intensity, and output region of the thermal feedback included in the thermal feedback data. may include.

Solutions of the present invention are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. will be able

According to the present invention, it is possible to provide thermal feedback to the user.

Further, according to the present invention, compatibility between a content reproducing device that reproduces multimedia content and a feedback device that provides thermal feedback to a user can be improved.

Further, according to the present invention, even if the plurality of feedback devices have different command systems, thermal feedback can be output from the plurality of feedback devices without error.

The effects of the present invention are not limited to the above-mentioned effects, and the effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings.

1 is a block diagram illustrating a configuration of a system 1000 for providing a thermal experience according to an embodiment of the present invention.
2 is a block diagram illustrating the configuration of a content reproducing device 1200 according to an embodiment of the present invention.
3 is a block diagram related to the configuration of the audio-visual device 1400 according to an embodiment of the present invention.
4 is a block diagram of a configuration of a feedback device 1600 according to an embodiment of the present invention.
5 is a block diagram illustrating a configuration of a heat output module 1640 according to an embodiment of the present invention.
6 is a diagram of one form of a heat output module 1640 according to an embodiment of the present invention.
7 is a diagram of another form of a heat output module 1640 according to an embodiment of the present invention.
8 is a diagram of another form of a heat output module 1640 according to an embodiment of the present invention.
9 is a diagram of another form of a heat output module 1640 according to an embodiment of the present invention.
10 is a diagram illustrating a heating operation for providing a sense of temperature feedback according to an embodiment of the present invention.
11 is a graph showing the intensity of a sense of warmth feedback according to an embodiment of the present invention.
12 is a diagram illustrating a heating operation for providing cooling feedback according to an embodiment of the present invention.
13 is a graph regarding the intensity of cooling feedback according to an embodiment of the present invention.
14 is a graph showing the intensity of a feeling of warmth/cooling feedback using voltage control according to an embodiment of the present invention.
FIG. 15 is a graph relating to temperature/cooling feedback intensity adjustment through operation control for each thermocouple group 1644 according to an embodiment of the present invention.
16 is a graph showing control of the intensity of warmth/cooling feedback through power application timing control according to an embodiment of the present invention.
17 is a diagram illustrating an operation of a thermal grill using a voltage control method according to an embodiment of the present invention.
18 is a table of voltages for providing neutral heat grill feedback in a voltage control method according to an embodiment of the present invention.
19 is a schematic diagram of an example of an electrical signal for a heat transfer operation according to an embodiment of the present invention.
20 is a diagram illustrating a heat transfer operation according to FIG. 19 according to an embodiment of the present invention.
21 is a schematic diagram of another example of an electrical signal for a heat transfer operation according to an embodiment of the present invention.
22 is a diagram illustrating a heat transfer operation according to FIG. 21 according to an embodiment of the present invention.
23 is a schematic diagram of another example of an electrical signal for a heat transfer operation according to an embodiment of the present invention.
24 is a diagram illustrating a heat transfer operation according to an embodiment of the present invention.
25 is a schematic diagram of yet another example of an electrical signal for a heat transfer operation according to an embodiment of the present invention.
26 is a diagram illustrating a heat transfer operation according to FIG. 25 according to an embodiment of the present invention.
27 is a block diagram of a configuration of a thermal feedback control system 2000 according to an embodiment of the present invention.
28 is a block diagram of a configuration of a thermal feedback output unit 2100 according to an embodiment of the present invention.
29 and 30 are diagrams for explaining thermal feedback information according to an embodiment of the present invention.
31 is a block diagram illustrating a configuration of a heat output unit 2200 according to an embodiment of the present invention.
32 and 33 are diagrams for explaining a packet structure of thermal feedback control data according to an embodiment of the present invention.
34 is a block diagram of a configuration of a control unit 2300 according to an embodiment of the present invention.
35 is a flowchart illustrating an operation of providing thermal feedback control data of the control unit 2300 according to an embodiment of the present invention.
36 is a flowchart for explaining the provision of thermal feedback control data by the control unit 2300 when individual control for a plurality of output regions is indicated in the thermal feedback data according to an embodiment of the present invention.
37 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when single control for an output region is indicated in thermal feedback data according to an embodiment of the present invention.
38 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when a thermal movement operation is indicated in thermal feedback data according to an embodiment of the present invention.
FIG. 39 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when a provision time of thermal feedback is indicated in thermal feedback data according to an embodiment of the present invention.
40 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when control for a plurality of feedback devices is indicated in the thermal feedback data according to an embodiment of the present invention.
41 is a basic flowchart of a method for providing a thermal experience according to an embodiment of the present invention.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. In addition, like reference numerals in each figure denote like members.

1. Thermal experience providing system

Hereinafter, a system 1000 for providing a thermal experience according to an embodiment of the present invention will be described.

1.1. Overview of the thermal experience delivery system

The system 1000 for providing a thermal experience according to an embodiment of the present invention is a system that allows a user to experience a thermal experience (TX: Thermal eXperince). In detail, the thermal experience providing system 1000 may allow the user to experience a thermal experience by outputting thermal feedback as part of an expression form of the content when playing multimedia content.

Here, the thermal feedback is a kind of thermal stimulation that mainly stimulates the thermal sensory organs distributed in the user's body so that the user feels the thermal sensation. should be construed as inclusive.

Representative examples of thermal feedback include warm feedback and cool feedback. Warm feedback means applying heat to a hot spot distributed on the skin so that the user feels warm, and cold feedback means applying cold heat to a cold spot distributed on the skin so that the user feels cold. it means.

Here, since heat is a physical quantity expressed in the form of a positive scalar, the expressions 'applying cold heat' or 'transferring cold heat' may not be strictly expressions from a physical point of view, but in the present specification, heat is applied for convenience of explanation. A phenomenon in which warm heat is applied or transmitted is expressed as being applied or transmitted, and a phenomenon that is vice versa, that is, a phenomenon in which heat is absorbed, is expressed as cold heat is applied or transmitted.

Also, in the present specification, the thermal feedback may further include a thermal grill feedback in addition to the warm feedback and the cool feedback. When hot and cold heat are given at the same time, the user perceives it as a sensation instead of as individual warm and cold sensations. This sensation is called Thermal Grill Illusion (TGI). That is, the thermal grill feedback refers to thermal feedback for applying hot and cold heat in combination, and may be mainly provided by simultaneously outputting the warm feedback and the cool feedback. In addition, the thermal grill feedback may be referred to as thermal sensation feedback in terms of providing a sensation close to sensation. A more detailed description of the heat grill feedback will be provided later.

In addition, the multimedia content may include various types of content including moving pictures, games, virtual reality applications, augmented reality applications, and the like.

In general, multimedia content is mainly provided to a user according to an audio-visual expression form based on video and audio, but in the present invention, the thermal expression based on the above-described thermal feedback may be included as an essential expression form.

Meanwhile, 'playback' of multimedia content should be interpreted as a comprehensive meaning including all operations of executing multimedia content and providing it to a user. Therefore, in this specification, the term 'play' should be interpreted to include not only an operation of simply reproducing a video through a media player, but also an operation of executing a game program, an educational program, a virtual reality application, and an augmented reality application. .

1.2. Construction of a system for providing thermal experience

1 is a block diagram illustrating a configuration of a system 1000 for providing a thermal experience according to an embodiment of the present invention.

Referring to FIG. 1 , a system 1000 for providing a thermal experience may include a content playback device 1200 , an audiovisual device 1400 , and a feedback device 1600 .

Here, the content reproduction device 1200 may reproduce multimedia content, the audiovisual device 1400 may output an image or audio according to the content reproduction, and the feedback device 1600 may output thermal feedback according to the content reproduction.

For example, the content reproducing device 1200 decodes video content including image data/audio data/thermal feedback data to the audiovisual device 1400 and the feedback device 1600 respectively to the image signal/audio signal/thermal feedback. can be transmitted as a signal. The audiovisual device 1400 may receive an image signal and an audio signal to output an image and an audio, and the feedback device 1600 may receive a thermal feedback signal and output a thermal feedback.

Hereinafter, each component of the thermal experience providing system 1000 will be described in more detail.

1.2.1. content playback device

The content playback device 1200 plays multimedia content.

2 is a block diagram illustrating the configuration of a content reproducing device 1200 according to an embodiment of the present invention.

Referring to FIG. 2 , the content reproduction device 1200 may include a communication module 1220 , a memory 1240 , and a controller 1260 .

The communication module 1220 may communicate with an external device. The content reproduction device 1200 may transmit/receive data to and from the audiovisual device 1400 or the feedback device 1600 through the communication module 1220 . For example, the content reproduction device 1200 may transmit an A/V signal to the audiovisual device 1400 or a thermal feedback signal to the feedback device 1600 through the communication module 1220 . In addition, the content playback device 1200 may download multimedia content by accessing the Internet through the communication module 1220 .

The communication module 1220 is largely divided into a wired type and a wireless type. Since the wired type and the wireless type have their respective strengths and weaknesses, in some cases, the wired type and the wireless type may be simultaneously provided in the content reproducing device 1200 .

In the case of the wired type, LAN (Local Area Network) or USB (Universal Serial Bus) communication is a typical example, and other methods are also possible.

In the case of the wireless type, a communication method of a Wireless Personal Area Network (WPAN) series such as Bluetooth or Zigbee may be mainly used. However, since the wireless communication protocol is not limited thereto, the wireless communication module may use a wireless local area network (WLAN)-based communication method such as Wi-Fi or other known communication methods.

On the other hand, it is possible to use a proprietary protocol developed by a game machine or console manufacturer as a wired/wireless communication protocol.

The memory 1240 may store various types of information. Various data may be temporarily or semi-permanently stored in the memory 1240 . Examples of the memory 1240 include a hard disk (HDD), a solid state drive (SSD), a flash memory, a read-only memory (ROM), a random access memory (RAM), and the like. This can be. The memory 1240 may be provided in a form embedded in the content reproducing device 1200 or in a form detachable.

In the memory 1240 , various data necessary for the operation of the content reproduction device 1200, including an operating system (OS) for driving the content reproduction device 1200 or content to be executed in the content reproduction device 1200 are stored. can

The controller 1260 may control the overall operation of the content playback device 1200 . For example, the controller 1260 may load and reproduce multimedia content from the memory 1240 or generate a control signal for controlling the output of video, audio, or thermal feedback according to the content reproduction.

The controller 1260 may be implemented as a central processing unit (CPU) or a similar device according to hardware, software, or a combination thereof. It may be provided in the form of an electronic circuit that performs a control function by processing an electrical signal in hardware, and may be provided in the form of a program or code for driving the hardware circuit in software.

1.2.2. audiovisual device

The audiovisual device 1400 may output images and audio according to multimedia playback.

3 is a block diagram related to the configuration of the audio-visual device 1400 according to an embodiment of the present invention.

Referring to FIG. 3 , the audiovisual device 1400 may include a communication module 1420 and an A/V module 1440 .

The communication module 1420 may communicate with an external device. The audiovisual device 1400 may transmit/receive data to and from the content reproduction device 1200 through the communication module 1420 . For example, the audiovisual device 1400 may receive an A/V signal from the content reproduction device 1200 or the feedback device 1600 through the communication module 1420 .

Since the communication module 1420 of the audiovisual device 1400 may be provided similarly to the communication module 1220 of the content reproduction device 1200, a more detailed description thereof will be omitted.

The A/V module 1440 may provide video or audio to the user. To this end, the A/V module 1440 may include an image module 1442 and an audio module 1444 .

The image module 1442 is generally provided in the form of a display, and may output an image according to an image signal received from the content reproducing device 1200 or the feedback device 1600 . The voice module 1444 is generally provided in the form of a speaker, and may output a voice according to a voice signal received from the content reproduction device 1200 or the feedback device 1600 .

1.2.3. feedback device

The feedback device 1600 may output thermal feedback according to multimedia playback.

4 is a block diagram of a configuration of a feedback device 1600 according to an embodiment of the present invention.

Referring to FIG. 4 , the feedback device 1600 may include a communication module 1620 and a heat output module 1640 .

According to an embodiment of the present invention, the feedback controller 1648 may be configured to be distinct from the heat output module 1640 , or may be included in the heat output module 1640 . Also, the present invention is not limited thereto, and when the feedback controller 1648 exists outside the heat output module 1640 , a feedback controller separate from the feedback controller 1648 may exist inside the heat output module 1640 . In this specification, for convenience of description, it is assumed that the feedback controller 1648 is a configuration included in the heat output module 1640 .

The communication module 1620 may communicate with an external device. The feedback device 1600 may transmit/receive data to and from the content reproduction device 1200 through the communication module 1620 . For example, the feedback device 1600 may receive thermal feedback data from the content playback device 1200 through the communication module 1620 . As another example, the feedback device 1600 may transmit an audio signal and/or an image signal to the audiovisual device 1400 through the communication module 1620 .

The thermal output module 1640 may output thermal feedback. Thermal feedback is a contact surface 1641 that comes into contact with the user's body and a heat output module 1640 including a thermoelectric element connected to the contact surface 1641 receives hot or cold heat generated in the thermoelectric element when power is applied to the contact surface 1641. may be output by applying to the user's body through

The thermal output module 1640 may output thermal feedback by performing a heating operation, an endothermic operation, or a thermal grill operation according to thermal feedback data received from the content reproduction device 1200 through the communication module 1620 , and the user A thermal experience can be experienced by the thermal feedback output.

Meanwhile, a more detailed description of the specific configuration or operation method of the heat output module 1640 will be described later.

2. Thermal output module

Hereinafter, the heat output module 1640 according to an embodiment of the present invention will be described.

2.1. Overview of Thermal Output Modules

The heat output module 1640 may output a thermal feedback for transferring hot and cold heat to a user by performing a heat generating operation, an endothermic operation, or a heat grill operation. In the thermal experience providing system 1000 , the thermal output module 1640 mounted on the feedback device 1600 outputs thermal feedback when the feedback device 1600 receives a thermal feedback signal to provide the thermal experience providing system 1000 to the user. to provide a thermal experience.

The heat output module 1640 may use a thermoelectric element such as a Peltier element to perform the above-described heating operation, heat absorbing operation, or thermal grill operation.

The Peltier effect is a thermoelectric phenomenon discovered by Jean Peltier in 1834. means a phenomenon that occurs. The Peltier device is a device that causes this Peltier effect. The Peltier device was initially made of a dissimilar metal junction such as bismuth and antimony, but has recently been manufactured by arranging NP semiconductors between two metal plates to have higher thermoelectric efficiency. .

In the Peltier device, when current is applied, heat and endotherm are immediately induced in both metal plates, and heat and endotherm can be switched according to the direction of the current. It is suitable for use in exothermic or endothermic operations. In particular, as a flexible thermoelectric element is recently developed, it can be manufactured in a form that can be easily contacted with the user's body, thereby increasing the commercial applicability of the feedback device 1600 .

Accordingly, the heat output module 1640 may perform a heat-generating operation or a heat-absorbing operation as electricity is applied to the above-described thermoelectric element. Although an exothermic reaction and an endothermic reaction occur at the same time in the thermoelectric element to which electricity is physically applied, in the present specification, with respect to the heat output module 1640, the surface in contact with the user's body generates heat as an exothermic operation, which absorbs heat. is defined as an endothermic action. For example, the thermoelectric element may be configured by disposing an N-P semiconductor on a substrate 1642 , and when a current is applied thereto, heat is generated on one side and heat is absorbed on the other side. Here, when the side facing the user's body is the front side and the opposite side is the back side, heat generation from the front side and heat absorption from the back side with respect to the heat output module 1640 are defined as performing a heating operation, and vice versa from the front side. Endothermic, heat generation from the rear side can be defined as performing endothermic operation.

In addition, since the thermoelectric effect is induced by the electric charge flowing in the thermoelectric element, it is possible to describe the electricity that induces the heat generating operation or the endothermic operation of the heat output module 1640 from the viewpoint of current, but in this specification, for convenience of description, In general, it will be described in terms of voltage. However, this is only for convenience of explanation, and a person having ordinary knowledge in the technical field to which the present invention belongs with respect to the description in terms of voltage (hereinafter referred to as 'person of ordinary skill') substitutes and interprets it in terms of current. Since it is not necessary to think about it, it is clear that the present invention should not be construed as being limited in terms of voltage.

2.2. Configuration of heat output module

5 is a block diagram illustrating a configuration of a heat output module 1640 according to an embodiment of the present invention.

Referring to FIG. 5 , the thermal output module 1640 includes a contact surface 1641 , a substrate 1642 , a thermocouple array 1643 disposed on the substrate 1642 , and a power terminal for applying power to the thermal output module 1640 . 1647 and a feedback controller 1645 .

The contact surface 1641 is in direct contact with the user's body to transfer hot or cold heat generated by the heat output module 1640 to the user's skin. In other words, a portion of the external surface of the feedback device 1600 that directly contacts the user's body may be the contact surface 1641 . For example, the contact surface 1641 may be formed in a grip portion gripped by the user in the casing of the feedback device 1600 .

For example, the contact surface 1641 may be provided as a layer directly or indirectly attached to the outer surface (in the direction of the user's body) of the thermocouple array 1643 that performs a heat-generating operation or a heat-absorbing operation in the heat output module 1640 . This type of contact surface 1641 may be disposed between the thermocouple array 1643 and the user's skin to conduct heat transfer. To this end, the contact surface 1641 may be provided with a material having high thermal conductivity so that heat transfer from the thermocouple array 1643 to the user's body is well achieved. In addition, the layer-type contact surface 1641 also serves to protect the thermocouple array 1643 from external impact by preventing the thermocouple array 1643 from being directly exposed to the outside.

Meanwhile, in the above, the contact surface 1641 has been described as a separate configuration disposed on the outer surface of the thermocouple array 1643 , but otherwise, the outer surface of the thermocouple array 1643 itself may be the contact surface 1641 . . In other words, some or all of the front surface of the thermocouple array 1643 may be the contact surface 1641 .

The substrate 1642 serves to support the unit thermocouple 1645 and is provided as an insulating material. For example, ceramic may be selected as a material of the substrate 1642 . In addition, the substrate 1642 may use a flat plate-shaped one, but this is not necessarily the case.

The substrate 1642 may be provided as a flexible material so as to have flexibility that can be universally used for various types of feedback devices 1600 having various shapes of contact surfaces 1641 . For example, in the gaming controller-type feedback device 1600, the portion where the user grips the gaming controller with the palm of the hand is mostly curved. In order to use the heat output module 1640 on this curved portion, the heat output module ( 1640) may be important to have this flexibility. For this, examples of the flexible material used for the substrate 1642 may include glass fiber or flexible plastic.

The thermocouple array 1643 includes a plurality of unit thermocouples 1645 disposed on a substrate 1642 . As the unit thermocouple 1645, different metal pairs (eg, bismuth and antimony) may be used, but mainly N-type and P-type semiconductor pairs may be used.

In the unit thermocouple 1645 , the semiconductor pair is electrically connected to one end and is electrically connected to the unit thermocouple 1645 at the other end. Electrical connections between pairs of semiconductors 1645a , 1646b or with adjacent semiconductors are made by conductor members 1646 disposed on substrate 1642 . The conductor member 1646 may be a conductive wire such as copper or silver or an electrode.

The electrical connection of the unit thermocouples 1645 may be mainly made of a series connection, and the unit thermocouples 1645 connected in series with each other form a thermocouple group 1644, and again the thermocouple group 1644 is a thermocouple array ( 1643) can be achieved.

The power terminal 1647 may apply power to the thermal output module 1640 . The thermocouple array 1643 may generate heat or absorb heat according to the voltage value of the power applied to the power terminal 1647 and the direction of the current. More specifically, two power terminals 1647 may be connected to one thermocouple group 1644 . Accordingly, when there are several thermocouple groups 1644 , two power terminals 1647 may be disposed for each thermocouple group 1644 . According to this connection method, by individually controlling a voltage value or a current direction for each thermocouple group 1644, whether to perform heat generation and heat absorption and the degree of heat generation or heat absorption can be adjusted.

Also, as will be described later, the power terminal 1647 receives the electrical signal output by the feedback controller 1645, and as a result, the feedback controller 1648 adjusts the direction or magnitude of the electrical signal to the heat output module 1640. It may be possible to control the exothermic operation and the endothermic operation. Also, when there are a plurality of thermocouple groups 1644 , it may be possible to individually control each thermocouple group 1644 by individually adjusting an electrical signal applied to each power terminal 1647 .

The feedback controller 1648 may apply an electrical signal to the thermocouple array 1643 through the power terminal 1647 . Specifically, the feedback controller 1648 receives information on thermal feedback from the controller 1260 of the content playback device 1200 through the communication module 1620, interprets the information on the thermal feedback, and the type or intensity of thermal feedback may be determined, and an electrical signal may be generated according to the determination result and applied to the power terminal 1647 to cause the thermocouple array 1643 to output thermal feedback.

To this end, the feedback controller 1648 may control the operation of the thermocouple array 1643 by performing calculation and processing of various information and outputting an electric signal to the thermocouple array 1643 according to the processing result. Accordingly, the feedback controller 1648 may be implemented as a computer or a similar device according to hardware, software, or a combination thereof. In hardware, the feedback controller 1648 may be provided in the form of an electronic circuit that performs a control function by processing electrical signals, and in software, it may be provided in the form of a program or code for driving a hardware circuit.

The feedback device 1600 may be provided with a plurality of the above-described heat output modules 1640 . For example, when the feedback device 1600 has a plurality of gripping parts, the heat output module 1640 may be mounted on each gripping part of the feedback device 1600 . In this way, when a plurality of heat output modules 1640 are provided in one feedback device 1600 , a feedback controller is provided for each heat output module 1640 in the feedback device 1600 or all heat output modules 1640 . A single feedback controller may be provided for integrated management. Also, when a plurality of feedback devices 1600 are provided to the thermal experience system 1000 , one or a plurality of heat output modules 1640 may be disposed in each feedback device 1600 .

2.3. Type of heat output module

Based on the description of the configuration of the heat output module 1640 described above, some representative forms of the heat output module 1640 will be described.

6 is a diagram of one form of a heat output module 1640 according to an embodiment of the present invention.

Referring to FIG. 6 , in one form of the heat output module 1640 , a pair of substrates 1642 are provided to face each other. A contact surface 1641 is positioned on the outside of one of the two substrates 1642 , so that heat generated by the heat output module 1640 can be transferred to the user's body. In addition, when the flexible substrate 1642 is used as the substrate 1642 , flexibility can be imparted to the heat output module 1640 .

A plurality of unit thermocouples 1645 are positioned between the substrates 1642 . Each unit thermocouple 1645 includes a semiconductor pair of an N-type semiconductor and a P-type semiconductor. In each unit thermocouple 1645 , the N-type semiconductor and the P-type semiconductor are electrically connected to each other by a conductor member 1646 at one end. In addition, the N-type semiconductor and the other end of the P-type semiconductor of the arbitrary unit thermocouple 1645 are electrically connected to each other by the conductor member 1646 and the other end of the P-type semiconductor and the N-type semiconductor of the unit thermocouple 1645 adjacent to each other. In this way, the electrical connection between the unit elements is made. Accordingly, the unit connection elements are connected in series to form one thermocouple group 1644 . In this form, the entire thermocouple array 1643 consists of one thermocouple group 1644, and since the entire unit thermocouple 1645 is connected in series between the power terminals 1647, the heat output module 1640 is Do the same over the entire front. That is, when power is applied to the power terminal 1647 in one direction, the heat output module 1640 may perform a heating operation, and when power is applied in the opposite direction, the heat output module 1640 may perform a heat absorbing operation.

7 is a diagram of another form of a heat output module 1640 according to an embodiment of the present invention.

Referring to FIG. 7 , another form of the heat output module 1640 is similar to the one described above. However, in this form, the thermocouple array 1643 has a plurality of thermocouple groups 1644 , and as each thermocouple group 1644 is connected to each power terminal 1647 , each thermocouple group 1644 is individual. control is possible. For example, in FIG. 7 , by applying currents in different directions to the first thermocouple group 1644 and the second thermocouple group 1644 , the first thermocouple group 1644 performs a heating operation (the current direction at this time) 'forward'), and the second thermocouple group 1644 may perform an endothermic operation (the current direction at this time is 'reverse'). As another example, by applying different voltage values to the power supply terminal 1647 of the first thermocouple group 1644 and the power supply terminal 1647 of the second thermocouple group 1644, the first thermocouple group 1644 and the second thermocouple group 1644 may be configured to perform a heat-generating operation or a heat-absorbing operation to a different degree from each other.

Meanwhile, although FIG. 7 illustrates that the thermocouple groups 1644 are arranged in a one-dimensional array in the thermocouple array 1643, it is also possible to have the thermocouple groups 1644 arranged in a two-dimensional array. 8 is a diagram of another form of a heat output module 1640 according to an embodiment of the present invention. Referring to FIG. 8 , by using a thermocouple group 1644 arranged in a two-dimensional array, more granular operation control for each region may be possible.

On the other hand, although it has been described that a pair of opposing substrates 1642 are used in the above-described forms of the heat output module 1640 , it is also possible to use a single substrate 1642 . 9 is a diagram of another form of a heat output module 1640 according to an embodiment of the present invention. Referring to FIG. 9 , a unit thermocouple 1645 and a conductor member 1646 may be disposed on a single substrate 1642 in such a way that they are embedded in the single substrate 1642 . For this purpose, it is possible to use glass fiber or the like as the substrate 1642 . If the single substrate 1642 of this type is used, higher flexibility can be imparted to the heat output module 1640 .

Various forms of the heat output module 1640 described above may be combined or modified within a range apparent to those skilled in the art. For example, in each form of the heat output module 1640 , it has been described that the contact surface 1641 on the front surface of the heat output module 1640 is formed as a separate layer from the heat output module 1640 , but the heat output module 1640 . ), the front surface itself may be the contact surface 1641 . For example, in one form of the above-described heat output module 1640 , the outer surface of one substrate 1642 may be the contact surface 1641 .

2.4. Thermal feedback output

Hereinafter, a thermal feedback output operation performed by the feedback device 1600 will be described.

The feedback device 1600 may output thermal feedback as the heat output module 1640 performs a heat generating operation or an endothermic operation. Thermal feedback may include warm feedback, cool feedback, and thermal grill feedback.

Here, the warmth feedback may be output by the heat output module 1640 performing a heating operation, and the cooling feedback may be output by performing an endothermic operation. In addition, the thermal grill feedback may be output through a thermal grill operation in which a heating operation and an endothermic operation are combined.

Meanwhile, the feedback device 1600 may output the above thermal feedback with various intensities. The intensity of the thermal feedback may be adjusted in such a way as to adjust the magnitude of the voltage applied to the thermocouple array 1643 by the feedback controller 1648 of the thermal output module 1640 through the power terminal 1647 . Here, the method of adjusting the magnitude of the voltage includes a method of applying the power to be finally applied to the thermoelectric element after smoothing the duty signal. That is, adjusting the magnitude of the voltage by adjusting the duty rate of the duty signal should also be regarded as being included in adjusting the magnitude of the voltage.

Hereinafter, a heating operation, an endothermic operation, and a thermal grill operation will be described in more detail.

2.4.1. Exothermic/endothermic action

The feedback device 1600 may provide heat feedback to the user by performing a heating operation with the heat output module 1640 . Similarly, an endothermic operation may be performed with the heat output module 1640 to provide a cooling feedback to the user.

10 is a diagram illustrating a heat generating operation for providing a sense of warmth feedback according to an embodiment of the present invention, and FIG. 11 is a graph showing the intensity of a sense of warmth feedback according to an embodiment of the present invention.

Referring to FIG. 10 , the heating operation may be performed by inducing an exothermic reaction in the direction of the contact surface 1641 as the feedback controller 1648 applies a forward current to the thermocouple array 1643 . Here, when the feedback controller 1648 applies a constant voltage (hereinafter, a voltage causing an exothermic reaction is referred to as a 'constant voltage') to the thermocouple array 1643, the thermocouple array 1643 starts a heating operation, and the contact surface ( 1641), as shown in FIG. 11, rises to the saturation temperature with time. Therefore, the user does not feel or feels weak at the beginning of the heating operation, and feels that the warmth rises until the saturation temperature is reached. do.

12 is a diagram illustrating a heat generating operation for providing a feeling of cooling feedback according to an embodiment of the present invention, and FIG. 13 is a graph showing the strength of a feeling of cooling feedback according to an embodiment of the present invention.

Referring to FIG. 12 , the endothermic operation may be performed by inducing an endothermic reaction in the direction of the contact surface 1641 as the feedback controller 1648 applies a reverse current to the thermocouple array 1643 . Here, when the feedback controller 1648 applies a constant voltage (hereinafter, a voltage causing an endothermic reaction is referred to as a 'reverse voltage') to the thermocouple array 1643, the thermocouple array 1643 initiates an endothermic operation, the contact surface The temperature of 1641 increases to the saturation temperature with time as shown in FIG. 13 . Therefore, the user does not feel a feeling of cooling or feels weak at the beginning of the endothermic operation, and feels that the feeling of cooling rises until the saturation temperature is reached. do.

On the other hand, when power is applied to the thermoelectric element, heat is generated as electrical energy is converted into thermal energy in addition to the exothermic reaction and endothermic reaction occurring on both sides of the thermoelectric element. Accordingly, when a voltage of the same magnitude is applied to the thermocouple array 1643 by changing only the direction of the current, the amount of change in temperature due to the heating operation may be greater than the amount of change in temperature due to the endothermic operation. Here, the temperature change amount means a temperature difference between the initial temperature and the saturation temperature in a state in which the heat output module 1640 does not operate.

Meanwhile, hereinafter, the heat generating operation and the endothermic operation performed by the thermoelectric element using electrical energy will be collectively referred to as a 'thermoelectric operation'. In addition, since a thermal grill operation, which will be described later, is a combined operation of a heating operation and an endothermic operation, the thermal grill operation may also be interpreted as a type of 'thermoelectric operation'.

2.4.2. Intensity control of exothermic/endothermic action

As described above, when the heat output module 1640 performs a heating operation or an endothermic operation, the feedback controller 1648 controls the degree of heat generation or endotherm of the heat output module 1640 by adjusting the magnitude of the applied voltage. can Accordingly, in addition to selecting the type of thermal feedback to be provided among the warm feedback and the cold feedback by adjusting the direction of the current by the feedback controller 1648, the intensity of the warm feedback or the cold feedback may be adjusted by adjusting the magnitude of the voltage.

14 is a graph showing the intensity of a feeling of warmth/cooling feedback using voltage control according to an embodiment of the present invention.

For example, referring to FIG. 14 , the feedback controller 1648 applies the voltage value of 5 steps in the forward or reverse direction, so that the feedback device 1600 provides the user with a total of 10 strengths of 5 steps of warmth feedback and 5 steps of cool feedback. It can provide thermal feedback.

Here, although FIG. 14 shows that the warm feedback and the cool feedback each have the same number of intensity grades, the number of intensity grades of the warm feedback and the cool feedback does not necessarily have to be the same and may be different from each other.

Also, although it is illustrated that the warm feedback and the cold feedback are implemented by changing the direction of the current using the voltage value of the same magnitude, the magnitude of the voltage value applied for the warmth feedback and the magnitude of the voltage value applied for the cool feedback does not have to be identical to each other.

In particular, when the same voltage is applied to perform a heating operation and an endothermic operation, since the temperature change in the warmth feedback due to the heating operation is generally larger than the temperature change in the endothermic operation, it is applied to the temperature feedback of the same grade during the cooling feedback. It is also possible to apply a voltage greater than the required voltage to show the same amount of temperature change in intensity classes corresponding to each other.

In the above description, it has been described that the voltage value applied to the heat output module 1640 is adjusted in order to control the intensity of the thermal feedback. However, the intensity of the thermal feedback can be controlled in other ways.

For example, when the thermocouple array 1643 of the thermal output module 1640 has a plurality of individually controllable thermocouple groups 1644 , the feedback controller 1648 controls the operation for each thermocouple group 1644 to provide thermal feedback. intensity can be adjusted.

FIG. 15 is a graph relating to temperature/cooling feedback intensity adjustment through operation control for each thermocouple group 1644 according to an embodiment of the present invention. Referring to FIG. 15 , when the thermocouple array 1643 includes five thermocouple groups 1644-1, 1644-2, 1644-3, 1644-4, and 1644-5, the feedback controller 1648 controls the thermocouple By applying a voltage to all or part of the pair group 1644, the intensity of the thermal feedback may be adjusted. For example, the feedback controller 1648 applies a voltage to the entire thermocouple group 1644 to provide the user with the highest intensity thermal feedback, or applies a voltage to only four thermocouple groups 1644 to give the user the highest intensity. of thermal feedback, or by applying a voltage to only three groups of thermocouples 1644 to provide a medium intensity thermal feedback to the user, or by applying a voltage to only two groups of thermocouples 1644 to provide a medium intensity thermal feedback to the user. Feedback may be provided, or voltage may be applied to only one group of thermocouples 1644 to provide the lowest intensity thermal feedback to the user.

In this way, when the intensity of thermal feedback is adjusted through whether voltage is applied/non-applied for each thermocouple group 1644 , the feedback controller 1648 controls the thermocouple group to which the voltage is to be applied so that the heat distribution is as uniform as possible within the allowable range. (1644) can be chosen. To this end, the feedback controller 1648 applies a voltage to the thermocouple group 1644 in such a way that the continuous number of the thermocouple group 1644 to which the voltage is applied or the thermocouple group 1644 to which the voltage is not applied is minimized. can decide whether Since the table shown in FIG. 15 is a form in consideration of the uniformity of the heat distribution, it will be more clearly understood with reference to the table.

As another example, it is also possible for the feedback controller 1648 to adjust the intensity of the thermal feedback by controlling the power-on timing. Specifically, the feedback controller 1648 may adjust the intensity of the thermal feedback by applying power to the thermocouple array 1643 as an electrical signal in the form of a duty signal having a duty cycle.

16 is a graph showing control of the intensity of warmth/cooling feedback through power application timing control according to an embodiment of the present invention. Referring to FIG. 16 , it can be seen that the intensity of the thermal feedback is controlled by adjusting the duty rate of the electrical signal.

As described above, if the intensity of the thermal feedback is adjusted, it is possible to provide a subdivided thermal feedback such as a strong feeling of warmth, a weak feeling of warmth, a strong feeling of coolness, and a weak feeling of coolness, rather than simply providing a feeling of warmth and coolness to the user. Such variously subdivided thermal feedback can provide a higher immersion to users in game environments or virtual/augmented reality environments, and when applied to medical devices, it has the advantage of more precisely examining the patient's senses.

On the other hand, in addition to the above-described intensity control method of the thermal feedback, it is also possible to adjust the intensity of the thermal feedback by mixing a voltage control method, an adjustment method for each thermocouple group 1644 (ie, adjustment for each region), and an adjustment method using a duty cycle. It is possible, and since it is only obvious to those skilled in the art to combine them, a description thereof will be omitted.

2.4.2. heat grill action

The feedback device 1600 may provide thermal grill feedback in addition to thermal feedback and cooling feedback. The sense of heat means that when hot and cold spots are stimulated at the same time in a person's body, they are not recognized as warm and cold but are recognized as pain. Accordingly, the feedback device 1600 may provide a heat grilling feedback to the user through a heat grilling operation in which a heating operation and an endothermic operation are combined.

Meanwhile, the feedback device 1600 may perform various types of heat grill operations to provide heat grill feedback, which will be described later after the types of heat grill feedback are described.

2.4.2.1. Types of heat grill feedback

Heat grill feedback may include neutral heat grill feedback, hot grill feedback, and cold grill feedback.

Here, the neutral heat grill feedback, the hot grill feedback, and the cold heat grill feedback induce a neutral heat feeling, a warm feeling, and a cold feeling, respectively, in the user. Neutral heat sensation may mean that only a sensation is felt without a feeling of warmth or cold, the sensation of warm heat may mean that a sensation is felt in addition to a feeling of warmth, and the sensation of cold heat may mean that a sensation is felt in addition to a feeling of cold.

Neutral heat sensation is induced when the intensity of a user's feeling of warmth and cold falls within a predetermined ratio range. The rate of feeling neutral heat sensation (hereinafter referred to as the 'neutral rate') may be different for each body part that receives thermal feedback, and even if it is the same body part, it may be slightly different for each individual. Neutral heat pain tends to be felt in situations given greater than intensity.

Here, the intensity of the thermal feedback may be the amount of heat applied by the feedback device 1600 to the body part in contact with the contact surface 1600 or the amount of heat absorbed from the body part. Accordingly, when thermal feedback is applied to a predetermined area for a predetermined time, the intensity of the thermal feedback may be expressed as a difference value between a temperature of a warm feeling or a feeling of cold with respect to the temperature of a target region to which the thermal feedback is applied.

On the other hand, the human body temperature is usually between 36.5 ~ 36.9 ℃, the skin temperature is known to be about 30 ~ 32 ℃ on average, although there are differences between individuals and parts. The temperature of the palm is about 33°C, which is slightly higher than the average skin temperature. Of course, the above-mentioned temperature values may vary somewhat depending on the individual, and even the same person may vary to some extent.

According to one experimental example, it was confirmed that a neutral heat sensation was felt when a warmth of about 40°C and a feeling of cold of about 20°C were given to the palm at 33°C. This gives a feeling of warmth of +7°C and a feeling of coolness of -13°C based on the palm temperature, so the neutral ratio in terms of temperature may correspond to 1.86.

As can be seen from this, in most people, when warm and cold are continuously applied to body areas of the same size, it is expressed as the ratio of the temperature difference caused by the cold to the temperature difference caused by the warm feeling on the skin being contacted. The neutral ratio to be achieved is in the range of about 1.5 to 5. In addition, the warm sensation may be felt when the magnitude of the warmth is greater than the neutral ratio, and the cold sensation can be felt when the magnitude of the cold sensation is greater than the neutral ratio.

2.4.2.2. Thermal grill behavior according to voltage regulation

The feedback device 1600 may perform a thermal grill operation in a voltage control method. The voltage control type thermal grill operation may be applied to the feedback device 1600 in which the thermocouple array 1643 includes a plurality of thermocouple groups 1644 .

Specifically, in the thermal grill operation of the voltage control method, the feedback controller 1648 applies a forward voltage to a part of the thermocouple group 1644 to perform a heating operation, and applies a reverse voltage to the other part to perform an endothermic operation, This may be accomplished as the heat output module 1640 simultaneously provides a sense of warmth feedback and a sense of cool feedback.

17 is a diagram illustrating an operation of a thermal grill using a voltage control method according to an embodiment of the present invention.

Referring to FIG. 17 , the thermocouple array 1643 includes a plurality of thermocouple groups 1644 arranged to form a plurality of lines. Here, the feedback controller 1648 causes the first thermocouple groups 1644-1 (eg, odd-numbered line thermocouple groups) to perform a heating operation and the second thermocouple groups 1644-2, for example The even-numbered line thermocouple groups) may apply power to perform an endothermic operation. As such, when the thermocouple groups 1644 alternately perform a heating operation and an endothermic operation according to the line arrangement, the user receives a feeling of warmth and coolness at the same time, and as a result, a heat grill feedback can be provided. Here, the division between odd-numbered lines and even-numbered lines is arbitrary, and vice versa.

Here, in the feedback device 1600 , the saturation temperature according to the heating operation of the first thermocouple groups 1644 - 1 and the saturation temperature according to the endothermic operation of the second thermocouple groups 1644 - 2 depend on a neutral ratio. control to provide neutral heat grill feedback.

18 is a table of voltages for providing neutral heat grill feedback in a voltage control method according to an embodiment of the present invention.

For example, referring to FIG. 18 , the feedback controller 1648 may apply five positive voltages and five reverse voltages to the heat output module 1640 , respectively, and the heat output module 1640 accordingly generates 5 grades of heat generation operation. Assuming that the feedback device 1600 performs an endothermic operation with an endothermic operation, the magnitude of the temperature change according to the same grade of heat generation operation and the endothermic operation is the same, and the magnitude of the temperature change amount between each grade is constant, the neutral ratio is set to 3 In this case, the feedback controller 1648 applies a constant voltage of the first grade, which is the smallest grade, to the first thermocouple group 1644-1, and the inverse of the third grade to the second thermocouple group 1644-2. By applying a voltage, the thermal output module 1640 can provide neutral thermal nociceptive feedback. Similarly, if the neutral ratio is 2.5, the feedback controller 1648 applies a second class of constant voltage to the first thermocouple group 1644-1 and provides a neutral heat grill feedback to the second thermocouple group 1644. For -2), the 5th grade reverse voltage can be applied. Alternatively, when the neutral ratio is 4, the feedback controller 1648 applies a first-grade constant voltage to the first thermocouple group 1644-1, and a fourth-grade inverse voltage to the second thermocouple group 1644-2. A voltage can be applied to generate neutral heat grill feedback. Alternatively, when the neutral ratio is 2, the feedback controller 1648 provides a neutral thermal sensation by applying a first grade constant voltage and a second grade reverse voltage or a second grade constant voltage and a fourth grade reverse voltage. can do. At this time, the strength of the former neutral thermal sensing (when using the first grade constant voltage and the second grade inverse voltage) is stronger than the latter's neutral thermal sensing (when using the second grade constant voltage and the fourth grade inverse voltage). can be strong That is, even in the case of heat grill feedback, the intensity can be adjusted. Meanwhile, the above description of a method for providing a neutral thermal sensation is exemplary, and the present invention is not limited thereto. For example, the number of grades of thermal feedback need not be five, and it is also possible that the number of grades of cold heat and warm heat are different. Also, the interval of the temperature change of each class does not have to be constant, for example, the voltage interval of each class may be constant.

In addition, the feedback controller 1648 may provide warm grill feedback by adjusting the constant voltage and the reverse voltage to be less than or equal to the neutral ratio, or may provide cold grill feedback by adjusting the constant voltage and the reverse voltage to be greater than or equal to the neutral ratio.

For example, referring back to FIG. 18 , when the neutral ratio is set to 3, the feedback controller 1648 applies a first class constant voltage to the first thermocouple group 1644 - 1 and applies the first class constant voltage to the second thermocouple group 1644 . When the reverse voltage of the 1st or 2nd grade is applied to -2), the heat output module 1640 generates heat and pain at a lower rate than the neutral ratio, thereby providing a heating grill feedback that feels both warmth and pain to the user. can do. On the other hand, at this time, the constant voltage is not necessarily the constant voltage used for the neutral heat grill feedback. In other words, the feedback controller 1648 may cause the heat output module 1640 to provide thermal grill feedback using a 4th grade constant voltage and a 4th grade reverse voltage.

In the case of cold-heat grill feedback, when the neutral ratio of the feedback controller 1648 is set to 3, (grade 1, grade 4) or (grade 1, grade 5) (constant voltage, reverse voltage) of the heat output module 1640 can be authorized to

However, when providing warm grill feedback or cold grill feedback, if constant voltage and reverse voltage are applied at a ratio significantly deviating from the neutral ratio, there may be a problem that the user does not feel a sense of urgency. It may be desirable to adjust the level of /reverse voltage.

2.5. heat transfer behavior

Hereinafter, the heat transfer operation will be described. Here, the heat moving operation is an operation of moving heat in the region of the heat output module, which may be performed using the heat output module 1640 including a plurality of individually controllable thermocouple groups 1644 .

19 is a schematic diagram of an example of an electrical signal for a heat movement operation according to an embodiment of the present invention, and FIG. 20 is a diagram illustrating a heat movement operation according to FIG. 19 .

19 and 20 , the heat output module 1640 includes a first thermocouple group 1644-1, a second thermocouple group 1644-2, a third thermocouple group 1644-3, and a second thermocouple group 1644-1. 4 thermocouple groups 1644 - 4 may be included.

In this case, the feedback controller 1648 may sequentially apply power to the thermoelectric element groups. Accordingly, the first thermocouple group 1644 - 1 may first perform a thermoelectric operation (here, the thermoelectric operation includes a heating operation, an endothermic operation, and a thermal grill operation). Thereafter, the thermoelectric operation may be performed in the order of the second, third, and fourth thermocouple groups 1644-2, 1644-3, and 1644-4.

Also, the feedback controller 1648 may cut off the power to the previous thermocouple group 1644 at the time of applying the power to the specific thermocouple group 1644 . Accordingly, the first thermocouple group 1644-1 stops the thermoelectric operation when the second thermocouple group 1644-2 starts the thermoelectric operation, and the second thermocouple group 1644-3 stops the third thermoelectric operation. When the pair group 1644 - 3 starts the thermoelectric operation, the thermoelectric operation is stopped, and the third thermocouple group 1644 - 3 starts the thermoelectric operation when the fourth thermocouple group 1644 - 4 starts the thermoelectric operation. can be stopped

Accordingly, the user may feel that heat moves from the area where the first thermocouple group 1644 - 1 is disposed to the area where the fourth thermocouple group 1644 - 4 is disposed on the contact surface.

The above-described example may be utilized as follows.

For example, if a plurality of thermoelectric element groups in the feedback device are arranged in a horizontal direction in a state held by the user, cooling heat may be moved from one side to the other side to provide the user with a feeling of passing cool wind. Also, moving the heat can provide a sense of passing the heat source.

21 is a schematic diagram of another example of an electric signal for a heat movement operation according to an embodiment of the present invention, and FIG. 22 is a diagram illustrating a heat movement operation according to FIG. 21 .

21 and 22 , the heat output module 1640 includes a first thermocouple group 1644-1, a second thermocouple group 1644-2, a third thermocouple group 1644-3, and a second thermocouple group 1644-1. 4 thermocouple groups 1644 - 4 may be included.

In this case, the feedback controller 1648 may sequentially apply power to the thermocouple groups 1644 . Accordingly, the first thermocouple group 1644 - 1 may first perform a thermoelectric operation. Thereafter, the thermoelectric operation may be performed in the order of the second, third, and fourth thermocouple groups 1644-2, 1644-3, and 1644-4.

Also, the feedback controller 1648 may cut off the power to the previous thermocouple group after a predetermined time from the point in time when power is applied to the specific thermocouple group 1644 . Accordingly, when the thermal sensation by the first thermocouple group 1644-1 is finished, the user may feel the thermal sensation by the second thermocouple group 1644-2, and the second thermocouple group 1644- When the thermal sensation by 2) ends, the thermal sensation by the third thermocouple group 1644-3 can be felt, and when the thermal sensation by the third thermocouple group 1644-2 ends, the first A feeling of heat generated by the four thermocouple groups 1644 - 4 may be sensed.

This is considering that a predetermined time is required from the time when power is applied to the thermocouple group until the contact surface reaches a temperature at which the user feels heat. That is, the predetermined time may correspond to a delay time from when power is applied to the thermoelectric element until the temperature of the contact surface reaches a temperature suitable for transferring a sense of heat.

Accordingly, the user may naturally feel that heat moves from the area where the first thermocouple group 1644 - 1 is disposed to the area where the fourth thermocouple group 1644 - 4 is disposed on the contact surface.

23 is a schematic diagram of another example of an electrical signal for a heat transfer operation according to an embodiment of the present invention, and FIG. 24 is a diagram illustrating a heat transfer operation according to an embodiment of the present invention.

23 and 24 , the heat output module 1640 includes a first thermocouple group 1644-1, a second thermocouple group 1644-2, a third thermocouple group 1644-3, and a second thermocouple group 1644-1. 4 thermocouple groups 1644 - 4 may be included.

In this case, the feedback controller 1648 may sequentially apply power to the thermocouple groups 1644 . Accordingly, the first thermocouple group 1644 - 1 may first perform a thermoelectric operation. Thereafter, the thermoelectric operation may be performed in the order of the second, third, and fourth thermocouple groups 1644-2, 1644-3, and 1644-4.

In addition, the feedback controller 1648 may not cut off the power to the thermoelectric element to which the pre-powered power is applied. Accordingly, the user may feel that heat rises from the area where the first thermocouple group 1644 - 1 is disposed to the area where the fourth thermocouple group 1644 - 4 is disposed on the contact surface.

The above-described example may be utilized as follows.

For example, if a plurality of thermocouple groups 1644 in the feedback device are disposed in a vertical direction in a state held by the user, cooling heat is transferred from the bottom to the top so that the user is immersed in cold water from the bottom of the body. It can provide a feeling of soaking.

25 is a schematic diagram of another example of an electrical signal for a heat transfer operation according to an embodiment of the present invention, and FIG. 26 is a diagram illustrating a heat transfer operation according to FIG. 25 .

25 and 26 , the heat output module 1640 includes a first thermocouple group 1644-1, a second thermocouple group 1644-2, a third thermocouple group 1644-3, and a second thermocouple group 1644-1. 4 thermocouple groups 1644 - 4 may be included.

At this time, each of the thermocouple groups 1644 is in a state in which power is applied and thermoelectric operation is performed.

In this state, the feedback controller 1648 may turn off power to the thermocouple groups 1644 in order. Accordingly, the first thermocouple group 1644-1 stops the thermoelectric operation first, and then stops the thermoelectric operation in the order of the second, third, and fourth thermocouple groups 1644-2, 1644-3, and 1644-4. can do.

Accordingly, the user may feel that heat is lost from the area where the first thermocouple group 1644 - 1 is disposed to the area where the fourth thermocouple group 1644 - 4 is disposed on the contact surface.

The above-described example may be utilized as follows.

For example, if a plurality of thermocouple groups 1644 in the feedback device are disposed in a vertical direction in a state held by the user, cool heat is moved from the bottom to the top so that the user is immersed in cold water from the bottom of the body. It can provide a sense of escape.

In the above-described example of the heat transfer operation, it has been described that four thermocouple groups 1644 are arranged in a one-dimensional array. It is not limited to the above-mentioned example.

3. Thermal feedback control system

Hereinafter, the thermal feedback control system 2000 according to an embodiment of the present invention will be described.

3.1 Overview of Thermal Feedback Control System

The thermal feedback control system 2000 according to an embodiment of the present invention controls information related to thermal feedback between the content playback device 1200 and the feedback device 1600 so that the thermal feedback is properly output from the feedback device 1600 . it is a system The thermal feedback control system 2000 may be included in the thermal experience providing system 1000 .

As described above, the content reproducing device 1200 provides thermal feedback data to the feedback device 1600, and the feedback device 1600 performs a thermal operation according to the thermal feedback data to output thermal feedback. However, in some cases, the thermal feedback data from the content playback device 1200 may not be understood. For example, depending on the manufacturer of the content playback device 1200 and the feedback device 1600 is different, the language used, the operating system, etc. are different, the command used in the content playback device 1200 and the feedback device 1600 are used. There may be incompatibility between the commands. In this case, since the feedback device 1600 cannot interpret the thermal feedback from the content playback device 1200, the content playback device 1200 may appropriately output the intended timing, intensity, and type of thermal feedback. none.

In order to solve this problem, a thermal feedback control system 2000 will be described in the present invention. According to the thermal feedback control system 2000 , command compatibility between the content reproduction device 1200 and the feedback device 1600 can be improved, and accordingly, the feedback device according to the thermal feedback data provided from the content reproduction device 1200 . Thermal feedback may be output at 1600 .

3.2. Configuration of thermal feedback control system

27 is a block diagram of a configuration of a thermal feedback control system 2000 according to an embodiment of the present invention.

Referring to FIG. 27 , the thermal feedback control system 2000 may include a thermal feedback data output unit 2100 , a thermal output unit 2200 , and a control unit 2300 .

The thermal feedback data output unit 2100 may obtain thermal feedback data and provide the thermal feedback data to the control unit 2300 . Here, the thermal feedback data may include information related to thermal feedback, that is, thermal feedback information. For example, the thermal feedback information may include information about a thermal feedback target, a thermal feedback type, a thermal feedback intensity, and a time when the thermal feedback is felt.

In addition, the thermal feedback data may be configured in a format (format) and/or instructions that can be understood by the thermal feedback data output unit 2100 .

Also, in some embodiments of the present invention, the thermal feedback data output unit 2100 may be implemented in a form included in the content reproduction device 1200 . As a specific embodiment, the thermal feedback data output unit 2100 may be implemented in a form included in the controller 1260 . In addition, the thermal feedback data output unit 2100 may be implemented in a form included in an application capable of playing multimedia content.

However, the present invention is not limited thereto, and the thermal feedback data output unit 2100 may be implemented in a form included in any device capable of acquiring and providing thermal feedback data. As an example, the thermal feedback data output unit 2100 may be implemented in a form included in the feedback device 1600 , the audiovisual device 1200 , or another external device.

Also, the thermal output unit 2200 may obtain thermal feedback control data and provide thermal feedback according to the thermal feedback control data. Here, the thermal feedback control data may refer to data in which information related to thermal feedback is configured in a format and/or a command (hereinafter, an understandable format) that can be understood by the heat output unit 2200 .

Also, in some embodiments of the present invention, the heat output unit 2200 may be implemented in a form included in the feedback device 1600 . In this case, the format of the thermal feedback control data may be the same as or different from the format of the thermal feedback data.

As a specific embodiment, the heat output unit 2200 may be implemented in a form included in the feedback controller 1648 . However, the present invention is not limited thereto, and the heat output unit 2100 may be implemented in a form included in any device that obtains thermal feedback control data and provides thermal feedback according to the thermal feedback control data.

Also, the control unit 2300 may obtain thermal feedback data, generate thermal feedback control data based on the thermal feedback data, and provide the thermal feedback control data.

In an embodiment of the present invention, the format of the thermal feedback control data may be different from the format of the thermal feedback data. In this case, even if the thermal feedback data is provided to the thermal output module 2300 , the thermal feedback data may not be interpreted by the thermal output module 2300 . The control device 2200 may convert the thermal feedback data into thermal feedback control data so that the thermal output module 2300 may output thermal feedback according to thermal feedback information included in the thermal feedback data.

Also, in some embodiments of the present invention, the control unit 2300 may be implemented in a form included in the feedback device 1600 , the audiovisual device 1400 , or the content reproduction device 1200 .

In addition, the present invention is not limited thereto, and the control unit 1300 may be implemented in a form included in any device that provides thermal feedback control data based on the thermal feedback data.

Hereinafter, each component of the thermal feedback control system 2000 will be described in more detail.

3.2.1. Thermal feedback data output unit

28 is a block diagram of a configuration of a thermal feedback output unit 2100 according to an embodiment of the present invention.

Referring to FIG. 28 , the thermal feedback output unit 2100 may include a thermal feedback data obtaining unit 2110 and a thermal feedback data providing unit 2120 .

The thermal feedback data acquisition unit 2110 may acquire thermal feedback data. The thermal feedback data includes thermal feedback information, and the thermal feedback information will be described in detail with reference to FIGS. 29 and 30 .

In an embodiment of the present invention, the thermal feedback data acquisition unit 2110 may generate thermal feedback data. In a specific embodiment, when a thermal event occurs and thermal feedback information according to the thermal event is determined, the thermal feedback data acquisition unit 2110 may generate thermal feedback data according to the thermal feedback information. Here, the thermal event may refer to a specific event in which user experience is improved by interworking with thermal feedback. For example, when the content is game content and a specific thermal event occurs within the game content (eg, when a character in the game content reaches a specific position), the thermal feedback data acquisition unit 2110 may It is possible to determine specific thermal feedback information corresponding to the event. For example, for every thermal event, a table in which thermal feedback information for the corresponding thermal event is specified may be stored, and the thermal feedback data acquisition unit 2110 may determine the specific thermal feedback information based on the table. As another example, an algorithm for calculating thermal feedback information for the corresponding thermal event may be stored. In this case, the thermal feedback data acquisition unit 2110 determines the situation of the specific thermal event (movement speed of the character, thermal resistance of the character, etc.) based on the algorithm, and based on the determination result, the Specific thermal feedback information may be determined. In addition, the thermal feedback data acquisition unit 2110 may generate thermal feedback data based on the specific thermal feedback information.

In an embodiment of the present invention, the data format (or instruction) of the thermal feedback data may be standardized. In this case, according to the standardized data format, the thermal feedback data may be understood in units and/or devices other than the thermal feedback data output unit 2100 . The standardized data format may be stored in the thermal feedback data output unit 2100 or a device (eg, memory 1240 ) accessible by the thermal feedback data output unit 2100 . The thermal feedback data acquisition unit 2110 may acquire a predetermined data format and generate thermal feedback data from the thermal feedback information according to the predetermined data format.

Also, in another embodiment of the present invention, the data format (or instruction) of the thermal feedback data is not standardized and may vary. In this case, according to the various data formats, the thermal feedback data generated based on the specific data format cannot be understood by other units and/or devices that cannot understand the specific data format. Of course, units and/or devices capable of understanding the specific data format may understand the thermal feedback data. In an embodiment of the present invention, the thermal feedback data acquisition unit 2110 is a thermal feedback data generating function for generating thermal feedback data (ie, a function including information on the specific data format (or specific data command)) ) to generate thermal feedback data. Specifically, the thermal feedback data obtaining unit 2110 may access a library including a plurality of thermal feedback data generating functions, obtain information on a specific data format from among the libraries, and based on the information on the specific data format can generate thermal feedback data. As an example, the thermal feedback data generating function may be added to the library, and accordingly, the thermal feedback data obtaining unit 2110 may generate thermal feedback data in a new data format using the added thermal feedback data generating function. can Also, in one embodiment, the thermal feedback data acquisition unit 2110 may call an API (Application Programming Interface) (or API for generating thermal feedback data) for accessing the thermal feedback data generating function, and the API It is possible to obtain information on the specific data format by accessing the library through .

Also, in an embodiment of the present invention, the thermal feedback data acquisition unit 2110 may receive thermal feedback data from the outside. For example, when the multimedia content is video content, the thermal feedback data acquisition unit 2110 may receive thermal feedback data corresponding to the video content from an external device. In this case, the received thermal feedback data may be in a data format understandable by the thermal feedback data acquisition unit 2110 .

Also, in an embodiment of the present invention, the timing at which the thermal feedback data acquisition unit 2110 acquires the thermal feedback data may vary. For example, in multimedia content, when a thermal event occurs in real time, the thermal feedback data acquisition unit 2110 may acquire thermal feedback data in real time whenever the thermal event occurs. As another example, the thermal feedback data acquisition unit 2110 may acquire thermal feedback data according to a predetermined period. For example, the thermal feedback data acquisition unit 2110 may periodically receive thermal feedback data from an external device.

As another example, the thermal feedback data acquisition unit 2110 may acquire thermal feedback data once while the multimedia content is being played. For example, when the multimedia content is video content, one thermal event data including a plurality of thermal feedback information corresponding to a plurality of thermal events occurring in the video content may be obtained.

Also, the thermal feedback data providing unit 2120 may provide the thermal feedback data to the control unit 2300 . In this case, the period in which the thermal feedback data providing unit 2120 provides the thermal feedback may vary. For example, the thermal feedback data providing unit 2120 may provide thermal feedback data to the thermal feedback data providing unit 2120 in real time whenever thermal feedback data is obtained from the thermal feedback data obtaining unit 2110, or Although the feedback data providing unit 2120 generates thermal feedback data, the thermal feedback data may be provided according to a predetermined period, or the thermal feedback data may be provided whenever a request is received from the control unit 2130 .

3.2.1.1. thermal feedback data

Hereinafter, thermal feedback data obtained by the thermal feedback data output unit 2100 will be described.

In this specification, for convenience of description, the thermal feedback data will be mainly described with reference to the embodiments of FIGS. 29 and 30, but the thermal feedback data is not configured only with the embodiments of FIGS. 29 and 30, and the thermal feedback data to be described below The degree of feedback may be combined in various ways to construct thermal feedback data. For example, the thermal feedback data may include a thermal feedback mode, a thermal feedback target, and thermal feedback intensity information. Combining them is only obvious to those skilled in the art, so a description thereof will be omitted.

29 and 30 are diagrams for explaining thermal feedback information according to an embodiment of the present invention.

Referring to FIG. 29 , thermal feedback data is thermal feedback information, and may include information on a thermal feedback target, thermal feedback type, thermal feedback intensity, and thermal feedback provision time.

Here, the thermal feedback target may mean a target to which the thermal feedback is applied. For example, when a plurality of feedback devices 1600 are used in the thermal experience providing system 1000 , when there are a plurality of heat output modules 1640 in the feedback device 1600 , or when a thermocouple group 1644 is controlled Thus, when the thermal output module 1640 is controlled for each region, etc., the thermal feedback target may indicate a target to perform thermal feedback.

Specifically, when a plurality of feedback devices 1600 are used in the system 1000 for providing a thermal experience, the thermal feedback data may include identification information of the feedback device 1600 . For example, the identification information of the feedback device 1600 may be information regarding which gaming controller to output thermal feedback through in a VR system using two bar-type gaming controllers.

Also, when thermal feedback is output for each region from one feedback device 1600 , the thermal feedback data may include information on an output region to which the thermal feedback is output. As an example, the thermal feedback data may be provided to a thermocouple array 1643 including a plurality of individually controllable thermocouple groups 1644 in which the thermoelectric elements of the feedback device 1600 in the thermal experience providing system 1000 are provided. It may include identification information on the thermal output module 1640 to output feedback, and identification information on the thermocouple array 1643 or thermal pair group 1644 to output thermal feedback.

Also, the type of thermal feedback may mean a type of thermal feedback. For example, the thermal feedback type may include a warm feedback, a cool feedback, and a thermal grill feedback. Heat grill feedback can also include neutral heat grill feedback, hot grill feedback, and cold grill feedback.

In addition, the thermal feedback strength may mean the strength of the thermal feedback. In some cases, thermal feedback type information may be included in the thermal feedback intensity information. For example, the thermal feedback intensity can be classified as 1-10 grades, 1-4 grades can be assigned cool feedback, 5-8 grades can be assigned warm feedback, 9-12 grades can have heat grill feedback, and so on. am. Also, as another example, thermal feedback strengths may be classified according to types of thermal feedback. For example, the intensity of the thermal feedback may be classified into 1 to 5 grades for the warm feedback and 1 to 5 grades for the cool feedback.

In addition, the thermal feedback provision time may mean a time during which the thermal feedback is provided. The thermal feedback providing time may include a start time, an end time, and an execution time of the thermal feedback output.

Referring to FIG. 30 , thermal feedback data is thermal feedback information, and may include information about a thermal feedback mode, a type of thermal feedback, and a thermal feedback providing time.

Here, the thermal feedback mode relates to a manner in which thermal feedback is output. Specifically, the thermal feedback mode relates to a method in which thermal feedback is output, and may include a simple output mode and a thermal transfer operation mode.

The simple output mode refers to a heat output mode when thermal feedback output from a plurality of output regions is not related to each other in a user's thermal experience. That is, the thermal feedback output from a specific output region may not be related to the thermal feedback output from another output region.

On the other hand, the heat movement operation mode refers to a heat output mode in the case of an operation of moving heat in a plurality of output areas. In this case, for the heat transfer operation, the thermal feedback output from a specific output region may be related to the thermal feedback output from another output region.

In addition, the heat movement operation mode may include information on the type and direction of the heat movement operation. As the type of the heat movement operation, the first heat movement in which thermal feedback is sequentially output from the output areas, and the thermal feedback output of the previous output area is terminated after a predetermined time from the time when the output of the thermal feedback is started in a specific output area operation (see FIGS. 19 to 22 ), a second heat transfer operation in which thermal feedback is sequentially output in the output regions, but thermal feedback is simultaneously terminated in the output regions (see FIGS. 23 to 24 ) and thermal feedback simultaneously in the output regions A third column moving operation (refer to FIGS. 25 to 26 ) may be included in which feedback is started to be output, but thermal feedback output is terminated in the order of the output regions. Of course, in addition to this, any thermal feedback in which thermal feedback output from a specific output region is related to thermal feedback output from another output region may be included in the thermal transfer operation.

Also, as the type of the heat transfer operation, detailed types of each heat transfer operation may be included. For example, the type and intensity information of the heat movement operation may be combined with the detailed type. For example, the first-first detailed type of the first heat transfer operation in which the thermal feedback is sequentially output from the output regions is a high-intensity grade in the output region where the thermal feedback is first output, and the thermal feedback is output last In the output region, the intensity may be set to a low grade, and subtype 1-2 is a grade with a low intensity in the output region where the thermal feedback is first output, and a grade with high intensity in the output region where the thermal feedback is output last can be set to

Also, the column movement operation mode may include direction information of the column movement operation. For example, the direction information of the heat movement operation may include information on a direction in which the heat movement operation starts and ends. For example, the direction information of the column moving operation is the second direction and the upper/lower output in which the column moving operation is performed in the order of the output area arranged on the left/right side to the output area arranged on the right/left side. It may include a third/fourth direction performed in the order of the output area disposed at the lower/upper side of the area. It is not limited thereto, and the direction information of the heat movement operation may include all information related to the directionality of the heat movement operation.

In addition, the information on the type of thermal feedback and the thermal feedback provision time may be applied as it is described with reference to FIG. 29 .

3.2.2. heat output unit

31 is a block diagram illustrating a configuration of a heat output unit 2200 according to an embodiment of the present invention.

Referring to FIG. 31 , the heat output unit 2200 may include a thermal feedback control data obtaining unit 2210 and a thermal feedback providing unit 2220 .

The thermal feedback control data acquisition unit 2210 may acquire thermal feedback control data. As described above, the thermal feedback control data may be configured in a format (format) and/or instructions (hereinafter, format) that can be understood by the heat output unit 2200 . In other words, the thermal feedback control data cannot be understood by other units and/or devices having a command system that cannot interpret the format. For example, if the thermal feedback providing unit 2100 cannot interpret the format, it cannot understand the thermal feedback control data. In addition, if the format cannot be interpreted by a heat output unit other than the heat output unit 2200 , the thermal feedback control data cannot be understood. That is, the thermal feedback control data may have a specificity that can be understood only in a specific heat output unit. As an example, the thermal feedback control data may be configured in a predetermined packet structure. The packet structures of the thermal feedback control data and the thermal feedback control data will be described in detail with reference to FIG. 31 .

Specifically, the thermal feedback control data acquisition unit 2210 may acquire thermal feedback control data from the control unit 2300 . Of course, in some cases, the thermal feedback control data acquisition unit 2210 may acquire thermal feedback control data from the thermal feedback data output unit 2100 . In this case, the thermal feedback control data acquisition unit 2210 acquires the thermal feedback data output from the thermal feedback data output unit 2100 as thermal feedback control data, and the thermal feedback data and the thermal feedback control data may be the same. have.

Also, in an embodiment, the thermal feedback control data obtaining unit 2210 transmits control request data for requesting thermal feedback control data to the control unit 2300 , and receives the control request data from the control unit 2300 according to the control request data. Thermal feedback control data may be obtained. In this case, the thermal feedback control data acquisition unit 2210 may transmit the control request data to the control unit 2300 according to a predetermined period, and when the thermal output unit 2200 receives a request to output the thermal feedback from the outside can transmit the control request data to the control unit 2300 .

Also, in another embodiment, the thermal feedback control data acquisition unit 2210 may acquire thermal feedback control data from the control unit 2300 without transmitting the control request data. For example, in multimedia content, when a thermal event occurs in real time, the thermal feedback control data acquisition unit 2210 whenever the control unit 2300 acquires the thermal feedback data, in response thereto, the control unit 2300 . It is possible to obtain thermal feedback control data from

As another example, the thermal feedback control data acquisition unit 2210 may acquire thermal feedback control data once while the multimedia content is being played. For example, when the multimedia content is video content, the thermal feedback control data acquisition unit 2210 includes a plurality of thermal feedback information corresponding to a plurality of thermal events linked in the video content from the control unit 2300. One thermal event data may be acquired.

Also, the thermal feedback providing unit 2220 may provide thermal feedback according to the thermal feedback control data. For example, when the heat output module 2220 is implemented in a form included in the feedback controller 1648, the thermal feedback can be output by controlling other components in the heat output module 1640 according to the thermal feedback control data. have. As another example, when the thermal output module 2220 is not included in the feedback controller 1648 , the thermal output module 2220 may provide thermal feedback control data to the feedback controller 1648 .

Also, the thermal feedback providing unit 2220 may include analysis information for interpreting the thermal feedback control data. Optionally, the thermal feedback control data may be encoded in a predetermined manner. For example, in order to reduce the size of the thermal feedback control data, the thermal feedback control data may be encoded in the predetermined manner. If the time for the thermal feedback control data acquisition unit 2220 to acquire the thermal feedback control data is delayed as the size of the thermal feedback control data is large, the provision of the thermal feedback by the thermal feedback supply unit 2220 is also delayed. because it can be

The thermal feedback providing unit 2220 may decode the thermal feedback control data so that the thermal feedback providing unit 2220 can understand it using the analysis information. For example, the analysis information may be configured in the form of a table. Specifically, in the table, when the thermal feedback type information among the thermal feedback control data is composed of “0001”, a feeling of warmth feedback is output, and when composed of “0011”, a feeling of cooling feedback is output, and composed of “0111”. If it is, information to output a feeling of cooling feedback may be included. As another example, the analysis information may include an algorithm for decoding the thermal feedback control data, and the thermal feedback providing unit 2220 may decode the thermal feedback control data according to the algorithm.

3.2.2.1. Thermal feedback control data

Hereinafter, thermal feedback control data obtained by the thermal output unit 2100 will be described.

32 and 33 are diagrams for explaining a packet structure of thermal feedback control data according to an embodiment of the present invention.

Referring to FIG. 32 , a packet structure (hereinafter, a packet) of the thermal feedback control data may include a header and a payload.

The header may include information about the destination, that is, information about the column output module 2200 . For example, the packet may be transmitted by the control unit 2300 , and the control unit 2300 includes information about the control unit 2300 in the header in order to transmit the packet to the heat output module 2200 . can do.

In addition, the payload may include thermal feedback information. In this case, the thermal feedback data in the payload may be arranged in a specific format according to a rule set in the thermal output module 2200 . If the payload is arranged according to a rule other than the rule set by the heat output module 2200, the heat output module 2200 cannot interpret the thermal feedback control data including the payload. To this end, before generating the packet, the control unit 2300 may obtain information about the rule set in the column output module 2200 in advance.

As such, the payload may be configured in various formats. 32 and 33 describe various configurations of the payload.

In this specification, for convenience of description, the payload will be mainly described in the embodiments of FIGS. 32 and 33 , but the payload is not configured only in the embodiments of FIGS. 32 and 33 , and fields to be described below are various. may be combined in such a way to construct a payload. Combining them is only obvious to those skilled in the art, so a description thereof will be omitted. In addition to the fields to be described below, various fields indicating thermal feedback information may exist. For example, the payload may include a mode field for a thermal feedback mode and a heat transfer action field for a heat transfer operation (eg, a field for a type of a heat transfer operation, a field for a direction of a heat transfer operation). can These various fields may also be applied to the field of the payload.

In FIG. 32 , the payload includes a device ID field indicating feedback device identification information, n output region fields indicating from the first output region to the n-th output region, and thermal information for each output region. It may be composed of n feedback information fields indicating feedback information. The device ID field is information indicating which feedback device 1600 the packet is for when a plurality of feedback devices 1600 are used in the thermal experience providing system 1000 . In addition, the output area field is information on an area to which thermal feedback is output from the feedback device 1600 . When the feedback device 1600 includes a plurality of heat output modules 1640 , the output area field is It indicates which column output module 1640 relates to the feedback information field corresponding to the area field. In addition, when the thermocouple array 1643 or the thermocouple group 1644 is individually controlled in the feedback device 1600, the output area field is a feedback information field corresponding to the output area field. or thermocouple group 1644 .

In addition, the feedback information field may include a type field indicating information on the type of thermal feedback and a level field indicating the strength of the thermal feedback. In this case, the type field may include information indicative of warm feedback, cold feedback, and heat grill feedback. In particular, for heat grill feedback, information indicating neutral heat grill feedback, warm grill feedback, and cold grill feedback is included. can do. Also, in the level field, the intensity of the thermal feedback indicated in the type field may be set.

Also, according to an embodiment, the feedback information field may include a level field instead of a type field. In this case, the level field may include information on thermal feedback. For example, in the level field, intensities are classified into grades 1 to 12, grades 1 to 4 are assigned cool feedback, grades 5 to 8 are assigned cool feedback, and grades 9 to 12 are assigned heat grill feedback. can

Referring to FIG. 33 , in (a), the payload of the packet may include an output area field and a level field. In the output area field, when a plurality of output areas are equally controlled by the feedback device 1600 may indicate all of the plurality of output areas, but when the plurality of output areas are individually controlled, the plurality of output areas may be indicated. For example, when the feedback device 1600 includes n output regions, the output region field may include a field value indicating each of the n output regions. Also, in the level field, when the plurality of output regions are equally controlled, the intensity of thermal feedback output from all of the plurality of output regions may be indicated. However, when the plurality of output regions are individually controlled, each of the plurality of output regions A thermal feedback intensity corresponding to may be indicated. For example, when the feedback device 1600 includes n output regions, the output region field may include a field value indicating the thermal feedback strength of each of the n output regions.

Also, as shown in (b), the payload of the packet may include n output region fields indicating each of n output regions and n level fields indicating thermal feedback strength of each of the plurality of output regions. have.

In addition, the payload of the packet may include an output field field, a level field, and a type field as in (c), and a device ID field, an output field field, a level field, and a time field (Time) as in (d). field) may be included. Here, the time field may include information about a time of providing thermal feedback. For example, the time field includes at least one of a first time field indicating a start time of the thermal feedback output, a second time field indicating an end time of the thermal feedback output, and a third time field indicating an execution time of the thermal feedback output. may include Also, according to an embodiment, the start time, the end time, and the execution time may be expressed as unique field values within the time field, rather than as separate fields. In addition, the time field may include at least one of the start time, the end time, and the execution time.

In addition, in the payloads shown in (c) and (d), it is expressed that the output area field and the level field are each included as one field, but the present invention is not limited thereto. As in (b), the payload may include n output field fields, n level fields, n type fields, and n time fields.

In addition to this, the payload of the packet may be expressed in various ways to indicate thermal feedback information.

3.2.3. control unit

As described above, the control unit 2300 may obtain thermal feedback data, generate thermal feedback control data based on the thermal feedback data, and provide the thermal feedback control data. The control unit 2300 transmits and receives data between the thermal feedback data output unit 2100 and the thermal output unit 2200 and improves the compatibility between the thermal feedback data output unit 2100 and the thermal output unit 2200. Middleware It can be implemented in the form of (middleware).

34 is a block diagram of a configuration of a control unit 2300 according to an embodiment of the present invention.

Referring to FIG. 34 , the control unit 2300 may include an acquiring unit 2310 , an analyzing unit 2320 , and a providing unit 2330 .

Also, as described above, the control unit 2300 may be implemented in a form included in the feedback device 1600 , the content reproduction device 1200 , or an external device. For example, the control unit 2300 may be implemented in a form included in the feedback controller 1648 of the feedback device 1600 or another controller in the feedback device 1600 other than the feedback controller 1648 . Also, as another example, the control unit 2300 may be implemented in a form included in the controller 1260 of the content reproducing device 1200 or another controller in the content reproducing device 1200 . In addition, as a specific example, the control unit 2300 may be implemented in the form of a driver for controlling the feedback device 1600 as an external device of the feedback device 1600 , and may be implemented as software independent of multimedia content. It may be implemented in the form of a thermal engine that provides thermal feedback information to content.

In an embodiment of the present invention, the acquisition unit 2310 may acquire thermal feedback data provided from the thermal feedback output unit 2100 .

Also, in an embodiment, the acquiring unit 2310 transmits request data for requesting thermal feedback data to the thermal feedback output unit 2100 , and receives thermal feedback data from the thermal feedback output unit 2100 according to the request data. can be obtained. In this case, the acquiring unit 2310 may transmit the request data to the thermal feedback output unit 2100 according to a predetermined period, and the control unit 2300 requests the thermal feedback control data from the thermal output unit 2200 . The request data may be transmitted to the thermal feedback output unit 2100 only when the control request data is obtained.

Also, in another embodiment, the obtainer 2310 may obtain the thermal feedback data from the thermal feedback output unit 2100 without transmitting the request data. For example, in multimedia content, when a thermal event is generated in real time, the acquiring unit 2310 receives thermal feedback data from the thermal feedback output unit 2100 whenever the thermal feedback output unit 2100 acquires the thermal feedback data. can be obtained.

As another example, the acquirer 2310 may acquire the thermal feedback data once while the multimedia content is being played. For example, when the multimedia content is video content, the acquiring unit 2310 may include a plurality of pieces of thermal feedback information associated with a plurality of thermal events occurring in the video content from the thermal feedback output unit 2100 . Thermal event data may be obtained.

Also, the analysis unit 2320 may analyze the thermal feedback data. As described above, the thermal feedback data may be configured in a format understandable by the thermal feedback data output unit 2100 . That is, in some cases, the thermal feedback data cannot be understood by other units or devices without information about the format. The interpretation may mean understanding information included in the thermal feedback data, that is, information related to the thermal feedback, from the thermal feedback data. The analysis may be expressed in various terms such as analysis and parsing. Accordingly, the analysis unit 2320 may be expressed by various names such as an analysis unit and a parsing unit.

The analysis unit 2320 may obtain information on the format of the thermal feedback data in advance to interpret the thermal feedback data.

In an embodiment of the present invention, when the thermal feedback data is configured in a standardized data format, the analysis unit 2320 is a device to which the obtaining unit 2310 can access information for interpreting the standardized data format (eg, For example, it may be stored in the memory 1240), and information related to thermal feedback may be obtained from the thermal feedback data using information for interpreting the standardized data format.

In another embodiment of the present invention, the thermal feedback data may be configured in various formats other than the standardized data format. In this case, the analysis unit 2320 may access information for interpreting a data format (hereinafter, referred to as a specific data format) of the thermal feedback data and interpret the specific data format. For example, an API for accessing information on the specific data type may be called, and information on the specific data type may be obtained by accessing a library including information on the specific data type through the API. .

In another embodiment of the present invention, the analysis unit 2320 may obtain information on the specific data format from the thermal feedback data output unit 2100 .

The analysis unit 2320 may interpret the thermal feedback data using information on the specific data format.

Also, the providing unit 2330 may provide information about the thermal feedback obtained by analyzing the thermal feedback data to the thermal output unit 2200 . In this case, the providing unit 2330 may provide the information on the thermal feedback in a format that the thermal output unit 2200 can understand.

Specifically, FIG. 35 is a flowchart of an operation of providing thermal feedback control data of the control unit 2300 according to an embodiment of the present invention.

Referring to FIG. 35 , the operation of providing thermal feedback control data of the control unit 2300 includes acquiring thermal feedback data (S3510), determining whether the thermal feedback data can be understood by a feedback device (S3520), and It may include converting the thermal feedback data into thermal feedback control data ( S3530 ).

The acquisition unit 2310 of the control unit 2300 may acquire thermal feedback data (S3510). For convenience of description, since the above-described content of the acquisition unit 2310 may be applied to step S3510 as it is, a detailed description thereof will be omitted.

Also, the providing unit 2330 of the control unit 2300 may determine whether the thermal feedback data can be understood by the feedback device 1600 ( S3530 ). Specifically, the providing unit 2330 may obtain information on a data format that can be understood by the heat output unit 2200 . For example, information on a data format understandable by the heat output unit 2200 may be stored in a device (eg, the memory 1240 ) accessible by the providing unit 2330 . In addition, information on a data format understandable by the heat output unit 2200 may be stored in a specific library, and the providing unit 2330 accesses the library to obtain a data format understandable by the heat output unit 2200 . information can be obtained. Also, as another example, the provider 2330 may receive information about a data format understandable by the heat output unit 2200 from the heat output unit 2200 .

Also, in addition to the heat output unit 2200 , there may be a heat output unit 2200 having a data format other than the data format used by the heat output unit 2200 , and accordingly, the providing unit 2330 provides a plurality of heat output units. For each, it is possible to provide thermal feedback control data that the corresponding thermal output unit can understand. To this end, a table in which information on a data format understandable by each of the plurality of column output units is stored may be stored, and information on a data format understandable by each of the plurality of column output units may be obtained from the table. .

Also, the provider 2330 may determine whether a data format of the thermal feedback data is compatible with a data format understandable by the heat output unit 2200 . As a result of the determination, if compatibility is possible, the providing unit 2330 determines that the thermal feedback data is understood by the feedback device 1600 , and if not compatible, the thermal feedback data is understood by the feedback device 1600 . It can be judged that it cannot be done.

In addition, when it is determined that the thermal feedback data is understood by the feedback device 1600 , the providing unit 2330 may provide the thermal feedback data as the thermal feedback control data without separately processing the thermal feedback data. . That is, the thermal feedback control data obtained from the thermal output unit 2200 may be the same as the thermal feedback data output from the thermal feedback data output unit 2100 .

Also, when it is determined that the thermal feedback data is not understood by the feedback device 1600 , the providing unit 2330 may convert the thermal feedback data into thermal feedback control data ( S3530 ). That is, the providing unit 2330 may process the thermal feedback data to be understandable by the heat output unit 2200 , and provide the processed thermal feedback data, that is, the thermal feedback control data, to the heat output unit 2200 . have. For example, the providing unit 2320 uses the previously obtained information on the data format understandable by the heat output unit 2200 to provide thermal feedback control data based on the information about the thermal feedback extracted from the thermal feedback data. can create Accordingly, the thermal feedback data and the thermal feedback control data may have different data formats (formats), data sizes, packet structures, and the like.

In an embodiment of the present invention, the providing unit 2330 may simply convert the thermal feedback data into the thermal feedback control data, but the thermal output unit 2200 provides the thermal feedback control data without simple conversion. Thermal feedback control data to output thermal feedback from the thermal output module 1640 according to a function (or state, specification, hereinafter referred to as a function of the thermal output module 1640 ) of the module 1640 . can create

For example, the thermal output module 1640 in which the thermal output unit 2200 provides thermal feedback control data may not output thermal feedback according to information on thermal feedback included in the thermal feedback data. For example, the thermal feedback data includes information on a heat movement operation, but is not individually controlled for each thermocouple array 1643 or thermocouple group 1644 in the heat output module 1640 , and all thermoelectric elements are the same. can be controlled. That is, the heat transfer operation cannot be performed in the heat output module 1640 .

To this end, the providing unit 2330 may convert the thermal feedback data into thermal feedback control data so that the thermal feedback may be output from the thermal output module 1640 .

Specifically, the providing unit 2330 may obtain information on the function of the heat output module 1640 . For example, the function of the heat output module 1640 may be reflected in a data format understandable by the heat output unit 2200 . As an example, a packet for a type of a column movement operation does not exist in a packet structure of a data format understandable by the column output unit 2200 , and the providing unit 2330 provides the column output module 1640 based on the packet structure. ) can be checked.

As another example, the provider 2330 may obtain information on the function of the heat output module 1640 from the heat output unit 2330 .

As another example, the providing unit 2330 may include a table indicating information on the function of the heat output module 1640 corresponding to each of the plurality of heat output units, and based on the table, the heat output module Information on the function of 1640 may be obtained.

Also, in the process of generating the thermal feedback control data based on the thermal feedback data, the providing unit 2330 includes information on thermal feedback that cannot be output by the thermal output module 1640 among information included in the thermal feedback data. (hereinafter, non-outputable thermal feedback information) may be removed to generate the thermal feedback data, or the non-outputable thermal feedback information may be replaced with similar thermal feedback information.

For example, when the heat output module 1640 cannot output the heat drawing feedback and the thermal feedback data includes information about the heat drawing feedback, the providing unit 2330 provides the heat drawing feedback information. The thermal feedback control data may be generated by ignoring it, or the thermal feedback control data may be generated by substituting information on the heat drawing feedback with information indicating the output of high intensity thermal feedback.

Implementations related to the provision of thermal feedback control data of the control unit 2300 are described in more detail below.

3.2.3.1. Implementation of providing thermal feedback control data of control unit 2300

36 is a flowchart for explaining the provision of thermal feedback control data by the control unit 2300 when individual control for a plurality of output regions is indicated in the thermal feedback data according to an embodiment of the present invention.

Referring to FIG. 36 , the control unit 2300 may obtain thermal feedback data ( S3610 ).

In addition, the control unit 2300 interprets the thermal feedback data, and when the information on the output region indicates individual control for a plurality of output regions, it determines whether the thermoelectric element of the feedback device 1600 is individually controlled. It can be determined (S3620). As described above, the control unit 2300 may obtain information on the function of the heat output module 1640 of the feedback device 1600 . For example, the control unit 2300 may obtain information on the function of the heat output module 1640 based on a data format understandable by the heat output unit 2200 , and from the heat output unit 2330 , Information on the function of the heat output module 1640 may be obtained, and the information on the function of the heat output module 1640 corresponding to each of the plurality of heat output units is obtained from a table indicating information on the function of the heat output module 1640 . It is also possible to obtain information about the function. The control unit 2300 may determine whether the thermoelectric element of the heat output module 1640 is individually controlled through the information on the function of the heat output module 1640 .

When it is determined that the thermoelectric elements of the feedback device 1600 are individually controllable, the control unit 2300 may generate thermal feedback control data so that the thermoelectric elements are individually controlled ( S3630 ). For example, since the thermoelectric element may be individually controlled in the feedback device 1600 according to the thermal feedback information included in the thermal feedback data, the control unit 2300 performs thermal feedback control on the thermal feedback data without processing additional information. Depending on the data format of the data, thermal feedback control data may be generated.

In addition, when it is determined that the thermoelectric elements of the feedback device 1600 cannot be individually controlled, the control unit 2300 may generate thermal feedback control data so that the thermoelectric elements are singlely controlled (S3640). Here, the single control may mean that all of the thermoelectric elements of the thermal output module 1640 are controlled to one output region by the same thermal feedback signal.

The control unit 2300 may convert thermal feedback output information for a plurality of output regions included in the thermal feedback data into thermal feedback output information for one output region in the thermal feedback control data. For example, when the thermal feedback data includes thermal feedback information for the first output region and thermal feedback information for the second output region, the control unit 2300 may provide thermal feedback for the second output region according to an embodiment. The thermal feedback control data may be generated by using the thermal feedback information for the first output region without considering the information, and thermal feedback information for the first output region and the thermal feedback information for the second output region may be combined to generate thermal feedback. Feedback control data may be generated.

Also, the control unit 2300 may provide the generated thermal feedback control data to the heat output unit 2200 ( S3650 ).

37 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when single control for an output region is indicated in thermal feedback data according to an embodiment of the present invention.

Referring to FIG. 37 , the control unit 2300 may obtain thermal feedback data ( S3710 ).

In addition, the control unit 2300 interprets the thermal feedback data, and when the information on the output region indicates single control of the output region, it is determined whether the thermoelectric element of the feedback device 1600 is single-controlled. can be (S3720).

As described above, the control unit 2300 may obtain information on the function of the heat output module 1640 of the feedback device 1600 , and based on the obtained information on the function of the heat output module 1640 , It may be determined whether the thermoelectric element of the thermal output module 1640 is single-controlled.

When it is determined that the thermoelectric element of the feedback device 1600 is single-controlled, the control unit 2300 may generate thermal feedback control data so that the thermoelectric element is single-controlled ( S3730 ). As an example, the control unit 2300 may generate the thermal feedback control data according to the data format of the thermal feedback control data without processing any particular information.

Also, when it is determined that the thermoelectric elements of the feedback device 1600 are individually controlled, the control unit 2300 may generate thermal feedback control data so that the thermoelectric elements are individually controlled ( S3740 ). For example, the control unit 2300 may indicate the same thermal feedback information to the plurality of thermoelectric elements so that the plurality of thermoelectric elements are individually controlled and the plurality of thermoelectric elements operate as one output region. For example, the control unit 2300 may generate thermal feedback control data indicating the same type, intensity, and provision time of thermal feedback for the plurality of thermoelectric elements according to the thermal feedback data. As another example, the control unit 2300 may generate thermal feedback control data according to a preset rule such that a plurality of thermoelectric elements are individually controlled and different thermal feedbacks are controlled in the plurality of thermoelectric elements.

Also, the control unit 2300 may provide the generated thermal feedback control data to the heat output unit 2200 ( S3750 ).

38 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when a thermal movement operation is indicated in thermal feedback data according to an embodiment of the present invention.

Referring to FIG. 38 , the control unit 2300 may obtain thermal feedback data, and may obtain information on a thermal movement operation from the thermal feedback data ( S3810 ). As an example, the control unit 2300 may obtain information on the type and direction of the heat movement operation from the heat movement operation mode information included in the thermal feedback data.

Also, the control unit 2300 may determine whether the column movement operation field is included in the data format understandable by the heat output unit 2200 ( S3820 ). Here, the time field may mean a field including information on a column movement operation in a packet structure of a data format that can be understood by the column output unit 2200 .

Also, when the data format includes the thermal movement operation field, the control unit 2300 may generate thermal feedback control data including the thermal movement operation field ( S3830 ). For example, the control unit 2300 generates a field for a type of a heat movement operation and/or a field for a direction of a heat movement operation based on information about the heat movement operation included in the thermal feedback data, and the field It is possible to generate thermal feedback control data including

Also, when the data format does not include the column movement operation field, the control unit 2300 may generate thermal feedback control data that does not include the column movement operation field ( S3840 ).

For example, when the thermoelectric elements of the heat output module 1640, that is, a plurality of output regions are individually controlled, a heat movement operation may be performed in the heat output module 1640, but the data format includes a heat movement operation field. There is no heat transfer operation. In this case, the control unit 2300 controls an output area field of the thermal feedback control data, a feedback information field, and You can configure the time field. For example, thermal feedback is sequentially outputted from the output regions for the information on the thermal movement operation, and the thermal feedback output of the previous output region is terminated after a predetermined time from the time when the thermal feedback output is started in a specific output region. If it is a first column movement operation and the direction information of the column movement operation indicates a first direction performed in the order of an output area disposed on the left side of the feedback device 1600 to an output area disposed on the right side of the feedback device 1600 , the control unit 2300 ) is an output area of the thermal feedback control data such that the first intensity of the sense of warmth feedback is output for 1 second from the first output area disposed on the left side of the feedback device 1600 to the nth output area disposed on the right side of the feedback device 1600 . Fields, feedback information fields, and time fields can be configured. Accordingly, the heat output module 1640 may perform the heat movement operation even if there is no heat movement operation field in the thermal feedback control data.

As another example, when the thermoelectric elements of the heat output module 1640, ie, a plurality of output regions, are controlled singly, since the heat movement operation cannot be performed in the heat output module 1640, information on the heat movement operation is provided. Without consideration, thermal feedback control data can be generated.

Also, the control unit 2300 may provide the generated thermal feedback control data to the heat output unit 2200 ( S3850 ).

FIG. 39 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when a provision time of thermal feedback is indicated in thermal feedback data according to an embodiment of the present invention.

Referring to FIG. 39 , the control unit 2300 may obtain thermal feedback data, and may obtain information on a time of providing thermal feedback from the thermal feedback data ( S3910 ). As an example, the control unit 2300 may include at least one of a start time, an end time, and an execution time of the thermal feedback output from the thermal feedback provision time information included in the thermal feedback data.

Also, the control unit 2300 may determine whether the time field is included in the data format understandable by the heat output unit 2200 ( S3920 ). Here, the time field may mean a field including information on a time of providing thermal feedback in a packet structure of a data format that can be understood by the thermal output unit 2200 .

Also, when the time field is included in the data format, the control unit 2300 may generate thermal feedback control data including the time field ( S3930 ). For example, the control unit 2300 may control a first time field indicating a start time of the thermal feedback output and a second time field indicating an end time of the thermal feedback output based on information on a provision time of the thermal feedback included in the thermal feedback data. At least one of the time field and the third time field indicating the execution time of the thermal feedback output may be generated, and thermal feedback control data including the fields may be generated.

Also, when the time field is not included in the data format, the control unit 2300 may generate thermal feedback control data that does not include the time field ( S3940 ). For example, in the data format, the control unit 2300 checks the start time, end time, and execution time of the output region of the thermal feedback based on the information on the provision time of the thermal feedback, the start time, the end time, and The thermal feedback control data may be generated at predetermined intervals so that the thermal feedback is output from the output region according to the execution time. Accordingly, there may be a plurality of thermal feedback control data.

Also, the control unit 2300 may provide the generated thermal feedback control data to the heat output unit 2200 ( S3950 ).

40 is a flowchart for explaining provision of thermal feedback control data by the control unit 2300 when control for a plurality of feedback devices is indicated in the thermal feedback data according to an embodiment of the present invention.

Referring to FIG. 40 , the control unit 2300 may obtain thermal feedback data and may obtain identification information of a plurality of feedback devices 1600 from the thermal feedback data ( S4010 ). For example, the identification information of the plurality of feedback devices 1600 is information on which feedback device 1600 to output thermal feedback through when a plurality of feedback devices 1600 are used for one multimedia content. can

Also, the control unit 2300 may generate thermal feedback data based on the identification information of the plurality of feedback devices 1600 ( S4020 ).

In an embodiment of the present invention, the control unit 2300 may determine whether the device ID field is included in the data format understandable by the column output unit 2200 . Here, the device ID field may mean a field indicating identification information of the feedback device 1600 .

In an embodiment of the present invention, when the device ID field is included in the data format understandable by the thermal output unit 2200, the control unit 2300 based on the identification information of the plurality of feedback devices 1600 from the thermal feedback data. As a result, thermal feedback control data including the device ID field may be generated.

In one embodiment, the control unit 2300 may generate one piece of thermal feedback control data that can all be used in the plurality of feedback devices 1600 . For example, a plurality of device ID fields may be included in the thermal feedback control data. For example, the thermal feedback control data includes a first device ID field indicating the first feedback device 1600 , first thermal feedback information for outputting thermal feedback from the first feedback device 1600 , and a second feedback device 1600 . ) may be included in the second device ID field indicating the second thermal feedback information for the thermal feedback output from the second feedback device 1600 . In this case, one piece of thermal feedback control data may include all information on the thermal feedback of the plurality of feedback devices 1600 .

In another embodiment, the control unit 2300 may generate a plurality of thermal feedback control data that can be used only in one feedback device 1600 among the plurality of feedback devices 1600 by the number of the feedback devices 1600 . . For example, one device ID field may be included in the thermal feedback control data. For example, the first thermal feedback control data includes a first device ID field indicating the first feedback device 1600 , and first thermal feedback information for outputting thermal feedback from the first feedback device 1600 , The second thermal feedback control data may include a second device ID field indicating the second feedback device 1600 and second thermal feedback information for outputting the thermal feedback from the second feedback device 1600 . In this case, only information about the thermal feedback of one feedback device 1600 may be included in one piece of thermal feedback control data.

In another embodiment of the present invention, when the device ID field is not included in the data format understandable by the thermal output unit 2200, the control unit 2300 receives the identification information of the plurality of feedback devices 1600 from the thermal feedback data. Based on , thermal feedback control data that does not include a device ID field may be generated.

In one embodiment, the control unit 2300 checks the thermal feedback information for each of the plurality of feedback devices 1600 based on the identification information of the plurality of feedback devices 1600, and based on the identification information, each feedback device Every 1600 , thermal feedback control data including information on thermal feedback may be generated. In this case, since the device ID field is not included in the data format understandable by the heat output unit 2200 , the device ID field is not included in the thermal feedback control data.

Also, the control unit 2300 may provide the generated thermal feedback control data to the heat output unit 2200 ( S4030 ). For example, when one piece of thermal feedback control data is generated in step S4020 , the single piece of thermal feedback control data may be provided to all of the plurality of feedback devices 1600 . As another example, when a plurality of thermal feedback control data is generated in operation S4020 , different thermal feedback control data corresponding to the plurality of feedback devices 1600 may be transmitted to the plurality of feedback devices 1600 .

Further, in another embodiment of the present invention, one feedback device 1600 is used for one multimedia content, but thermal feedback information for a plurality of feedback devices may be indicated in the thermal feedback data. In this case, the control unit 2300 may generate the thermal feedback control data in various ways based on the thermal feedback data. For example, the control unit 2300 may generate thermal feedback control data based on thermal feedback information of one feedback device 1600 among the thermal feedback information of a plurality of feedback devices 1600 included in the thermal feedback data. In addition, thermal feedback control data may be generated by combining the thermal feedback information of the plurality of feedback devices 1600 .

The control unit 2300 may provide the generated thermal feedback control data to the feedback device 1600 .

Also, in another embodiment of the present invention, a plurality of feedback devices 1600 are used for one multimedia content, but only thermal feedback information for one feedback device may be indicated in the thermal feedback data.

In this case, the control unit 2300 may generate thermal feedback control data for the plurality of feedback devices 1600 in various ways based on the thermal feedback data. For example, the control unit 2300 may generate a plurality of identical thermal feedback control data based on thermal feedback information of the feedback device 1600 included in the thermal feedback data, and convert the generated plurality of thermal feedback control data into a plurality of thermal feedback devices. It may be provided to the feedback device 1600 .

As another example, the control unit 2300 may generate a plurality of thermal feedback control data according to a preset rule based on the thermal feedback information of one feedback device 1600 . In this case, the feedback information fields included in the plurality of thermal feedback control data may indicate different thermal feedbacks. The control unit 2300 may provide each of a plurality of different generated thermal feedback control data to the plurality of feedback devices 1600 .

4. Method of providing thermal experience based on thermal feedback control system (2000)

Hereinafter, a method for providing a thermal experience based on the thermal feedback control system 2000 according to an embodiment of the present invention will be described. In the following description, a method for providing a thermal experience according to an embodiment of the present invention will be described with reference to the operations of the thermal experience providing system 1000 and the thermal feedback control system 2000 described above. However, since this is only for convenience of description, the method for providing a thermal experience based on the thermal feedback control system 2000 according to an embodiment of the present invention is not limited thereto.

4.1. Overview of how to provide a thermal experience

41 is a basic flowchart of a method for providing a thermal experience according to an embodiment of the present invention.

Referring to FIG. 41 , in the method for providing a thermal experience according to an embodiment of the present invention, the thermal feedback data output unit 2100 acquires thermal feedback data according to the reproduction of multimedia content ( S4110 ), and the control unit 2300 . Obtaining the thermal feedback data (S4120), the control unit 2300 converting the thermal feedback data into thermal feedback control data (S4130), the thermal output unit 2200 acquiring the thermal feedback control data ( S4140 ) and the thermal output unit 2200 providing thermal feedback according to the thermal feedback control data ( S4150 ). In the above, the above-described steps will be described.

First, the thermal feedback data output unit 2100 may acquire thermal feedback data according to reproduction of multimedia content (S4110). In an embodiment, the content playback device 1200 may play multimedia content. The multimedia content may be a video, a game, a virtual reality application, an augmented reality application, a tangible application, and the like. The controller 1260 of the content reproducing device 1200 may load the multimedia content stored in the memory 1240 from the memory 1240 or receive the multimedia content through the communication module 1220 and reproduce it.

For example, the controller 1260 of the content reproducing device 1200 may reproduce multimedia content such as a game or a movie file stored in the memory 1240 . For another example, the content playback device 1200 may receive and play multimedia content from the Internet through the communication module 1220 according to a downloading or streaming method.

As the multimedia content is reproduced, the thermal feedback data output unit 2100 may acquire thermal feedback information. The multimedia content may include thermal feedback data or an algorithm for processing thermal feedback. The controller 1260 of the content reproduction device 1200 may decode the thermal feedback data or perform a thermal feedback processing algorithm according to the reproduction of the multimedia content, and may obtain the thermal feedback data as a result. Also, the thermal feedback data output unit 2100 may obtain the thermal feedback data from the controller 1260 . For example, the thermal feedback data output unit 2100 may be included in the controller 1260 or may be included in a device physically different from the controller 1260 .

Also, the control unit 2300 obtains the thermal feedback data (S4120), the control unit 2300 converts the thermal feedback data into thermal feedback control data (S4130), and the heat output unit 2200 generates the thermal feedback data (S4130). Feedback control data may be obtained (S4140). For steps S4120 to S4140, since the contents described with reference to FIGS. 27 to 35 may be applied as they are, a detailed description thereof will be omitted.

Also, the thermal output unit 2200 may provide thermal feedback according to the thermal feedback control data ( S4150 ).

The thermal output unit 2200 may generate a thermal feedback signal based on the thermal feedback control data and provide the thermal feedback signal to the feedback controller 1648 . In this case, the heat output unit 2220 may be implemented in a form included in the feedback controller 1648 or may be implemented as a device physically separated from the feedback controller 1648 . The feedback controller 1648 may perform a thermal feedback output operation according to the thermal feedback signal.

Here, the thermal feedback signal is a signal for controlling the output of the thermal feedback.

In an embodiment of the present invention, the thermal feedback signal may include a thermal feedback start signal indicating the start of the thermal feedback output and a thermal feedback end signal indicating the end of the thermal feedback output.

In a specific embodiment, the thermal output unit 2200 may provide a thermal feedback start signal according to the thermal feedback control data, and the feedback controller 1648 may obtain the start signal. When a start signal is obtained for the feedback controller 1648, the feedback controller 1648 applies power to the thermocouple array 1643 according to the start signal so that the thermocouple array 1643 performs a thermal feedback output operation. .

In addition, when the thermal output unit 2200 provides a thermal feedback termination signal according to the thermal feedback control data, the feedback controller 1648 obtains the termination signal, and the feedback controller 1648 controls the thermocouple according to the termination signal. Powering off the array 1643 may cause the thermocouple array 1643 to stop the thermal feedback output operation.

Here, the end signal is not essential. For example, the thermal output unit 2200 may include feedback execution time information in the start signal according to the thermal feedback control data, and the feedback controller 1648 determines the output time of the thermal feedback according to the feedback execution time information. It is determined that the output of the thermal feedback may be maintained for the output time and then the output of the thermal feedback may be terminated, so a termination signal may not be required. For another example, if the output time of the thermal feedback in the feedback device 1600 is set as a default, the feedback controller 1648 may maintain the output of the thermal feedback for a preset time and then end the output of the thermal feedback. Again, a termination signal may not be needed.

On the other hand, the feedback controller 1648 of the feedback device 1600 provides a thermal feedback reporting signal for reporting the operating state of the thermal output module 1640 to the thermal output unit 2200, and the thermal output unit 2200 provides a thermal feedback A report signal may be provided to the control unit 2300 . For example, the feedback device 1600 may provide the report signal periodically or in response to obtaining a thermal feedback signal. The thermal feedback report signal may include information such as whether thermal feedback is output, the type or strength of thermal feedback being output, the temperature of the contact surface 1641, user's bio-information sensed by the sensing module, whether an error has occurred, and the amount of battery will be. The control unit 2300 may consider information included in the report signal in converting the thermal feedback data into thermal feedback control data based on the report signal. For example, when the report signal includes information that the cooling feedback cannot be output from the thermal output module 1649, the control unit 2300 controls the cooling feedback among information on the type of thermal feedback included in the thermal feedback data. may not be reflected in the thermal feedback control data.

In addition, the thermal feedback output operation of the feedback device 1600 according to the thermal feedback signal may be performed in various ways.

First, the initiation and termination of the thermal feedback output operation of the feedback device 1600 may be performed as follows. As an example, the feedback device 1600 may perform a thermal feedback output operation only while the thermal feedback signal is received, and may stop the thermal feedback output operation if not received. As another example, when the start signal is received, the feedback device 1600 may output the thermal feedback for a default time period or for the thermal feedback provision time included in the start signal, and then stop the output. As another example, the feedback device 1600 may output thermal feedback for a time from the reception time of the start signal to the reception time of the end signal and then stop the output.

In addition, the thermal feedback signal may be provided as a simple on/off signal, or may be provided in a form including thermal feedback information according to the thermal feedback control data. When receiving the thermal feedback signal, the feedback controller 1648 may extract information included therein to control the thermal feedback output operation. For example, the feedback controller 1648 determines which thermal output module 1640 will perform the thermal feedback output operation based on the output region information of the thermal feedback (information included in the output region field of the thermal feedback control data). can judge As another example, the feedback controller 1648 may determine whether to perform a heating operation, an endothermic operation, and a thermal grill operation based on the thermal feedback type information (information included in the type field of the thermal feedback control data). As another example, the feedback controller 1648 may determine the voltage value of the power to be applied to the thermocouple array 1643 based on the thermal feedback intensity information (information included in the level field of the thermal feedback control data). have. As another example, the feedback controller 1648 may determine the start time and end time of the thermal feedback output based on the thermal feedback provision time information (information included in the time field of the thermal feedback control data). Of course, at least one of the type/strength/providing time of the above-described thermal feedback may be set as a default in the feedback device 1600 .

4.2. Applications of Methods of Providing Thermal Experience

Traditionally, content, including games and movies, has been experienced according to audiovisual expression methods provided by video or audio. In addition, in order to improve immersion in content, tactile experiences represented by vibration feedback or olfactory experiences using smells are subsidizing the existing audiovisual forms of expression. In addition, recently, solutions that can experience omnidirectional user experiences such as virtual reality or augmented reality are being developed.

The thermal experience providing system 1000 implements Thermal Reality (TR) to provide various contents by outputting thermal feedback in conjunction with various situations provided by the above-described conventional methods in allowing the user to experience the contents. user experience can be further enhanced.

In this regard, using the method for providing a thermal experience described above, the system 1000 for providing a thermal experience provides the user with a thermal feedback by allowing the feedback device 1600 to output the thermal feedback through the thermal feedback signal according to the reproduction of the multimedia content. It can provide a thermal experience.

Accordingly, the method for providing a thermal experience can be applied to various technical fields requiring user experience. Hereinafter, some representative technical fields in which the thermal feedback control system 2000 can be utilized will be briefly described.

4.2.1. virtual reality

Virtual reality is a representative example of a field in which the thermal feedback control system 2000 may be utilized.

Virtual reality refers to creating a virtual environment or situation so that a user can feel as if he or she is actually in a virtual space. In general, virtual reality is implemented based on a 3D image that dynamically changes according to a user's gaze using an HMD. Virtual reality is being actively developed for various games and movies, as well as educational or work assistance purposes.

In particular, with the recent development of smart devices, after the release of Samsung Electronics' Gear VR TM, VR devices are released one after another, and the virtual reality market is expected to grow in the future. In addition, as VR devices of various manufacturers and product groups are released, compatibility between virtual reality applications and various types of feedback devices included in the various VR devices may be problematic.

The thermal feedback control system 200 of the present invention is applied to such a virtual reality application and solves the compatibility problem, thereby adding a thermal sense to the existing visual/auditory/tactile sense.

For example, the thermal feedback control system 2000 applies a temperature to a specific object disposed in a virtual space, and when an avatar, an alter ego of the user, touches the object in virtual reality, thermal feedback data for thermal feedback , convert the thermal feedback data into thermal feedback control data understandable in the feedback device 1600 , and provide the thermal feedback control data to the feedback device 1600 , thereby realizing a thermal reality. In this case, the thermal feedback control system 2000 may provide the thermal feedback control data to the feedback device 1600 in real time immediately upon obtaining the thermal feedback data.

4.2.2. augmented reality

The thermal feedback control system 2000 may be utilized in the augmented reality field.

Augmented reality is also called mixed reality because it provides a virtual object overlaid on the real world and combines the virtual environment with the real environment.

Compared to virtual reality that immerses the user into a complete virtual space, augmented reality basically augments virtual objects or additional virtual information in the real world, so even if an HMD is used, the reality is projected as it is instead of completely blocking the user's view. It is implemented by augmenting a virtual image on a glass-type transparent display or synthesizing a virtual image in real time with an actual image captured by using the camera 1480 .

Therefore, unlike the virtual reality technology, the augmented reality technology has an advantage in that the user provides a real environment and a virtual environment at the same time, so that the user can interact with information in the real environment with a better sense of reality.

Various smart devices, including Apple's iPhone TM, are equipped with augmented reality functions, although limited. There is growing interest in As such, as the number of devices equipped with the augmented reality function increases, compatibility between the augmented reality application and various types of feedback devices for outputting thermal feedback in relation to the devices equipped with the various augmented reality functions may be problematic. .

The thermal feedback control system 2000 may assist the existing visual/auditory user experience by providing a thermal sensation that is linked to the augmented reality application. For example, the thermal feedback control system 2000 obtains thermal feedback data for the thermal feedback as one of the augmentation elements when a hot object enters into the user's field of view, and converts the thermal feedback data into a thermal feedback device 1600 understandable. By converting the feedback control data into feedback control data and providing the thermal feedback control data to the feedback device 1600 , useful information may be provided to the user. In this case, the thermal feedback control system 2000 may provide the thermal feedback control data to the feedback device 1600 in real time immediately upon obtaining the thermal feedback data.

4.2.3. game content

The thermal feedback control system 2000 may be utilized for game content.

Game content is basically multimedia content based on interactions between game elements and users, and because it has interactive elements, user experience is a very important field.

Implementation of game content may be accomplished through the above-described virtual reality or augmented reality technique as well as the traditional technique of reflecting a user's manipulation on a game screen output through an existing TV or monitor. The thermal experience providing system 1000 may add a thermal experience to the game environment implemented through the above-mentioned techniques as part of improving game immersion. For example, when the thermal experience providing system 1000 is hit by a gun or the like in a game of the first-person shooter genre, it may output thermal feedback according to the hit.

In addition, game content may be implemented using gaming controllers of various manufacturers and product groups, and a heat output module 1640 for providing the thermal feedback to the gaming controller may be included. Since the heat output module 1640 may be controlled by the gaming controller in which the heat output module 1640 is mounted, compatibility between the thermal feedback data corresponding to the game content and the various gaming controllers may be a problem. In this case, the thermal feedback control system 2000 obtains thermal feedback data for thermal feedback corresponding to the game content, converts the thermal feedback data into thermal feedback control data understandable by the thermal output module 1640 , and thermal feedback By providing control data to the thermal output module 1640 , thermal feedback can be provided regardless of the type of gaming controller. In this case, the thermal feedback control system 2000 may provide the thermal feedback control data to the gaming device in real time immediately upon obtaining the thermal feedback data.

4.2.4. video content

In addition, the thermal feedback control system 2000 may also be used for video content. Video content is based on an audiovisual expression form such as video or audio, and the thermal experience providing system 1000 may add thermal experience to multimedia content by outputting thermal feedback corresponding to audiovisually expressed video scenes. . For example, the thermal experience providing system 1000 may output thermal feedback such as outputting a thermal feedback in an explosion scene and outputting a cooling feedback in a scene in which water is turned over.

However, feedback devices related to video content may be of various types, and a command system of each feedback device and a data format understandable by each feedback device may be different from each other. Therefore, similar to the previous examples, compatibility between video content and various feedback devices may be a problem. To this end, the thermal feedback control system 2000 obtains thermal feedback data for thermal feedback related to video content, converts the thermal feedback data into thermal feedback control data understandable by the feedback device 1600 , and thermal feedback control data By providing to the feedback device 1600, it is possible to implement a thermal reality. In this case, the thermal feedback control system 2000 may provide the thermal feedback control data to the feedback device 1600 in real time as soon as it acquires the thermal feedback data, and one thermal feedback including the entire thermal feedback information of the video content. Only control data may be provided to the feedback device 1600 .

Although various application fields of the thermal feedback control system 2000 have been described above, the application fields of the thermal feedback control system 2000 are not limited to the above-described examples. In addition to the technical fields described above, the thermal feedback control system 2000 can be used for various multimedia contents including educational or learning contents or medical applications.

Therefore, in the present invention, the thermal feedback control system 2000 should be interpreted as applicable without limitation to a field capable of providing thermal feedback to improve user experience.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible for those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (23)

Thermal feedback to a feedback device that outputs thermal feedback by transferring heat generated by a thermoelectric operation including at least one of a heating operation and an endothermic operation of the thermoelectric element to which power is applied to the user through a contact surface in contact with the user's body part A method of controlling a control unit that provides control data, the method comprising:
When a thermal event causing the thermal feedback occurs in an application that provides a thermal experience through thermal feedback, information on at least one of the type, intensity, and output region of the thermal feedback induced by the thermal event is included obtaining thermal feedback data;
obtaining the thermal feedback control data configured in a format understandable to the feedback device based on the thermal feedback data; and
providing the thermal feedback control data to the feedback device so that the feedback device outputs the thermal feedback according to information on at least one of a type, intensity, and output region of the thermal feedback included in the thermal feedback data;
including,
The thermal feedback control data is
including level information indicating the level of power applied to the thermoelectric element and type information indicating at least one of a heating operation and a heat absorbing operation of the thermoelectric element,
Obtaining the thermal feedback control data comprises:
determining the level information based on the strength of the thermal feedback; and
determining the type information based on the type of the thermal feedback;
containing,
The control method of the control unit.
According to claim 1,
The data format of the thermal feedback data is not a format understandable by the feedback device,
The control method of the control unit.
According to claim 1,
The step of obtaining the thermal feedback data comprises:
obtaining information for understanding the thermal feedback data; and
The thermal feedback data is interpreted based on information for understanding the thermal feedback data, and from the thermal feedback data, at least one of a type, an intensity, and an output region of the thermal feedback induced by the thermal event included in the thermal feedback. Steps to extract information about one
containing,
The control method of the control unit.
According to claim 1,
Obtaining the thermal feedback control data comprises:
obtaining information about a format understandable from the feedback device; and
converting the thermal feedback data into the thermal feedback control data based on information about a format understandable by the feedback device;
containing,
The control method of the control unit.
According to claim 1,
the thermal feedback control data is configured in a first packet structure according to a format understandable by the feedback device;
The first packet structure is
including a level field indicating the level information and a type field indicating the type information,
The control method of the control unit.
6. The method of claim 5,
The first packet structure is
an output area field indicating a thermal element performing the thermoelectric operation;
Obtaining the thermal feedback control data comprises:
determining the output area field based on the output area of the thermal feedback;
The control method of the control unit.
6. The method of claim 5,
Obtaining the thermal feedback control data comprises:
When the type of the thermal feedback is warm feedback indicating a heating operation during the thermoelectric operation, the field value of the level field is determined as a first category, and the field value of the level field is determined based on the intensity of the thermal feedback. Determined by any one of the field values of the first category,
When the type of the thermal feedback is a cooling feedback indicating an endothermic operation during the thermoelectric operation, a field value of the level field is determined as a second category distinguished from the first category, and the field value is determined based on the intensity of the thermal feedback. characterized in that the field value of the level field is determined as a field value of any one of the second categories,
The control method of the control unit.
6. The method of claim 5,
The first packet structure is
A device ID field indicating the feedback device among a plurality of feedback devices
including,
Obtaining the thermal feedback control data comprises:
obtaining identification information about a feedback device that outputs the thermal feedback from the thermal feedback data;
Characterized in determining the device ID field based on the identification information for the feedback device,
The control method of the control unit.
7. The method of claim 6
The thermoelectric element includes a first thermoelectric element and a second thermoelectric element, and different powers are applied to the first thermoelectric element and the second thermoelectric element, whereby a thermoelectric operation of the first thermoelectric element and the second thermoelectric element are applied. If the thermoelectric behavior of the
The output area field is
a first output region field indicating the first thermoelectric element and a second output region field indicating the second thermoelectric element;
The level field is
and a first intensity field indicating the intensity of the first thermal feedback output from the first thermoelectric element and a second intensity field indicating the intensity of the second thermal feedback output from the second thermoelectric element. ,
The control method of the control unit.
10. The method of claim 9,
The thermal feedback data is
Heat transfer operation information indicating information on a heat transfer operation for transferring heat from the first thermoelectric element to the second thermoelectric element - The heat transfer operation information includes information about the type of the heat transfer operation and information about the heat transfer operation. comprising at least one of information about the direction;
The first packet structure is
and a heat transfer action field indicating the heat transfer operation,
Obtaining the thermal feedback control data comprises:
Characterized in determining the heat movement operation field based on the heat movement operation information,
The control method of the control unit.
10. The method of claim 9,
The thermal feedback data is
Heat transfer operation information indicating information on a heat transfer operation for transferring heat from the first thermoelectric element to the second thermoelectric element - The heat transfer operation information includes information about the type of the heat transfer operation and information about the heat transfer operation. comprising at least one of information about the direction;
In the first packet structure, when a column movement operation field indicating the column movement operation is not included,
Obtaining the thermal feedback control data comprises:
determining the first output area field and the second output area field, the first intensity field and the second intensity field based on the heat movement motion information,
The control method of the control unit.
6. The method of claim 5,
The thermal feedback data is
information on the provision time of the thermal feedback, wherein the information on the provision time includes at least one of an output start time of the thermal feedback, an output end time of the thermal feedback, and an output execution time of the thermal feedback; and ,
The first packet structure is
and a time field indicating a provision time of the thermal feedback;
Obtaining the thermal feedback control data comprises:
characterized in that the time field is determined based on at least one of the output start time, the output end time, and the output execution time,
The control method of the control unit.
6. The method of claim 5,
When information that cannot be indicated in the thermal feedback control data is included in the thermal feedback data,
Obtaining the thermal feedback control data comprises:
characterized in that the thermal feedback control data is generated without considering information that cannot be indicated in the first packet structure,
The control method of the control unit.
6. The method of claim 5,
When information that cannot be indicated in the thermal feedback control data is included in the thermal feedback data,
Obtaining the thermal feedback control data comprises:
converting information that cannot be indicated in the thermal feedback control data into information that can be indicated in the thermal feedback control data according to a predetermined rule;
Characterized in generating the thermal feedback control data based on the converted information,
The control method of the control unit.
According to claim 1,
When the data format of the thermal feedback data is a format understandable by the feedback device,
Obtaining the thermal feedback control data comprises:
characterized in that the thermal feedback data is determined as the thermal feedback control data,
The control method of the control unit.
According to claim 1,
When the thermal event is linked to a specific thermal event among game contents,
The step of obtaining the thermal feedback data comprises:
Characterized in that the thermal feedback data is acquired in real time whenever the specific thermal event occurs in the game content,
The control method of the control unit.
According to claim 1,
When the thermal event is linked to a plurality of scenes among video contents,
The step of obtaining the thermal feedback data comprises:
Before being reproduced in the plurality of scenes, the thermal feedback data, wherein the thermal feedback data includes information about the total thermal feedback caused by the total thermal event interlocking with the plurality of scenes - characterized in that ,
The control method of the control unit.
According to claim 1,
The control unit is
Characterized in that it is a controller of a content playback device that executes the application,
The control method of the control unit.
According to claim 1,
The control unit is
characterized in that it is a feedback controller of the feedback device for applying power to the thermoelectric element,
The control method of the control unit.
A computer-readable recording medium in which a program for performing the method of any one of claims 1 to 19 is recorded.
When a thermal event causing the thermal feedback occurs in an application that provides a thermal experience through thermal feedback, information on at least one of the type, intensity, and output region of the thermal feedback induced by the thermal event is included a thermal feedback data output unit for providing thermal feedback data;
a heat output unit that provides the thermal feedback through a thermoelectric element using thermal feedback control data obtained based on the thermal feedback data; and
A thermal feedback control system comprising: a control unit for improving compatibility between the thermal feedback data output unit and the thermal output unit between the thermal feedback data output unit and the thermal output unit,
The control unit is
obtaining the thermal feedback data from the thermal feedback data output unit;
obtaining the thermal feedback control data configured in a format understandable by the thermal output unit based on the thermal feedback data;
providing the thermal feedback control data to the heat output unit so that the thermal feedback is provided from the heat output unit according to information on at least one of a type, intensity, and output region of the thermal feedback included in the thermal feedback data; ,
The thermal feedback control data is
including level information indicating the level of power applied to the thermoelectric element and type information indicating at least one of a heating operation and a heat absorbing operation of the thermoelectric element,
The control unit is
determining the level information based on the strength of the thermal feedback;
determining the type information based on the type of the thermal feedback,
Thermal feedback control system.
A content playback device comprising:
memory for storing data;
a communication module for communicating with an external device; and
A controller for acquiring and playing multimedia content from the memory; including,
The controller is
When there is a thermal event causing thermal feedback in the multimedia content, obtaining thermal feedback data including information on at least one of a type, intensity, and output region of thermal feedback induced by the thermal event,
obtaining the thermal feedback control data configured in a format understandable in a feedback device based on the thermal feedback data;
providing the thermal feedback control data to the feedback device so that the feedback device outputs the thermal feedback according to information on at least one of a type, intensity, and output region of the thermal feedback included in the thermal feedback data;
The thermal feedback control data is
including level information indicating the magnitude of power applied to the thermoelectric element and type information indicating at least one of a heating operation and an endothermic operation of the thermoelectric element,
The controller is
determining the level information based on the strength of the thermal feedback;
determining the type information based on the type of the thermal feedback,
content playback device.
A feedback device comprising:
A thermoelectric element that performs a thermoelectric operation including at least one of a heating operation and a heat absorbing operation, a power terminal for supplying power for the thermoelectric operation to the thermoelectric element, and a power terminal provided on one side of the thermoelectric element and in contact with a user's body part a heat output module including a contact surface to output thermal feedback by transferring heat generated by the thermoelectric operation to the user through the contact surface; and
A feedback controller for controlling the heat output module,
The feedback controller is
When a thermal event causing the thermal feedback occurs in an application that provides a thermal experience through thermal feedback, information on at least one of the type, intensity, and output region of the thermal feedback induced by the thermal event is included obtain thermal feedback data;
obtaining the thermal feedback control data configured in a format understandable to the feedback device based on the thermal feedback data;
The thermal feedback control data is
including level information indicating the level of power applied to the thermoelectric element and type information indicating at least one of a heating operation and a heat absorbing operation of the thermoelectric element,
The feedback controller is
determining the level information based on the strength of the thermal feedback;
determining the type information based on the type of the thermal feedback,
feedback device.

Images