WO2024128765A1 - Dispositif de commande haptique pour délivrer et commander une température en conjugaison avec un contenu de réalité vierge, et son procédé de fonctionnement - Google Patents

Dispositif de commande haptique pour délivrer et commander une température en conjugaison avec un contenu de réalité vierge, et son procédé de fonctionnement Download PDF

Info

Publication number
WO2024128765A1
WO2024128765A1 PCT/KR2023/020452 KR2023020452W WO2024128765A1 WO 2024128765 A1 WO2024128765 A1 WO 2024128765A1 KR 2023020452 W KR2023020452 W KR 2023020452W WO 2024128765 A1 WO2024128765 A1 WO 2024128765A1
Authority
WO
WIPO (PCT)
Prior art keywords
temperature
user
haptic controller
virtual object
contact
Prior art date
Application number
PCT/KR2023/020452
Other languages
English (en)
Korean (ko)
Inventor
고기남
Original Assignee
플레이스비 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 플레이스비 주식회사 filed Critical 플레이스비 주식회사
Publication of WO2024128765A1 publication Critical patent/WO2024128765A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/389—Electromyography [EMG]
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25B—REFRIGERATION MACHINES, PLANTS OR SYSTEMS; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS
    • F25B21/00—Machines, plants or systems, using electric or magnetic effects
    • F25B21/02—Machines, plants or systems, using electric or magnetic effects using Peltier effect; using Nernst-Ettinghausen effect
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
    • G01K1/00—Details of thermometers not specially adapted for particular types of thermometer
    • G01K1/02—Means for indicating or recording specially adapted for thermometers
    • G01K1/024—Means for indicating or recording specially adapted for thermometers for remote indication
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
    • G01K13/00—Thermometers specially adapted for specific purposes
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
    • G01K7/00—Measuring temperature based on the use of electric or magnetic elements directly sensitive to heat ; Power supply therefor, e.g. using thermoelectric elements
    • G01K7/02—Measuring temperature based on the use of electric or magnetic elements directly sensitive to heat ; Power supply therefor, e.g. using thermoelectric elements using thermoelectric elements, e.g. thermocouples
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10N—ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10N10/00—Thermoelectric devices comprising a junction of dissimilar materials, i.e. devices exhibiting Seebeck or Peltier effects
    • H10N10/80—Constructional details

Definitions

  • the present invention relates to a haptic controller that outputs and controls temperature in connection with virtual reality content and a method of operating the same. More specifically, the present invention relates to a thermoelectric element to stimulate the user's sensory nerves related to temperature in content provided through virtual reality. It relates to a haptic controller that outputs hot or cold air through and a method of operating the same.
  • this technology simply delivers to the user the temperature according to the specific nature of the virtual object implemented in virtual reality, and there are still limitations in realistically enabling the user to experience different sensations depending on the user's movements.
  • the purpose of the present invention is to accurately convey to the user the surface temperature of a virtual object contacted through a user character in a virtual reality simulation through a haptic controller.
  • the purpose of the present invention is to realistically implement the sensation of experiencing the same temperature differently depending on the intensity with which the body of a user character in a virtual reality simulation contacts a virtual object through a haptic controller.
  • a communication unit that communicates with at least one external device; battery; A thermoelectric element that outputs a specified temperature; a heat conduction member configured to transmit cold or warm air to the outside of the haptic controller while in contact with the thermoelectric element; A temperature sensor in contact with the heat-conducting member; and determining the device control temperature based on data received from a connected external device, controlling the temperature of the thermoelectric element to correspond to the device control temperature, and measuring the temperature of the heat-conducting member through the temperature sensor, and measuring the temperature.
  • a haptic controller that outputs and controls temperature in connection with virtual reality content, including a processing unit that processes to correct the temperature of the thermoelectric element so that the temperature and the element control temperature are the same, can be provided.
  • the processing unit may obtain a difference value between the device control temperature and the measured temperature, and may correct the temperature of the thermoelectric element if the difference value is greater than or equal to a preset value.
  • the processing unit changes the device control temperature to a first stable temperature below the preset user's body temperature if the measured temperature exceeds the preset maximum temperature, and if the measured temperature is less than the preset minimum temperature, the device controls the temperature.
  • the control temperature can be changed to a second stable temperature that is higher than the user's body temperature.
  • the processing unit may obtain an EMG sensing value from at least one EMG sensor attached to at least a part of the user's body, and control the device control temperature based on the EMG sensing value.
  • the data received from the connected external device includes the surface temperature of a specific object with which the body of the user character corresponding to the haptic controller is in contact within the virtual reality provided through the external device, and the processing unit is configured to: Based on the surface temperature of a specific object, the temperature delivered to the body of the user character in contact with the specific object may be determined as the device control temperature.
  • the processing unit determines a first transfer temperature between the surface temperature of the specific object and the user's body temperature at the time the user character's body comes into contact with the specific object as the device control temperature, and the electromyography sensing value According to the increase, the first transfer temperature can be proportionally changed in the direction of the surface temperature of the specific object.
  • the processing unit corresponds the EMG sensing value and the first temperature at the point of contact, the maximum value of the EMG sensing value preset for the user and the surface temperature of the specific object, and generates the proportionally changed first temperature. 2
  • the value of the transfer temperature can be determined.
  • thermoelectric element control temperature based on data received from a connected external device and controlling the temperature of the thermoelectric element to correspond to the element control temperature; (b) measuring the temperature of a heat-conducting member configured to transmit cold or warm air to the outside of the haptic controller while in contact with the thermoelectric element through a temperature sensor in contact with the heat-conducting member; and (c) modifying the temperature of the thermoelectric element so that the measured temperature and the element control temperature are the same.
  • the haptic controller can accurately convey the surface temperature of the virtual object to the user by comparing the temperature of the thermoelectric element with the temperature delivered to the user through the heat transfer member and correcting the output temperature of the thermoelectric element.
  • the haptic controller controls the temperature of the thermoelectric element in the direction of the surface temperature of the virtual object as the sensing value of the electromyography sensor increases, thereby adjusting the intensity with which the body of the user character in the virtual reality simulation contacts the virtual object. Accordingly, the sensation of experiencing the same temperature differently can be realized realistically.
  • FIG. 1 is a diagram showing the configuration of a haptic controller according to an embodiment of the present invention.
  • FIGS. 2 and 3 are diagrams showing the approximate external configuration of a haptic controller according to an embodiment of the present invention.
  • Figure 4 is a diagram illustrating a state in which the hand of a user character corresponding to a haptic controller is in contact with a virtual object according to an embodiment of the present invention.
  • Figure 5 shows a flow of operations in which a haptic controller transmits the temperature of a virtual object to a user's hand according to an embodiment of the present invention.
  • first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, order, or order of the component is not limited by the term.
  • a component is described as being “connected,” “coupled,” or “connected” to another component, that component may be directly connected or connected to that other component, but there is no need for another component between each component. It should be understood that may be “connected,” “combined,” or “connected.”
  • 'Data' processed by electronic devices and/or haptic controllers can be expressed in terms of 'information'.
  • information may be used as a concept including data.
  • the present invention relates to a haptic controller that outputs and controls temperature in connection with virtual reality content.
  • a haptic controller that outputs hot or cold air through a thermoelectric element to stimulate the user's sensory nerves related to temperature. do.
  • FIG. 1 is a diagram showing the configuration of a haptic controller according to an embodiment of the present invention.
  • the haptic controller 100 may include a processing unit 110, a storage unit 120, a communication unit 130, and a temperature control unit 140.
  • the processing unit 110 of the haptic controller 100 can process the user's touch input through artificial intelligence (AI).
  • AI artificial intelligence
  • the processing unit 110 of the haptic controller 100 controls the functions of the haptic controller 100 and/or peripheral devices (e.g., lights, beam projectors, speakers, and/or devices) based on the user's touch input recognized through artificial intelligence.
  • peripheral devices e.g., lights, beam projectors, speakers, and/or devices
  • IoT Internet of Things
  • the processing unit 110 may process a touch input input to the touch screen panel and a control command based thereon through at least one program (app, application, tool, plug-in, etc., hereinafter referred to as a control command processing program).
  • the control command processing program may be stored in the storage unit 120 of the haptic controller 100 and/or the storage unit of an external device connected to the haptic controller 100.
  • the processing unit 110 may share data processing with at least one device (eg, user device) connected to the haptic controller 100 through a control command processing program.
  • at least one device eg, user device
  • the haptic controller 100 performing an event according to a control command may be understood as performing events designated through at least one control command processing-related program of the haptic controller 100.
  • control command processing is described as being provided through a control command processing program installed in the haptic controller 100, but is not limited to this and may be provided through another pre-installed program or a temporary installation program.
  • control command processing may be performed through at least a portion of a database provided free of charge or for a fee in a device external to the haptic controller 100.
  • the operation of the haptic controller 100 is performed based on the data processing and device control of the processing unit 110, and the processing unit 110 can perform designated functions based on control commands confirmed from touch input to the touch screen panel. there is.
  • processing unit 110 may process control commands based on touch input through the touch screen panel according to priorities specified based on the identified user.
  • the processing unit 110 can check multi-touch input through a touch screen panel.
  • the processing unit 110 may identify a user based on a touch input obtained through a touch screen panel and/or process the touch input according to setting information of the identified user.
  • the processing unit 110 may identify the user of the touch input input through the touch screen panel based on at least one artificial intelligence algorithm. At this time, the processing unit 110 may perform regression analysis using the learned algorithm for touch input processing stored in the storage unit 120.
  • the storage unit 120 may store various data processed by at least one component of the haptic controller 100 (e.g., the processing unit 110 or the communication unit 130).
  • the data is, for example, a control command processing It may include programs (or software), data, various categories created based on the data, and input data or output data related thereto.
  • the storage unit 120 is an artificial intelligence system that includes at least some of an artificial neural network algorithm, a blockchain algorithm, a deep learning algorithm, a regression analysis algorithm, and mechanisms, operators, language models, and big data related thereto for identifying and processing touch input. May include algorithms.
  • the storage unit 120 may include an algorithm for identifying a user based on a touch input input through a touch screen panel, and/or an algorithm for performing a specified operation in relation thereto.
  • the storage unit 120 may include at least one algorithm for processing a touch input through the touch screen panel, such as a touch pattern recognition algorithm and a touch user classification algorithm.
  • the storage unit 120 may include data for confirming and processing designated control and operations through signals received through each device included in the input/output unit.
  • the operations described through the storage unit 120 are processed by the processing unit 110, and data for processing related operations, data in process, processed data, preset data, etc. are stored in the storage unit 120 as a database. You can.
  • Data stored in the storage unit 120 may be changed, modified, deleted, and/or created by the processing unit 110 as new data based on an administrator input of the haptic controller 100 or a user input of the user device.
  • the storage unit 120 may store device setting information of the haptic controller 100.
  • the device setting information may be setting information for at least some of the functions of the haptic controller 100.
  • the storage unit 120 may store user information for at least one user. For each user information, at least some of user identification information (eg, identification, ID), password, and user customized setting information may be stored.
  • user identification information eg, identification, ID
  • password e.g., password
  • user customized setting information is setting information for at least some of the functions of the haptic controller 100, and can be set and stored according to user input.
  • the storage unit 120 may store virtual object information about a plurality of virtual objects.
  • the virtual object information may be information about a virtual object implemented through virtual reality simulation provided by a user device connected to the haptic controller 100.
  • the virtual object information stored in the storage unit 120 may include a plurality of virtual objects and information about the properties and surface temperature of each virtual object.
  • the properties of the virtual object may include at least some of the shape, material, and surface texture of the virtual object.
  • the virtual object information may include information about the temperature and/or surface temperature of the virtual object.
  • at least part of the virtual object information may be stored in the storage unit 120 in the form of a lookup table.
  • the virtual object information stored in the storage unit 120 is the same as or similar to the information of the virtual reality simulation in which the corresponding virtual objects are implemented, and may be received from a user device that provides the virtual reality simulation or a server related to the virtual reality simulation. .
  • the storage unit 120 may be configured to include volatile memory or non-volatile memory.
  • the communication unit 130 supports establishment of a wired communication channel between the haptic controller 100 and at least one other electronic device (e.g., a user device, or a server), establishment of a wireless communication channel, and performance of communication through the established communication channel. You can.
  • the communication unit 130 operates dependently or independently of the processing unit 110 and may include one or more communication processors that support wireless communication.
  • the communication unit 130 is a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN)) may include a communication module, or a power line communication module).
  • GNSS global navigation satellite system
  • LAN local area network
  • the communication unit 130 is a short-range communication network such as Bluetooth, BLE (Bluetooth Low Energy), WiFi, WiFi direct, IrDA (infrared data association), ZigBee, UWB, and RF (Radio Frequency) and/or a cellular network, the Internet, or a computer network. It can communicate with external electronic devices through a long-distance communication network (e.g. LAN or WAN).
  • a short-range communication network such as Bluetooth, BLE (Bluetooth Low Energy), WiFi, WiFi direct, IrDA (infrared data association), ZigBee, UWB, and RF (Radio Frequency) and/or a cellular network, the Internet, or a computer network. It can communicate with external electronic devices through a long-distance communication network (e.g. LAN or WAN).
  • a long-distance communication network e.g. LAN or WAN
  • Various types of communication modules constituting the communication unit 130 may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips).
  • the temperature controller 140 may provide temperature feedback according to the surface temperature of the virtual object.
  • the temperature control unit 140 may include a heating source and a cooling source to provide temperature feedback.
  • thermoelectric element may be configured to include at least a portion of a Peltier effect element or an element configured to output cool or warm air according to the flow of positive temperature coefficient (PTC) current.
  • PTC positive temperature coefficient
  • the temperature control unit 140 may further include a heat transfer member in contact with the thermoelectric element, and a temperature sensor in contact with the heat transfer member.
  • the temperature control unit 140 will be described in detail through FIGS. 2 and 3.
  • cold or warmth can be explained based on a person's body temperature.
  • the temperature is not limited to this, and the temperature that is the standard for cold or warm may be changed depending on the setting.
  • the haptic controller 100 may include a motion sensor unit that measures data related to the position, posture, and/or movement of the haptic controller.
  • the motion sensor unit includes at least one of a pressure sensor, a speed sensor, a gravity sensor, an infrared sensor, and an ultrasonic sensor, and can transmit the measured motion sensing value to a user device connected to the haptic controller 100.
  • the haptic controller 100 may be configured to further include an input/output unit.
  • the input unit of the input/output unit may include at least one button, and the output unit may further include a microphone for inputting audio.
  • the input/output unit may further include at least some of an input unit (not shown) that inputs data, such as a keyboard, mouse, and touch pad, and an output unit (not shown) that outputs data, such as a display unit (e.g., a display), a speaker, and a driver. .
  • an input unit that inputs data
  • an output unit that outputs data
  • a display unit e.g., a display
  • speaker e.g., a speaker
  • driver e.g., a driver
  • a microphone can convert external acoustic signals into electrical voice data.
  • the converted sound signal may have a PCM (pulse code modulation) state or a compressed audio waveform.
  • the microphone may include an A/D conversion unit that converts sound into digital.
  • the converted audio data can be used in various ways depending on the function being performed by the processing unit 110.
  • the display unit may be configured to include a touch screen panel in which a touch panel and a display panel are combined.
  • the touch screen panel can sense a touch input through a part of the user's body, such as a finger or palm, and/or a means for touch (eg, an electronic pen such as a stylus (pen)).
  • a means for touch eg, an electronic pen such as a stylus (pen)
  • the touch screen panel may be equipped with a multi-touch function that senses two or more touches at the same time.
  • the haptic controller 100 or the user device has at least some of the functions of all information and communication devices, including mobile communication terminals, multimedia terminals, wired terminals, fixed terminals, and internet protocol (IP) terminals. may include.
  • the haptic controller 100 is a device for processing control commands and may be configured to include at least some functions of a workstation or a large-capacity database or to be connected through communication.
  • User devices connected to the haptic controller 100 include mobile phones, personal computers (PCs), portable multimedia players (PMPs), mobile internet devices (MIDs), smartphones, tablet PCs, and tablets. Examples include bullet PCs and laptops.
  • the user device can be described as a device that processes control commands of the haptic controller 100.
  • the user device provides a virtual reality simulation to the user, and is connected to the haptic controller 100 as an input device to process control commands input through the haptic controller 100.
  • a server is an entity that exists on a network and performs the roles of a web server, database server, and application server. According to a preferred embodiment, the server may provide various contents to the haptic controller 100 and/or the user device based on processing of the haptic controller 100.
  • FIGS. 2 and 3 are diagrams showing the approximate external configuration of a haptic controller according to an embodiment of the present invention.
  • the haptic controller 100 provides virtual content provided to the user holding the haptic controller 100 through the user device, for example, at least some of the virtual reality space, objects, actions, and functions provided through virtual reality simulation. By interacting with a user character, it is possible to provide a three-dimensional sense of various movements, such as holding or pressing an object.
  • the haptic controller 100 is connected to the user device through the communication unit 130 and can operate as an input device for a virtual reality simulation provided through the user device.
  • the exterior of the haptic controller 100 may include a housing 201, a button portion, and a heat transfer member of the temperature control portion 140.
  • the haptic controller 100 is in a state in which at least a portion of the heat transfer member is exposed so that the heat transfer member is in contact with the user's palm while the user is holding the haptic controller 100. It can be composed of:
  • the haptic controller 100 has at least one button 211, 212, 213, 214, 215, and/or 217 to correspond to the positions of the user's fingers while holding the haptic controller 100. ) can be configured.
  • the heat transfer members 221 and 321 that transmit the hot or cold air generated from the thermoelectric element to the outside are located on the rear of the haptic controller 100. It can be configured.
  • the heat transfer member 221 is configured to include an externally exposed surface of the haptic controller 100, and is curved along the outer shape of the rear of the haptic controller 100 on which the heat transfer member 221 is disposed. can be formed.
  • the heat transfer member 321 may be formed with a fin, pillar, protrusion, and/or pipe-shaped protrusion having a pattern on one surface.
  • the protrusion of the heat transfer member 321 may be configured to be exposed to the outside through holes formed on the rear of the haptic controller 100.
  • One surface of the heat transfer member 221, 321 located inside the haptic controller 100 may be in contact with one surface of the thermoelectric element constituting the temperature control unit 140.
  • thermoelectric element and the heat-conducting member may be contacted through at least some of the joining members selected from a heat-conducting pad, a heat-conducting sheet, a heat-conducting film, and a heat-conducting grease.
  • the joint member may have an adhesive having adhesive properties applied to at least one surface.
  • the heat transfer members 221 and 321 can transfer cold or warm air generated from the thermoelectric element to the outside of the haptic controller 100.
  • the heat conductive member may transmit cold or warm air emitted by the thermoelectric element to the contact surface of the user's hand.
  • the temperature control unit 140 may further include at least one temperature sensor capable of measuring the temperature of the heat-conducting member.
  • the temperature sensor may be configured to measure the temperature of the heat-conducting member while in contact with one surface of the heat-conducting member inside the haptic controller 100.
  • Figure 4 is a diagram illustrating a state in which the hand of a user character corresponding to a haptic controller is in contact with a virtual object according to an embodiment of the present invention.
  • the haptic controller 100 may detect the position, posture, and/or movement of the user's hand. For example, the haptic controller 100 may transmit the motion sensing value obtained through the motion sensor unit to the user device that is interlocking with the haptic controller.
  • the user device may determine the position, posture, and/or movement of a user character's body part (e.g., hand) in the provided virtual reality simulation and apply the judgment result to the virtual reality simulation.
  • a user character's body part e.g., hand
  • the user character's movements may be determined based on the motion sensing value of the haptic controller 100.
  • the user device transmits information about the virtual object in contact with a part of the user character's body in the virtual reality simulation to the haptic controller 100, and the haptic controller 100 provides temperature feedback based on the information on the received virtual object. can be performed.
  • the haptic controller 100 acquires the surface temperature of the virtual object based on information about the virtual object received from the user device, and provides cold or warm air corresponding to the obtained temperature to the user. It can be delivered.
  • the haptic controller 100 may receive information about the virtual object and the point in time when a part of the user character's body (eg, a hand) contacts a virtual object in a virtual reality simulation from the user device.
  • a part of the user character's body eg, a hand
  • the haptic controller 100 may obtain the surface temperature of the virtual object based on the received information about the virtual object and control the thermoelectric element to output cold or warm air of the obtained temperature. Cold air or warmth output from the thermoelectric element may be transmitted to the user's body in contact with the heat transfer member through the heat transfer member.
  • the haptic controller 100 detects when ice 411 is placed on the user character's hand 401 in a virtual reality simulation from a user device, and You can receive information about ice.
  • the haptic controller 100 acquires the surface temperature of the virtual object based on the received information about the virtual object, and uses a thermoelectric element to output the obtained temperature through the thermoelectric element at the time the ice 411 is placed. You can control it.
  • the cold output from the thermoelectric element may be transmitted to the user's palm in contact with the heat transfer member 221 or 321 through the heat transfer member 221 or 321.
  • the haptic controller 100 transmits the temperature of the ice to the hand of the user holding the haptic controller 100 in response to the ice 411 placed on the hand 401 of the user character in the virtual reality simulation. You can.
  • the haptic controller 100 can transmit the surface temperature of not only ice but also various virtual objects in contact with a part of the user character's body in a virtual reality simulation to the user's hand in contact with the heat transfer member.
  • Figure 5 shows a flow of operations in which a haptic controller transmits the temperature of a virtual object to a user's hand according to an embodiment of the present invention.
  • the haptic controller 100 may determine an element control temperature based on data received from a connected external device and control the temperature of the thermoelectric element to correspond to the element control temperature.
  • the external device may be a user device (eg, a PC) that provides a virtual reality simulation to the user while connected to the haptic controller 100.
  • the user device may determine and implement the position, posture, and/or movement of a user character body part (eg, hand) based on the motion sensing value received from the haptic controller 100.
  • the haptic controller 100 can transmit the motion sensing value measured through the motion sensor unit to the user device.
  • the user device can implement the movement of the user character in virtual reality based on the motion sensing value received from the haptic controller 100.
  • the user device may confirm that a part of the user character's body (eg, a hand) is in contact with a virtual object implemented in the virtual reality simulation according to the user character's movement based on the motion sensing value.
  • a part of the user character's body eg, a hand
  • the user device may transmit the point in time when a part of the user character's body contacts the virtual object and the virtual object information to the haptic controller 100. At this time, the user device may transmit virtual object information including the surface temperature of the virtual object with which the user character is in contact to the haptic controller 100.
  • the haptic controller 100 may obtain the surface temperature of the virtual object based on the received virtual object information.
  • the haptic controller 100 may control the temperature of the thermoelectric element based on the surface temperature of the acquired virtual object.
  • the haptic controller 100 may determine the surface temperature of the virtual object as the device control temperature.
  • the haptic controller 100 may determine the first transfer temperature that moves by the initial correction ratio of the surface temperature in the direction of the user's body temperature from the surface temperature of the virtual object as the device control temperature.
  • the haptic controller 100 may determine the device control temperature based on the initial correction ratio stored in the setting information. For example, when the initial correction rate is set to 1% and the surface temperature of the virtual object is 30 degrees Celsius, the haptic controller 100 changes the direction of the user's body temperature by 0.3 degrees Celsius, which is 1% of 30 degrees Celsius. 30.3 degrees Celsius can be determined as the first delivery temperature for delivery to the user.
  • the haptic controller 100 changes 0.4 degrees, which is 1% of 40 degrees Celsius, toward the user's body temperature, making 39.6 degrees Celsius the user's body temperature. It can be determined as the first transfer temperature for delivery to.
  • the haptic controller 100 may determine the surface temperature or the first transfer temperature of the virtual object as the device control temperature and control the temperature of the thermoelectric element to correspond to the device control temperature.
  • the initial correction rate is assumed to be 1%, but may change depending on user input.
  • the user's body temperature can be assumed to be 36.5 degrees Celsius, which is the normal human body temperature.
  • the user's body temperature may change according to user input or measurement of the user's body temperature.
  • the haptic controller 100 determines the temperature of a heat-conducting member configured to transmit cold or warm air to the outside of the haptic controller 100 while in contact with the thermoelectric element using a temperature sensor in contact with the heat-conducting member. It can be measured through .
  • the haptic controller 100 controls the temperature of the thermoelectric element through step 501(a), it can measure the temperature of the heat transfer member through step 503(b).
  • the haptic controller 100 may correct the temperature of the thermoelectric element so that the measured temperature and the element control temperature are the same.
  • the haptic controller 100 may obtain the difference between the measured temperature of the heat transfer member and the element control temperature, and if the difference is greater than a preset value, the temperature of the thermoelectric element may be corrected.
  • the haptic controller 100 may compare the preset value and the difference value and control the temperature of the thermoelectric element when the difference value becomes more than the preset value.
  • step 505(c) the haptic controller 100 may perform step 503(b) or end the embodiment of FIG. 5 .
  • the haptic controller 100 may change the device control temperature to a first stable temperature below the user's body temperature.
  • the haptic controller 100 may control the temperature of the thermoelectric element so that the measured temperature of the heat transfer member is equal to the first stable temperature.
  • the haptic controller 100 may change the device control temperature to a second stable temperature higher than the user's body temperature.
  • the haptic controller 100 may control the temperature of the thermoelectric element so that the measured temperature of the heat transfer member is equal to the second stable temperature.
  • step 505(c) the haptic controller 100, when the measured temperature of the heat transfer member exceeds the preset maximum temperature or is below the preset maximum temperature, even if the difference value with the device control temperature is less than the preset value, the first The temperature of the thermoelectric element can be controlled by the stable temperature or the second stable temperature.
  • the haptic controller 100 can provide a temperature difference to the user's hand holding the haptic controller 100 according to a change in the part of the user character's body that is in contact with the virtual object.
  • the haptic controller 100 includes an electromyography sensor (or sensor module, hereinafter electromyographic sensor) worn on at least a part of the user's body, such as the back of the user's hand, wrist, arm, shoulder, etc., and a communication unit. It may be connected through (130).
  • electromyography sensor or sensor module, hereinafter electromyographic sensor
  • the haptic controller 100 may receive EMG sensing values from the EMG sensor in real time or at designated time intervals. The haptic controller 100 can control the device control temperature based on the acquired electromyography sensing value.
  • the haptic controller 100 may control the temperature of the thermoelectric element according to the first transfer temperature between the surface temperature of the virtual object and the user's body temperature. .
  • the haptic controller 100 may control the temperature of the thermoelectric element using the first transfer temperature as the element control temperature at the time when the body part of the user character received from the user device contacts the virtual object. Additionally, the haptic controller 100 may receive the first EMG sensing value from the EMG sensor at the time when a part of the user character's body contacts the virtual object.
  • the increase in the EMG sensing value can be explained by the contraction of the user's muscle where the EMG sensor is located and/or the user applying force to the muscle.
  • the increase in electromyography sensing value can be explained by the increase in pressure applied to the virtual object.
  • the haptic controller 100 proportionally transfers the first transfer temperature to the virtual object.
  • the surface temperature can be changed in the direction of .
  • the haptic controller 100 corresponds the first electromyography sensing value at the time when a part of the user character's body contacts the virtual object to the first transfer temperature, and sets the maximum value of the electromyographic sensing value preset for the user. can correspond to the surface temperature of the virtual object.
  • the first EMG sensing value is the first value
  • the maximum value of the EMG sensing value preset for the user is the fifth value
  • the surface temperature of the virtual object is determined to be 40 degrees
  • the first transfer temperature is determined to be 39.6 degrees Celsius. It can be.
  • the proportionally matched temperature of 39.8 degrees Celsius may be determined as the second transfer temperature.
  • the first EMG sensing value is the first value
  • the maximum value of the EMG sensing value preset for the user is the fifth value
  • the surface temperature of the virtual object is determined to be 30 degrees Celsius
  • the first transfer temperature is determined to be 30.4 degrees Celsius. You can.
  • the haptic controller 100 obtains the fourth value as the second EMG sensing value
  • the proportionally matched temperature of 30.1 degrees Celsius may be determined as the second transfer temperature.
  • the maximum value of the first EMG sensing value and the preset sensing value is described as a natural number (or integer) of the first value and the fifth value
  • the second EMG sensing value is described as a natural number (or integer).
  • the second transfer temperature corresponding to the second EMG sensing value is divided into the first transfer temperature and the second transfer temperature corresponding to the second EMG sensing value. It can be determined proportionally between the surface temperatures of virtual objects.
  • the haptic controller 100 may calculate the second transfer temperature as described above through at least one proportional equation determined based on at least a portion of the electromyography sensing value, the surface temperature of the virtual object, and the preset user's body temperature.
  • At least one proportional equation includes a first electromyography sensing value, a first transfer temperature, a maximum value of an electromyography sensing value preset for the user, a surface temperature of the virtual object, a preset body temperature of the user, and a second It may be set to calculate the second transfer temperature based on at least some of the electromyography sensing values.
  • At least one proportional equation for calculating the second transfer temperature may be stored in the storage unit 120 of the haptic controller 100.
  • the haptic controller 100 can control the temperature of the thermoelectric element using the second transfer temperature as the element control temperature.
  • the haptic controller 100 based on the electromyography sensing value at the time when the user character's body part touches the virtual object, when the electromyography sensing value increases while the user character's body part is in contact with the virtual object. , the first transfer temperature can be modified in the direction of the surface temperature of the virtual object.
  • the haptic controller 100 can implement the user's sense of feeling the surface temperature of the virtual object more strongly as the user's body contacts the object more strongly.
  • the user device may detect the contact between the user character and the virtual object or the proximity of the user character to the virtual object based on detection information received from the haptic controller 100.
  • temperature feedback performed by the haptic controller 100 may vary depending on the positional relationship, contact, or proximity between the user character and the virtual object performed through virtual reality simulation of the user device.
  • the user device may detect the position and posture of the user character's hand based on the motion sensing value received from the haptic controller 100 before determining temperature feedback.
  • the user device may detect a situation in which the user character's hand and the virtual object are close or the user character's hand and the virtual object are in contact, according to the motion sensing value of the haptic controller 100 in the virtual reality simulation.
  • the user device may transmit the detected situation information to the haptic controller 100.
  • the haptic controller 100 can check the detected virtual object information.
  • the haptic controller 100 may determine temperature level information based on the acquired virtual object information and context information received from the user device.
  • temperature level information may include initial temperature, final temperature, time to reach final temperature, and temperature variable range.
  • the haptic controller 100 may determine the initial temperature and final temperature of the temperature level information to be high, and determine the time to reach the final temperature and the temperature variable range according to the size of the fire. You can decide.
  • the haptic controller 100 may determine temperature level information by additionally considering the positional relationship between the virtual object and the user character based on the situation information. For example, when the haptic controller 100 receives situation information about a contact between a virtual object and the user character's hand from the user device, the haptic controller 100 may set the final temperature arrival time to be short and the initial temperature to be high. On the other hand, when the haptic controller 100 receives situation information from the user device that the virtual object and the user character's hand are in close proximity, the haptic controller 100 may set the final temperature arrival time to be long and the initial temperature to be low.
  • the haptic controller 100 may set the final temperature arrival time by additionally considering the material of the virtual object. That is, if the material has high thermal conductivity, the time to reach the final temperature can be set short, and if the material has low thermal conductivity, the time to reach the final temperature can be set long.
  • the haptic controller 100 may determine temperature level information by additionally considering user manipulation information.
  • the user manipulation information may include situational information about the area and part in contact with the virtual object, and the posture of the hand that manipulates the virtual object.
  • the haptic controller 100 detects electromyography and situation information about the area where the hand of the virtual object and the user character touches, the contact position, and/or the hand posture based on the detection information. You can check the value and set the initial temperature and final temperature arrival time based on the virtual object setting temperature, contact area, contact position, and/or situational information about the hand posture and electromyography sensing values.
  • the haptic controller 100 may set the initial temperature low and the time to reach the final temperature may be set to be long.
  • the haptic controller 100 may set the initial temperature high and the time to reach the final temperature short.
  • the hand posture of the user character included in the situation information can be determined in various ways, such as, for example, a grasping action, a putting action, a twisting action, a grasping action, or a lifting action, depending on the motion sensing value received from the haptic controller 100.
  • Temperature level information can be set precisely according to the posture of the hand.
  • the haptic controller 100 may determine temperature level information by additionally considering user temperature information.
  • the user temperature information may include the highest and lowest allowable temperature determined according to user feedback, the user's body temperature obtained according to biological signals, etc.
  • the haptic controller 100 controls the thermoelectric element by gradually increasing the predetermined temperature, thereby transferring warmth to the user through the heat conduction member and By receiving feedback, you can set your maximum allowable temperature.
  • the haptic controller 100 controls the thermoelectric element by gradually lowering the preset temperature to deliver cold air to the user through the heat conduction member, and can set the user's minimum allowable temperature by receiving feedback from the user.
  • the haptic controller 100 checks the highest and lowest allowable temperatures pre-stored according to user feedback, and provides the highest allowable temperature, the lowest allowable temperature, attribute information of the virtual object, and Temperature level information can be determined based on the location relationship between the virtual object and the user.
  • the haptic controller 100 may determine temperature level information by additionally considering content situation information.
  • the content situation information may include the set temperature of the virtual reality space where the user character is located.
  • the haptic controller 100 may receive context information of virtual reality content implemented in a virtual reality simulation provided by a user device.
  • the haptic controller 100 obtains the set temperature of the virtual reality space where the user character is located from the received situation information, and determines the initial temperature, final temperature arrival time, and temperature based on the surface temperature of the virtual object and the set temperature of the virtual reality space.
  • a variable range can be set. For example, if the user character is located in a cold outdoor space or a warm house, the haptic controller 100 can set temperature level information by reflecting the temperature of the space.
  • the haptic controller 100 may control the temperature of the thermoelectric element using the temperature determined based on temperature level information as the element control temperature.
  • the haptic controller 100 may perform at least part of the embodiment of FIG. 3 in controlling the temperature of the thermoelectric element based on temperature level information.
  • the haptic controller 100 may compare the virtual object set temperature, the highest allowable temperature, and the lowest allowable temperature.
  • the highest and lowest allowable temperatures may be preset values through user feedback and may be set differently for each user.
  • the haptic controller 100 may determine a temperature close to the virtual object set temperature among the highest and lowest allowable temperatures as the limit temperature. For example, if the virtual object is fire, the highest allowable temperature can be set as the limit temperature, and if the virtual object is ice, the lowest allowable temperature can be set as the limit temperature.
  • the haptic controller 100 may determine the temperature with the smaller temperature value among the virtual object set temperature and the limit temperature as the final temperature. For example, if the virtual object set temperature is 40 degrees Celsius and the limit temperature is 38 degrees Celsius, the haptic controller 100 may set 38 degrees Celsius as the final temperature.
  • the haptic controller 100 may determine the temperature with the larger temperature value among the virtual object set temperature and the limit temperature as the final temperature. For example, if the virtual object set temperature is 10 degrees Celsius and the limit temperature is 12 degrees Celsius, the haptic controller 100 may set 12 degrees Celsius as the final temperature.
  • the haptic controller can accurately convey the surface temperature of the virtual object to the user by comparing the temperature of the thermoelectric element with the temperature delivered to the user through the heat transfer member and correcting the output temperature of the thermoelectric element.
  • the haptic controller controls the temperature of the thermoelectric element in the direction of the surface temperature of the virtual object as the sensing value of the electromyography sensor increases, thereby adjusting the intensity with which the body of the user character in the virtual reality simulation contacts the virtual object. Accordingly, the sensation of experiencing the same temperature differently can be realized realistically.
  • the haptic controller 100 can deliver the surface temperature of a virtual object to the user more realistically in conjunction with a virtual reality simulation provided to the user through the user device.
  • the functions of various embodiments described as being performed by the haptic controller 100 are operations processed through the processing unit 110 of the haptic controller 100 and/or the haptic controller 100. It can be performed by being organically connected to the components of the device connected to (100).
  • the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Signal Processing (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Thermal Sciences (AREA)
  • Mechanical Engineering (AREA)
  • User Interface Of Digital Computer (AREA)
  • Dermatology (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)

Abstract

Selon divers modes de réalisation de la présente invention, sont divulgués un dispositif de commande haptique pour délivrer et commander une température conjointement avec un contenu de réalité virtuelle, et son procédé de fonctionnement, le dispositif de commande comprenant : une unité de communication communiquant avec au moins un dispositif externe ; une batterie ; un thermoélément pour délivrer en sortie une température désignée ; un élément thermoconducteur pour transférer de l'air froid ou chaud vers l'extérieur du dispositif de commande haptique dans un état de contact avec le thermoélément ; un capteur de température en contact avec l'élément thermoconducteur ; et une unité de traitement pour déterminer une température de commande d'élément sur la base de données reçues en provenance d'un dispositif externe connecté, commander la température du thermoélément de telle sorte que celle-ci correspond à la température de commande d'élément, mesurer la température de l'élément thermoconducteur à travers le capteur de température, et effectuer un traitement pour corriger la température du thermoélément de telle sorte que la température mesurée est la même que la température de commande d'élément.
PCT/KR2023/020452 2022-12-12 2023-12-12 Dispositif de commande haptique pour délivrer et commander une température en conjugaison avec un contenu de réalité vierge, et son procédé de fonctionnement WO2024128765A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020220173110A KR102547683B1 (ko) 2022-12-12 2022-12-12 가상현실 콘텐츠와 연계하여 온도를 출력 및 제어하는 햅틱 컨트롤러 및 그 동작 방법
KR10-2022-0173110 2022-12-12

Publications (1)

Publication Number Publication Date
WO2024128765A1 true WO2024128765A1 (fr) 2024-06-20

Family

ID=86947349

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2023/020452 WO2024128765A1 (fr) 2022-12-12 2023-12-12 Dispositif de commande haptique pour délivrer et commander une température en conjugaison avec un contenu de réalité vierge, et son procédé de fonctionnement

Country Status (2)

Country Link
KR (3) KR102547683B1 (fr)
WO (1) WO2024128765A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102547683B1 (ko) * 2022-12-12 2023-06-26 플레이스비 주식회사 가상현실 콘텐츠와 연계하여 온도를 출력 및 제어하는 햅틱 컨트롤러 및 그 동작 방법

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170169674A1 (en) * 2015-12-10 2017-06-15 Nxp B.V. Haptic feedback controller
KR20180048202A (ko) * 2016-10-31 2018-05-10 주식회사 테그웨이 피드백 디바이스, 콘텐츠 재생 디바이스, 열적 경험 제공 시스템 및 열적 경험 제공 방법
KR20200000803A (ko) * 2018-06-25 2020-01-03 임머숀 코퍼레이션 가상 현실 사용자를 위한 실세계 햅틱 상호작용
KR102355274B1 (ko) * 2020-11-20 2022-02-07 플레이스비 주식회사 햅틱 컨트롤러를 이용한 온도 피드백 제공 시스템 및 방법
KR20220030641A (ko) * 2020-09-03 2022-03-11 삼성전자주식회사 전자 장치 및 전자 장치의 동작 방법
KR102547683B1 (ko) * 2022-12-12 2023-06-26 플레이스비 주식회사 가상현실 콘텐츠와 연계하여 온도를 출력 및 제어하는 햅틱 컨트롤러 및 그 동작 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170169674A1 (en) * 2015-12-10 2017-06-15 Nxp B.V. Haptic feedback controller
KR20180048202A (ko) * 2016-10-31 2018-05-10 주식회사 테그웨이 피드백 디바이스, 콘텐츠 재생 디바이스, 열적 경험 제공 시스템 및 열적 경험 제공 방법
KR20200000803A (ko) * 2018-06-25 2020-01-03 임머숀 코퍼레이션 가상 현실 사용자를 위한 실세계 햅틱 상호작용
KR20220030641A (ko) * 2020-09-03 2022-03-11 삼성전자주식회사 전자 장치 및 전자 장치의 동작 방법
KR102355274B1 (ko) * 2020-11-20 2022-02-07 플레이스비 주식회사 햅틱 컨트롤러를 이용한 온도 피드백 제공 시스템 및 방법
KR102547683B1 (ko) * 2022-12-12 2023-06-26 플레이스비 주식회사 가상현실 콘텐츠와 연계하여 온도를 출력 및 제어하는 햅틱 컨트롤러 및 그 동작 방법

Also Published As

Publication number Publication date
KR102547683B1 (ko) 2023-06-26
KR102547702B1 (ko) 2023-06-26
KR102547695B1 (ko) 2023-06-26

Similar Documents

Publication Publication Date Title
WO2024128765A1 (fr) Dispositif de commande haptique pour délivrer et commander une température en conjugaison avec un contenu de réalité vierge, et son procédé de fonctionnement
WO2018066848A1 (fr) Dispositif de soin de la peau
WO2021029529A1 (fr) Dispositif de fourniture d'adaptation virtuelle et procédé de fourniture associé
WO2020045947A1 (fr) Dispositif électronique de commande de propriété d'écran sur la base de la distance entre un dispositif d'entrée de stylet et le dispositif électronique et son procédé de commande
WO2015156465A1 (fr) Appareil d'affichage en verre flexible et son procédé de commande
WO2016080630A1 (fr) Terminal d'utilisateur destiné à commander un dispositif d'affichage et son procédé de commande
WO2018129977A1 (fr) Procédé et appareil de commande de charge, support de stockage et dispositif informatique
WO2015023136A1 (fr) Procédé et appareil de reconnaissance d'état de préhension dans un dispositif électronique
WO2016182181A1 (fr) Dispositif portable et procédé permettant de fournir une rétroaction d'un dispositif portable
WO2020091505A1 (fr) Dispositif électronique et son procédé d'interaction intelligente
WO2017119745A1 (fr) Dispositif électronique et procédé de commande associé
WO2016204357A1 (fr) Terminal mobile et procédé de commande correspondant
WO2016195207A1 (fr) Terminal mobile
WO2016192438A1 (fr) Procédé d'activation de système d'interaction de détection de mouvement, et procédé et système d'interaction de détection de mouvement
WO2020076055A1 (fr) Dispositif électronique contenant un dispositif de saisie par crayon et procédé d'utilisation de celui-ci
WO2022097862A1 (fr) Procédé de commande d'affichage et dispositif électronique prenant en charge ledit procédé
WO2016204338A1 (fr) Dispositif électronique
WO2018143509A1 (fr) Robot mobile et son procédé de commande
WO2021080171A1 (fr) Procédé et dispositif permettant la détection d'un port à l'aide d'un capteur inertiel
WO2021101006A1 (fr) Dispositif électronique pour fournir un contenu sur la base de l'emplacement d'une image réfléchissante d'un objet externe, et procédé de fonctionnement de dispositif électronique
WO2021132743A1 (fr) Dispositif électronique permettant d'afficher un contenu portant sur une application et son procédé de commande
WO2022050611A1 (fr) Dispositif électronique et procédé de fonctionnement de dispositif électronique
WO2017057846A1 (fr) Capteur de détection de port et dispositif portable le comprenant
WO2021149844A1 (fr) Dispositif électronique pour afficher des contenus et son procédé de commande
WO2017176036A1 (fr) Procédé et système de partage de contenu basé sur les déplacements d'un utilisateur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23903967

Country of ref document: EP

Kind code of ref document: A1