WO2018233344A1 - Haptic feedback apparatus and method, readable storage medium and electronic product - Google Patents

Haptic feedback apparatus and method, readable storage medium and electronic product Download PDF

Info

Publication number
WO2018233344A1
WO2018233344A1 PCT/CN2018/081724 CN2018081724W WO2018233344A1 WO 2018233344 A1 WO2018233344 A1 WO 2018233344A1 CN 2018081724 W CN2018081724 W CN 2018081724W WO 2018233344 A1 WO2018233344 A1 WO 2018233344A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
virtual object
haptic feedback
control signal
signal generator
Prior art date
Application number
PCT/CN2018/081724
Other languages
French (fr)
Chinese (zh)
Inventor
权雯琪
闵航
舒勇
孙贺
王雪峰
Original Assignee
京东方科技集团股份有限公司
重庆京东方光电科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 重庆京东方光电科技有限公司 filed Critical 京东方科技集团股份有限公司
Publication of WO2018233344A1 publication Critical patent/WO2018233344A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Definitions

  • Embodiments of the present disclosure are directed to a haptic feedback device and method.
  • Virtual reality technology involves many aspects such as simulation environment, perception, natural skills, and sensing devices.
  • perception means that ideal virtual reality technology should have all the perceptions that people have. That is to say, in addition to the visual perception generated by computer graphics technology, virtual reality technology also has a perception of hearing, touch, motion, and even smell.
  • a user can touch a virtual object, and the user desires to obtain a similar feeling to the real object corresponding to touching the virtual object.
  • At least one embodiment of the present disclosure provides a haptic feedback device comprising: at least one connection structure, a wearable device, and at least one signal generator.
  • One end of the connection structure is connected to the wearable device, and the other end of the connection structure is connected to the signal generator.
  • the wearable device is configured to detect a target location.
  • the signal generator is configured to generate a sensing signal in accordance with the control signal and output the sensing signal.
  • the wearable device is further configured to: determine a virtual object at the target location; generate the control signal according to the virtual object; and transmit the control signal to the signal generator.
  • the haptic feedback device further includes a processing device; the processing device configured to: determine a virtual object at the target location; generate the control signal according to the virtual object; and send the control signal to the The signal generator.
  • connection structure includes a housing and a signal line located inside the housing; the signal line is configured to transmit the control signal from the wearable device to the signal generator.
  • the outer casing is a deformable material; and the deformable material comprises a metal.
  • the connecting structure is a deformable long rod.
  • the haptic feedback device includes a plurality of connection structures and a plurality of signal generators, the plurality of connection structures being connected in one-to-one correspondence with the plurality of signal generators; the plurality of connection structures are discretely disposed on the a wearable device; and the plurality of connection structures are unequal in length.
  • the wearable device includes a first wireless transceiver
  • the signal generator includes a second wireless transceiver
  • the wearable device and the signal release device pass the first wireless transceiver and the second The wireless transceiver communicates.
  • the wearable device includes a sensor configured to detect the target location.
  • the wearable device further includes: a memory configured to store location information of the plurality of virtual objects; and a processor configured to identify the virtual location at the target location according to location information of the plurality of virtual objects object.
  • the memory is further configured to store attribute information of the plurality of virtual objects; the processor is further configured to: acquire virtuality at the target location according to attribute information of the plurality of virtual objects Attribute information of the object; and generating the control signal according to attribute information of the virtual object at the target position.
  • the signal generator has a spherical shape or a funnel shape.
  • the signal generator includes one or more of an optical signal generator, an electrical signal generator, a wind signal generator, a vibrator, and a thermal signal generator.
  • At least one embodiment of the present disclosure also provides a haptic feedback method including: detecting a target position; determining a virtual object at the target position; generating a control signal according to the virtual object; and generating a sensing signal according to the control signal, And outputting the sensing signal.
  • the determining the virtual object at the target location comprises: acquiring location information of the stored plurality of virtual objects; and identifying the virtual object at the target location according to the location information of the plurality of virtual objects.
  • generating the control signal according to the virtual object includes: acquiring attribute information of the stored plurality of virtual objects; acquiring attributes of the virtual object at the target position according to attribute information of the plurality of virtual objects Information; and generating the control signal based on attribute information of the virtual object at the target location.
  • the generating the sensing signal according to the control signal comprises: generating one or more of an optical signal, an electrical signal, a wind signal, a vibration signal, a cold signal, and a thermal signal according to the control signal.
  • At least one embodiment of the present disclosure provides a computer readable storage medium having stored thereon computer instructions that, when executed by a processor, implement one or more steps of the haptic feedback method.
  • At least one embodiment of the present disclosure provides an electronic product comprising one or more processors configured to execute computer instructions to perform one or more steps of the haptic feedback method.
  • FIG. 1 is a schematic structural diagram of a haptic feedback device according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of a physical object of a tactile feedback device according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of an application scenario of a haptic feedback device according to an embodiment of the present disclosure
  • FIG. 4 is a flowchart of a haptic feedback method according to an embodiment of the present disclosure.
  • Virtual reality technology is a collection of various technologies such as simulation technology, computer graphics human-machine interface technology, multimedia technology, sensing technology and network technology.
  • the user can see and touch a virtual object.
  • the device commonly used in virtual reality technology is to simulate the tactile sensation by installing some vibrating contacts on the inner layer of the glove or by transmitting vibrations from the hand-held sensor handle.
  • the disadvantages of the above methods are also obvious.
  • the shock contacts in the handle and glove can only simulate the touch of a small part of the object, and the glove also isolates the hand from the air, so the comfort is not good.
  • an embodiment of the present disclosure provides a haptic feedback device 100 that can be used in virtual reality technology.
  • the haptic feedback device 100 includes at least one connection structure 160 (eg, 160a, 160b, 160c, etc. in FIG. 1), a wearable device 101, and at least one signal generator 180 (eg, 180a, 180b, 180c, etc. in FIG. 1). .
  • One end of the connection structure 160 is connected to the wearable device 101, and the other end of the connection structure 160 is connected to the signal generator 180.
  • the connection structure 160 characterized by the arrows in FIG. 1 is only used to illustrate that the wearable device 101 and the signal generator 180 can be connected through both ends of the connection structure 160, and for the structure of the connection structure 160, reference can be made to the following embodiments.
  • the wearable device 101 described above may be configured to perform an operation of: detecting a target position; determining a virtual object at the target position; generating a control signal according to the virtual object; and transmitting the control signal to the signal generator.
  • the signal generator 180 described above may be configured to generate a sensing signal in accordance with a control signal generated by the wearable device 101 and output a sensing signal. Further, the sensing signal will be perceived by the sender's hand by a perceived action (eg, a touch action).
  • a perceived action eg, a touch action
  • the above control signals can be transmitted in a wired manner.
  • the connecting structure 160 may include: a casing and a signal line located inside the casing.
  • the signal line is configured to transmit the control signal from the wearable device 101 to the signal generator 180.
  • the signal line is a bundle or a plurality of transmission lines composed of a plurality of cable lines, and the carrier of the signal line may be a metal or other carrier such as an optical cable or the like.
  • the outer casing is of a deformable bendable material.
  • the deformable bendable material may comprise a metal such as iron, copper or aluminum.
  • a signal line using a metal carrier constitutes a plurality of transmission lines, which may be distributed inside the metal casing.
  • connection structure 160 can be a deformable long rod.
  • the deformable long rod also adopts a material that can be deformed and bendable.
  • the deformable bendable material includes a metal such as iron, copper or aluminum.
  • an iron rod is used as the connection structure 160, one end of which is connected to the wearable device 101, and the other end is connected to a signal generator 180.
  • short-range wireless transmission technologies include Bluetooth, ultra-wideband, or wifi.
  • wearable device 101 can include a first wireless transceiver
  • signal generator 180 includes a second wireless transceiver
  • wearable device 101 and signal processor 180 can communicate via a first wireless transceiver and a second wireless transceiver.
  • haptic feedback device 100 can simultaneously transmit the generated control signals in one of a wired transmission or a wireless manner.
  • the corresponding connection structure 160 is realized by arranging signal lines inside the casing and the casing.
  • the wearable device 101 may include a first wireless transceiver, and the signal generator 180 includes a second wireless transceiver.
  • the generated control signals can be transmitted wirelessly.
  • the generated control signals may be transmitted in a wired manner, that is, using signal lines inside the connection structure 160.
  • haptic feedback device 100 includes a plurality of connection structures 160 and a plurality of signal generators 180, one-to-one correspondence between connection structure 160 and signal generator 180. That is, a connection structure 160 is coupled to a signal generator 180, wherein the plurality of signal generators 180 can belong to different categories, respectively generating and outputting different sensing signals.
  • connection structures 160 is discretely disposed on the wearable device 101.
  • the connection structure 160 is detachably coupled to the wristband.
  • each of the connection structures 160 may not be equal in some embodiments.
  • a shorter connection structure 160 is provided corresponding to the palm position, and a relatively longer connection structure 160 is provided for the fingertip portion.
  • the purpose of sensing the tactile signals by different portions of the hand may also be achieved by bending the respective connecting structures 160.
  • the lengths of the connecting structures 160 may be equal or similar.
  • a plurality of different types of multiple signal generators may be employed. That is, the perception of various different virtual objects is simulated by adjusting the number and type of signal generators 180. For example, when the touched virtual object is a low-heat virtual object, two heat signal generators may be used to generate heat; if the virtual object to be touched is a hot virtual object, five or even six heat signal generators may be used. At the same time fever.
  • wearable device 101 can include sensor 108.
  • the sensor 108 can be configured to detect the target location.
  • the target location is the location of the virtual object that the user is trying to perceive (eg, touch).
  • the target position may be characterized by position information, for example, using two-dimensional coordinates or three-dimensional coordinates as position information.
  • sensor 108 can employ a position sensor.
  • the sensor 108 can determine the target location based on the trajectory of the user's hand movement. For example, the location pointed by the user's hand is the target location.
  • the wearable device 101 can further include: a memory 103, and a processor 102.
  • the memory 103 may be configured to store location information of a plurality of virtual objects
  • the processor 102 may be configured to identify virtual objects at the target location according to location information of the plurality of virtual objects stored by the memory 103.
  • the memory 103 stores corresponding virtual objects at various locations.
  • a matching strategy can be used to find the virtual object at the target location.
  • the virtual object at the spatial position (1, 1, 1) is stored as an ice block.
  • the processor 103 determines that the user touches at this time.
  • the virtual object is ice.
  • the identification information may also be set on the virtual object, and then the processor 102 identifies the virtual object by determining the identification information.
  • all virtual objects are uniformly coded, and each virtual object corresponds to a unique coded identifier, and each virtual object is characterized by an identification information.
  • the memory 103 can store a mapping table that identifies the correspondence between the information and the virtual object. For example, when the user touches the virtual object at the target location, the identification information stored on the virtual object at the target location can be read, and then the processor 102 obtains the virtual object at the target location by analyzing the identification information.
  • the coded identification information may be stored using a two-dimensional code or the like.
  • the types of the above-described virtual objects may include objects of different temperatures, such as objects of different temperatures or electric conductors, which may be perceived by the user's touch. For example, an alarm signal can also be issued when a dangerous virtual object is touched.
  • the memory 103 may be further configured to store attribute information of the plurality of virtual objects; the processor 102 is further configured to: acquire, at the target location, according to attribute information of the plurality of virtual objects The attribute information of the virtual object; and the processor 102 generates a corresponding control signal according to the attribute information of the virtual object at the target position.
  • the attribute information described above is information capable of characterizing a perceptual feature of a virtual object, for example, information characterizing a tactile feature of the virtual object.
  • the corresponding attribute information may be cool; when the virtual object is a jade bracelet, the corresponding attribute information may be smooth or the like.
  • haptic feedback device 100 can also include a processing device (not shown).
  • the sensor 108 that senses the location may be provided only on the wearable device 101, and all or part of the functions of the memory 103 and the processor 102 described above may be implemented in the processing device.
  • the wearable device 101 needs to set a transmitter to transmit the target location to the processing device, and the processing device recognizes the virtual object at the target location, and further obtains the attribute information of the virtual object by the processing device and finally generates the control.
  • the signal is generated and the control signal is generated to the signal generator 180.
  • a control signal can be sent by the processing device to the signal generator 180 via a wireless channel, or a control signal can be sent by the processing device to the wearable device 101, and then controlled by the wearable device 101 by wire or wirelessly.
  • the signal is sent to signal generator 180.
  • the shape of the signal generator 180 can be spherical or funnel shaped.
  • the spherical generator outputs a sensing signal in all directions of the space, so that the palm or the finger is placed at a flexible position at this time.
  • a funnel-shaped or other shaped signal generator it is necessary to analyze the position of the finger or the palm relative to the signal generator so that the sensing signal output by the signal generator can be sensed by the palm or the finger.
  • the sensing signal is generated by signal generator 180 in accordance with a control signal.
  • signal generator 180 can include a variety of types, with each type of signal generator producing a single or composite sensing signal.
  • the type of signal generator may include, for example, one or more of an optical signal generator, an electrical signal generator, a wind signal generator, a vibrator, and a cold and heat signal generator.
  • the electric signal generator generates a current that causes a slight vibration or tingling by a person through the two electrodes
  • the wind signal generator generates a gas flow from the end through a heatable and cooled micro fan, and the like.
  • the wearable device 101 described above can include a wristband, a wearable wristband, a wearable armband or a wearable ring, and the like.
  • the smart bracelet involved in the following technical solutions can be a complete bracelet or a notched wristband.
  • a notched wristband it only needs to be worn on the wrist by the user.
  • an embodiment of the present disclosure provides a tactile feedback device that uses a smart bracelet 201 as the wearable device 101 and a ball generator 280 as the signal generator 180.
  • the connecting structure 260 may adopt a structure in which a signal line is disposed in the outer casing and the outer casing, or a long rod which is only used for supporting and fixing the respective signal generators.
  • the smart bracelet 20 needs to transmit a control signal to the signal generator 280 using a wireless transceiver, or send or receive a signal related to the smart bracelet 201 using a wireless transceiver.
  • signals associated with smart bracelet 201 include, but are not limited to, target position signals.
  • the length of each connection structure 260 is not equal.
  • an embodiment of the present disclosure provides a schematic diagram of touching a spatial virtual object by using the haptic sensing device 200 of FIG. 2.
  • the user wears a tactile sensing device 310 (corresponding to the tactile feedback device 200 of Fig. 2) and touches a certain position A of the space at which a pentagon firing unit 320 is placed.
  • the working process of the haptic feedback device 310 is as follows: when the user wears the haptic feedback device 310 and touches the point A of the heating element 320 in the space, the smart bracelet of the haptic feedback device 310 reads the coordinate information of the target position A, and then according to the coordinate information.
  • the coordinate information determines that the virtual object at the target position is a pentagonal heat generating body 320.
  • the smart bracelet regenerates the control information according to the attribute information of the heating element, and then controls the corresponding spherical signal generator to generate the thermal radiation signal. Therefore, the user can perceive the heating signal radiated by the thermal signal generator.
  • the haptic feedback device 310 integrates a position sensing function, a virtual object recognition function, and a control signal generating function.
  • a processor, a memory, and a sensor need to be disposed on the smart bracelet of the haptic feedback device 310.
  • the processor reads the instruction code from the memory, reads the position sensing data from the sensor, and reads related data pre-stored by the memory (for example, the related data may include a correspondence relationship between the position information and the virtual object or a correspondence between the virtual object and the attribute information Table), and perform the corresponding function based on the read data and finally output the control signal.
  • the haptic feedback device 310 can output the generated control signal to the signal generator by wire or wirelessly.
  • Each of the signal generators generates a sensing signal in response to a corresponding control signal and outputs to each of the signal generators.
  • the smart bracelet included in the haptic feedback device 310 may be used only to implement the location aware function, while the recognition function and the attribute information acquisition function for the virtual object are all implemented by the processing device.
  • the smart bracelet transmits the perceived location information (ie, the target location) to the processing device, and the processing device performs some or all of the functions of virtual object recognition or attribute information acquisition.
  • the control signals can then be sent to the individual signal generators by wired and wireless means by the smart bracelet.
  • Each of the signal generators generates a sensing signal in response to a corresponding control signal and outputs to each of the signal generators.
  • the smart bracelet also provides a detection unit (not shown) that is capable of detecting the target position in real time or periodically. If the detecting unit finds that the target position changes, the processor 102 can be notified to acquire the virtual object according to the new target position and finally generate a control signal. Accordingly, after the target location changes, the processor 102 can generate an instruction to turn off the currently turned on signal generator.
  • a detection unit (not shown) that is capable of detecting the target position in real time or periodically. If the detecting unit finds that the target position changes, the processor 102 can be notified to acquire the virtual object according to the new target position and finally generate a control signal. Accordingly, after the target location changes, the processor 102 can generate an instruction to turn off the currently turned on signal generator.
  • an embodiment of the present disclosure further provides a haptic feedback method 400.
  • the haptic feedback method 400 may include: step 401, detecting a target position; step 411, determining a virtual object at the target position; step 421, generating a control signal according to the virtual object; and step 431, generating according to the control signal The signal is sensed and the sensed signal is output.
  • the detection target location may be derived from the touch location of the hand as perceived by the sensor.
  • the center position of the palm or the fingertip position of the hand may be used as the target position, or the feature of the virtual object may be further determined whether the center position of the palm or the fingertip position is the target position.
  • a palm center position can be used as a target position (a virtual object such as an egg), and a virtual object that requires a fingertip touch can have a fingertip position as a target position (some button keys, etc.) ).
  • the pointing position of the hand can also be used as the target position, and the corresponding sensor needs to read the pointing information of the corresponding finger.
  • determining the virtual object at the target location may, for example, obtain a virtual object at the target location using the target location and virtual object correspondence table.
  • a correspondence table between each position and a virtual object is stored in advance, a target position of the current finger is acquired, and a virtual object located at the target position is obtained by finding a correspondence table.
  • the target position can be characterized in two or three dimensions. It can also be characterized by a string such as a label.
  • the position points of each of the placed virtual positions need to be uniformly coded, and a virtual object corresponds to a code, and the target position of the touch is represented by the code.
  • the corresponding relation table needs to store the correspondence between the code and the virtual object.
  • generating a control signal according to the virtual object may be, for example, generating a corresponding control signal by attribute information of the virtual object. Or directly generate a corresponding control signal according to the virtual object, that is, by analyzing the sensing effect of the virtual object in advance to generate a corresponding control signal, and directly determining the corresponding control signal after determining the virtual object.
  • the above control signal may be an on signal or a shutdown signal for causing the corresponding signal generator to start operation, and may be a signal or the like that causes the corresponding signal generator to change the signal strength.
  • the information carried by the control signal can be adjusted in real time depending on the actual characteristics of the touched virtual object.
  • the determining, by the step 411, the virtual object at the target location may include: acquiring location information of the stored plurality of virtual objects; and identifying the virtual location at the target location according to the location information of the plurality of virtual objects. object.
  • the position corresponding to the virtual object may be a coordinate range or a coordinate at the center of the virtual object.
  • the target position is the same as the coordinate value of a certain virtual object D
  • the virtual object at the target position is D
  • the absolute value of the difference is small enough (for example, the difference is less than a predetermined threshold), and the virtual object at the target position is E.
  • the step 421 of generating the control signal according to the virtual object may include: acquiring the stored attribute information of the plurality of virtual objects; acquiring the virtual object at the target location according to the attribute information of the plurality of virtual objects Attribute information; and generating the control signal according to attribute information of the virtual object at the target location.
  • the attribute information types may include, cool, hot, smooth, rough, vibration, and the like.
  • generating the control signal according to the attribute information may be determining a signal generator that needs to be turned on according to the attribute information, and determining characteristic information such as the intensity or frequency of the sensing signal generated by the signal generator according to the attribute information, and then the opening signal and the characteristic information are based on the information.
  • the communication protocol is encapsulated to generate the final control signal.
  • the generating, by the step 431, the sensing signal according to the control signal may include: generating one or more of an optical signal, an electrical signal, a wind signal, a vibration signal, a cold signal, and a thermal signal according to the control signal.
  • the control signal may carry intensity information of the optical signal, or vibration frequency and vibration amplitude information of the vibration signal, or intensity information of the cold and hot signal, and the like.
  • control signal may also include a signal command to turn off the respective signal generator when the user touch ends.
  • the method further includes the step of monitoring whether the target location changes in real time, by which the target location can be updated, and the operations of the foregoing steps 411 to 431 are repeatedly performed according to the updated target location.
  • one or more of the optical signal, the electrical signal, the wind signal, the shock signal, the cold signal, and the thermal signal are generated by the respective signal generators in response to the control signals.
  • At least one embodiment of the present disclosure provides a computer readable storage medium having stored thereon computer instructions that, when executed by a processor, implement one or more steps of the haptic feedback method 400.
  • At least one embodiment of the present disclosure provides an electronic product comprising one or more processors configured to execute computer instructions to perform one or more steps of the haptic feedback method 400.
  • the embodiment of the present disclosure installs a sensing bracelet at the wrist of the user, and has a current, and the wind generator is suspended around the palm of the hand through the wristband.
  • the spherical generator according to the object
  • the texture ie, attribute information

Abstract

A haptic feedback apparatus (100) and haptic feedback method. The haptic feedback apparatus (100) comprises: at least one connection structure (160), a wearable device (101) and at least one signal generator (180). One end of the connection structure (160) is connected to the wearable device (101), and the other end of the connection structure (160) is connected to the signal generator (180). The wearable device (101) is configured to detect a target position. The signal generator (180) is configured to generate a perception signal according to a control signal, and to output the perception signal.

Description

触觉反馈装置及方法、可读存储介质、电子产品Tactile feedback device and method, readable storage medium, electronic product 技术领域Technical field
本公开的实施例涉及一种触觉反馈装置和方法。Embodiments of the present disclosure are directed to a haptic feedback device and method.
背景技术Background technique
虚拟现实技术涉及模拟环境、感知、自然技能和传感设备等多个方面。例如,感知是指理想的虚拟现实技术应该具备人所具有的一切感知。也就是说,除计算机图形技术所生成的视觉感知外,虚拟现实技术还有针对听觉、触觉、运动、甚至嗅觉的感知。在虚拟现实技术中,用户可以去触摸一个虚拟物体,而且用户很希望获得与触摸该虚拟物体所对应的真实物体的相类似的感受。Virtual reality technology involves many aspects such as simulation environment, perception, natural skills, and sensing devices. For example, perception means that ideal virtual reality technology should have all the perceptions that people have. That is to say, in addition to the visual perception generated by computer graphics technology, virtual reality technology also has a perception of hearing, touch, motion, and even smell. In virtual reality technology, a user can touch a virtual object, and the user desires to obtain a similar feeling to the real object corresponding to touching the virtual object.
发明内容Summary of the invention
本公开的至少一个实施例提供一种触觉反馈装置,包括:至少一个连接结构、可穿戴设备和至少一个信号发生器。所述连接结构的一端与所述可穿戴设备相连,所述连接结构的另一端与所述信号发生器相连。所述可穿戴设备被配置为:检测目标位置。所述信号发生器被配置为依据控制信号产生感知信号,并输出所述感知信号。At least one embodiment of the present disclosure provides a haptic feedback device comprising: at least one connection structure, a wearable device, and at least one signal generator. One end of the connection structure is connected to the wearable device, and the other end of the connection structure is connected to the signal generator. The wearable device is configured to detect a target location. The signal generator is configured to generate a sensing signal in accordance with the control signal and output the sensing signal.
例如,所述可穿戴设备还被配置为:确定所述目标位置处的虚拟物体;根据所述虚拟物体产生所述控制信号;以及发送所述控制信号至所述信号发生器。For example, the wearable device is further configured to: determine a virtual object at the target location; generate the control signal according to the virtual object; and transmit the control signal to the signal generator.
例如,所述的触觉反馈装置还包括处理设备;所述处理设备被配置为:确定所述目标位置处的虚拟物体;根据所述虚拟物体产生所述控制信号;以及发送所述控制信号至所述信号发生器。For example, the haptic feedback device further includes a processing device; the processing device configured to: determine a virtual object at the target location; generate the control signal according to the virtual object; and send the control signal to the The signal generator.
例如,所述连接结构包括:外壳和位于所述外壳内部的信号线;所述信号线被配置为将所述控制信号从所述可穿戴设备传输至所述信号发生器。For example, the connection structure includes a housing and a signal line located inside the housing; the signal line is configured to transmit the control signal from the wearable device to the signal generator.
例如,所述外壳为可形变材质;以及所述可形变材质包括金属。For example, the outer casing is a deformable material; and the deformable material comprises a metal.
例如,所述连接结构为可形变的长杆。For example, the connecting structure is a deformable long rod.
例如,所述触觉反馈装置包括多个连接结构和多个信号发生器,所述多 个连接结构与所述多个信号发生器一一对应连接;所述多个连接结构分散地设置于所述可穿戴设备;以及所述多个连接结构的长度不相等。For example, the haptic feedback device includes a plurality of connection structures and a plurality of signal generators, the plurality of connection structures being connected in one-to-one correspondence with the plurality of signal generators; the plurality of connection structures are discretely disposed on the a wearable device; and the plurality of connection structures are unequal in length.
例如,所述可穿戴设备包括第一无线收发器,所述信号发生器包括第二无线收发器,所述可穿戴设备和所述信号放生器通过所述第一无线收发器和所述第二无线收发器进行通信。For example, the wearable device includes a first wireless transceiver, the signal generator includes a second wireless transceiver, the wearable device and the signal release device pass the first wireless transceiver and the second The wireless transceiver communicates.
例如,所述可穿戴设备包括传感器,被配置为检测所述目标位置。For example, the wearable device includes a sensor configured to detect the target location.
例如,所述可穿戴设备还包括:存储器,被配置为存储多个虚拟物体的位置信息;以及处理器,被配置为依据所述多个虚拟物体的位置信息,识别所述目标位置处的虚拟物体。For example, the wearable device further includes: a memory configured to store location information of the plurality of virtual objects; and a processor configured to identify the virtual location at the target location according to location information of the plurality of virtual objects object.
例如,所述存储器,还被配置为存储所述多个虚拟物体的属性信息;所述处理器,还被配置为:依据所述多个虚拟物体的属性信息,获取所述目标位置处的虚拟物体的属性信息;以及依据所述目标位置处的虚拟物体的属性信息生成所述控制信号。For example, the memory is further configured to store attribute information of the plurality of virtual objects; the processor is further configured to: acquire virtuality at the target location according to attribute information of the plurality of virtual objects Attribute information of the object; and generating the control signal according to attribute information of the virtual object at the target position.
例如,所述信号发生器的外形为球状或者漏斗状。For example, the signal generator has a spherical shape or a funnel shape.
例如,所述信号发生器包括光信号发生器、电信号发生器、风信号发生器、震动器和冷热信号发生器中的一个或多个。For example, the signal generator includes one or more of an optical signal generator, an electrical signal generator, a wind signal generator, a vibrator, and a thermal signal generator.
本公开的至少一个实施例还提供一种触觉反馈方法,包括:检测目标位置;确定所述目标位置处的虚拟物体;根据所述虚拟物体产生控制信号;以及依据所述控制信号产生感知信号,并输出所述感知信号。At least one embodiment of the present disclosure also provides a haptic feedback method including: detecting a target position; determining a virtual object at the target position; generating a control signal according to the virtual object; and generating a sensing signal according to the control signal, And outputting the sensing signal.
例如,所述确定所述目标位置处的虚拟物体,包括:获取存储的多个虚拟物体的位置信息;依据所述多个虚拟物体的位置信息,识别所述目标位置处的虚拟物体。For example, the determining the virtual object at the target location comprises: acquiring location information of the stored plurality of virtual objects; and identifying the virtual object at the target location according to the location information of the plurality of virtual objects.
例如,根据所述虚拟物体产生所述控制信号,包括:获取存储的所述多个虚拟物体的属性信息;依据所述多个虚拟物体的属性信息,获取所述目标位置处的虚拟物体的属性信息;以及依据所述目标位置处的虚拟物体的属性信息生成所述控制信号。For example, generating the control signal according to the virtual object includes: acquiring attribute information of the stored plurality of virtual objects; acquiring attributes of the virtual object at the target position according to attribute information of the plurality of virtual objects Information; and generating the control signal based on attribute information of the virtual object at the target location.
例如,所述依据所述控制信号产生所述感知信号,包括:依据所述控制信号产生光信号、电信号、风信号、震动信号、冷信号和热信号中的一个或多个。For example, the generating the sensing signal according to the control signal comprises: generating one or more of an optical signal, an electrical signal, a wind signal, a vibration signal, a cold signal, and a thermal signal according to the control signal.
本公开的至少一个实施例提供一种计算机可读存储介质,其上存储有计算机指令,所述计算机指令被处理器执行时实现所述的触觉反馈方法的一个 或多个步骤。At least one embodiment of the present disclosure provides a computer readable storage medium having stored thereon computer instructions that, when executed by a processor, implement one or more steps of the haptic feedback method.
本公开的至少一个实施例提供一种电子产品,包括一个或多个处理器,所述处理器被配置为运行计算机指令以执行所述的触觉反馈方法的一个或多个步骤。At least one embodiment of the present disclosure provides an electronic product comprising one or more processors configured to execute computer instructions to perform one or more steps of the haptic feedback method.
附图说明DRAWINGS
为了更清楚地说明本公开实施例的技术方案,下面将对实施例的附图作简单地介绍,显而易见地,下面描述中的附图仅仅涉及本公开的一些实施例,而非对本公开的限制。In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly described below. It is obvious that the drawings in the following description relate only to some embodiments of the present disclosure, and are not to limit the disclosure. .
图1为本公开实施例提供的一种触觉反馈装置的结构示意图;1 is a schematic structural diagram of a haptic feedback device according to an embodiment of the present disclosure;
图2为本公开实施例提供的一种触觉反馈装置的实物示意图;2 is a schematic diagram of a physical object of a tactile feedback device according to an embodiment of the present disclosure;
图3为本公开实施例提供的一种触觉反馈装置应用场景图;FIG. 3 is a schematic diagram of an application scenario of a haptic feedback device according to an embodiment of the present disclosure;
图4为本公开实施例提供的一种触觉反馈方法的流程图。FIG. 4 is a flowchart of a haptic feedback method according to an embodiment of the present disclosure.
具体实施方式Detailed ways
下面将结合附图,对本公开实施例中的技术方案进行清楚、完整地描述参考在附图中示出并在以下描述中详述的非限制性示例实施例,更加全面地说明本公开的示例实施例和它们的多种特征及有利细节。应注意的是,图中示出的特征不是必须按照比例绘制。所给出的示例仅旨在有利于理解本公开示例实施例的实施,以及进一步使本领域技术人员能够实施示例实施例。因而,这些示例不应被理解为对本公开的实施例的范围的限制。The technical solutions in the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, by way of the accompanying drawings. Embodiments and their various features and advantageous details. It should be noted that the features shown in the figures are not necessarily drawn to scale. The examples are given only to facilitate an understanding of the implementation of the example embodiments of the present disclosure, and to enable those skilled in the art to practice the example embodiments. Therefore, the examples are not to be construed as limiting the scope of the embodiments of the present disclosure.
除非另外特别定义,本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性,而只是用来区分不同的组成部分。此外,在本公开各个实施例中,相同或类似的参考标号表示相同或类似的构件。Unless otherwise specifically defined, technical terms or scientific terms used in the present disclosure shall be understood in the ordinary meaning as understood by those having ordinary skill in the art to which the disclosure pertains. The words "first," "second," and similar terms used in the present disclosure do not denote any order, quantity, or importance, but are used to distinguish different components. In addition, in the various embodiments of the present disclosure, the same or similar reference numerals denote the same or similar components.
虚拟现实(virtual reality)技术是仿真技术、计算机图形学人机接口技术、多媒体技术、传感技术和网络技术等多种技术的集合。在一个虚拟现实技术对应的系统中,用户可以看到并去触摸一个虚拟的物体。为了模拟手真正接触该虚拟物体的感觉,虚拟现实技术常用的装置是在手套内层安装一些可以振动的触点或者通过手持感应柄处传来的震动来模拟触觉。但是,上述方式 的缺点也是明显的。例如,手柄和手套内的震动触点只能模拟很小一部分实物的触觉,并且手套还将手与空气隔离,因此舒适度不佳。Virtual reality technology is a collection of various technologies such as simulation technology, computer graphics human-machine interface technology, multimedia technology, sensing technology and network technology. In a system corresponding to virtual reality technology, the user can see and touch a virtual object. In order to simulate the feeling that the hand actually touches the virtual object, the device commonly used in virtual reality technology is to simulate the tactile sensation by installing some vibrating contacts on the inner layer of the glove or by transmitting vibrations from the hand-held sensor handle. However, the disadvantages of the above methods are also obvious. For example, the shock contacts in the handle and glove can only simulate the touch of a small part of the object, and the glove also isolates the hand from the air, so the comfort is not good.
下面结合图1-4,对本公开实施例提供的一种触觉反馈装置及方法的具体实施方式进行详细说明。A specific implementation manner of a haptic feedback device and method provided by an embodiment of the present disclosure is described in detail below with reference to FIG.
如图1所示,本公开的实施例提供一种触觉反馈装置100,可以用于虚拟现实技术中。该触觉反馈装置100包括:至少一个连接结构160(例如图1中的160a、160b、160c等)、可穿戴设备101和至少一个信号发生器180(例如图1中的180a、180b、180c等)。所述连接结构160的一端与所述可穿戴设备101相连,所述连接结构160的另一端与所述信号发生器180相连。图1中的箭头表征的连接结构160仅用于说明可穿戴设备101与信号发生器180之间可以通过连接结构160的两端相连接,而对于连接结构160的结构可以参考如下实施例。As shown in FIG. 1, an embodiment of the present disclosure provides a haptic feedback device 100 that can be used in virtual reality technology. The haptic feedback device 100 includes at least one connection structure 160 (eg, 160a, 160b, 160c, etc. in FIG. 1), a wearable device 101, and at least one signal generator 180 (eg, 180a, 180b, 180c, etc. in FIG. 1). . One end of the connection structure 160 is connected to the wearable device 101, and the other end of the connection structure 160 is connected to the signal generator 180. The connection structure 160 characterized by the arrows in FIG. 1 is only used to illustrate that the wearable device 101 and the signal generator 180 can be connected through both ends of the connection structure 160, and for the structure of the connection structure 160, reference can be made to the following embodiments.
上述可穿戴设备101可以被配置为执行如下操作:检测目标位置;确定所述目标位置处的虚拟物体;根据所述虚拟物体产生控制信号;以及发送所述控制信号至所述信号发生器。The wearable device 101 described above may be configured to perform an operation of: detecting a target position; determining a virtual object at the target position; generating a control signal according to the virtual object; and transmitting the control signal to the signal generator.
上述信号发生器180可以被配置为依据可穿戴设备101产生的控制信号产生感知信号,并输出感知信号。进一步的,该感知信号将被感知动作(例如,触摸动作)发出者的手部感知。The signal generator 180 described above may be configured to generate a sensing signal in accordance with a control signal generated by the wearable device 101 and output a sensing signal. Further, the sensing signal will be perceived by the sender's hand by a perceived action (eg, a touch action).
在一些实施例中,上述控制信号可以采用有线方式进行传输。相应的,所述连接结构160可以包括:外壳和位于所述外壳内部的信号线。所述信号线被配置为将所述控制信号从可穿戴设备101传输至信号发生器180。例如,信号线为由多条电缆线构成的一束或多束传输线,信号线的载体可以为金属或其它载体,如光缆等。In some embodiments, the above control signals can be transmitted in a wired manner. Correspondingly, the connecting structure 160 may include: a casing and a signal line located inside the casing. The signal line is configured to transmit the control signal from the wearable device 101 to the signal generator 180. For example, the signal line is a bundle or a plurality of transmission lines composed of a plurality of cable lines, and the carrier of the signal line may be a metal or other carrier such as an optical cable or the like.
在一些实施例中,所述外壳采用可形变可弯折材质。例如,所述可形变可弯折材质可以包括铁、铜或铝等金属。例如,采用金属载体的信号线组成多束传输线,该多束传输线可以分布于金属壳体内部。In some embodiments, the outer casing is of a deformable bendable material. For example, the deformable bendable material may comprise a metal such as iron, copper or aluminum. For example, a signal line using a metal carrier constitutes a plurality of transmission lines, which may be distributed inside the metal casing.
在一些实施例中,上述控制信号采用无线方式传输,例如,可以采用短距离无线传输技术。相应的连接结构160可以为可形变的长杆。所述可变形长杆也采用可形变可弯折的材质。例如,可形变可弯折材质包括铁、铜或铝等金属。例如,采用铁杆作为连接结构160,该铁杆连接结构160的一端连接可穿戴设备101,另一端连接一个信号发生器180。例如,短距离无线传输技 术包括蓝牙、超宽带或者wifi等。例如,可穿戴设备101可以包括第一无线收发器,信号发生器180包括第二无线收发器,可穿戴设备101和信号放生器180可以通过第一无线收发器和第二无线收发器进行通信。In some embodiments, the above control signals are transmitted wirelessly, for example, short-range wireless transmission techniques may be employed. The corresponding connection structure 160 can be a deformable long rod. The deformable long rod also adopts a material that can be deformed and bendable. For example, the deformable bendable material includes a metal such as iron, copper or aluminum. For example, an iron rod is used as the connection structure 160, one end of which is connected to the wearable device 101, and the other end is connected to a signal generator 180. For example, short-range wireless transmission technologies include Bluetooth, ultra-wideband, or wifi. For example, wearable device 101 can include a first wireless transceiver, signal generator 180 includes a second wireless transceiver, and wearable device 101 and signal processor 180 can communicate via a first wireless transceiver and a second wireless transceiver.
在一些实施例中,触觉反馈装置100可以同时采用有线方式传输或无线方式之一传输生成的控制信号。此时,相应的连接结构160为采用外壳和外壳内部布置信号线的方式实现。为了同时实现采用无线方式传输控制信号的目的,可穿戴设备101可以包括第一无线收发器,信号发生器180包括第二无线收发器。当触觉反馈装置100工作于被无线网络覆盖的环境时,可以采用无线方式传输生成的控制信号。当触觉反馈装置100工作于无网络覆盖的环境时,或者网络覆盖信号不好时,均可以采用有线的方式即采用连接结构160内部的信号线传输生成的控制信号。In some embodiments, haptic feedback device 100 can simultaneously transmit the generated control signals in one of a wired transmission or a wireless manner. At this time, the corresponding connection structure 160 is realized by arranging signal lines inside the casing and the casing. In order to achieve the purpose of simultaneously transmitting a control signal wirelessly, the wearable device 101 may include a first wireless transceiver, and the signal generator 180 includes a second wireless transceiver. When the haptic feedback device 100 operates in an environment covered by a wireless network, the generated control signals can be transmitted wirelessly. When the haptic feedback device 100 operates in an environment without network coverage, or when the network coverage signal is not good, the generated control signals may be transmitted in a wired manner, that is, using signal lines inside the connection structure 160.
在一些实施例中,触觉反馈装置100包括多个连接结构160和多个信号发生器180,连接结构160与信号发生器180之间一一对应连接。即,一个连接结构160与一个信号发生器180相连接,其中,多个信号发生器180可以属于不同的种类,分别生成和输出不同的感知信号。In some embodiments, haptic feedback device 100 includes a plurality of connection structures 160 and a plurality of signal generators 180, one-to-one correspondence between connection structure 160 and signal generator 180. That is, a connection structure 160 is coupled to a signal generator 180, wherein the plurality of signal generators 180 can belong to different categories, respectively generating and outputting different sensing signals.
各连接结构160分散地设置于可穿戴设备101上。例如,可穿戴设备101为手环时,连接结构160分散连接于手环上。Each of the connection structures 160 is discretely disposed on the wearable device 101. For example, when the wearable device 101 is a wristband, the connection structure 160 is detachably coupled to the wristband.
为了使手的各部分分别感知触摸虚拟物体的感受,在一些实施例中各所述连接结构160的长度可以不相等。例如,相应于手掌位置处设置一个较短的连接结构160,而对于指尖部分设置相对较长的连接结构160。在另一些实施例中,也可以通过弯折各连接结构160达到使手的不同部位分别感知触觉信号的目的,这种情况下各连接结构160的长度可以相等或相近似。In order for portions of the hand to sense the perception of touching the virtual object, respectively, the length of each of the connection structures 160 may not be equal in some embodiments. For example, a shorter connection structure 160 is provided corresponding to the palm position, and a relatively longer connection structure 160 is provided for the fingertip portion. In other embodiments, the purpose of sensing the tactile signals by different portions of the hand may also be achieved by bending the respective connecting structures 160. In this case, the lengths of the connecting structures 160 may be equal or similar.
在一些实施例中,为了达到模拟不同虚拟物体的感知效果,可以采用不同数量不同种类的多个信号发生器。也就是通过调整信号发生器180的数量和种类模拟各种不同虚拟物体给人的知觉。例如,触摸的虚拟物体为热度较低的虚拟物体时,可以采用两个热信号发生器发热;如果要触摸的虚拟物体为发烫的虚拟物体时,可以采用五个甚至六个热信号发生器同时发热。In some embodiments, to achieve a simulated effect of simulating different virtual objects, a plurality of different types of multiple signal generators may be employed. That is, the perception of various different virtual objects is simulated by adjusting the number and type of signal generators 180. For example, when the touched virtual object is a low-heat virtual object, two heat signal generators may be used to generate heat; if the virtual object to be touched is a hot virtual object, five or even six heat signal generators may be used. At the same time fever.
在一些实施例中,可穿戴设备101可以包括传感器108。该传感器108可以被配置为检测所述目标位置。目标位置即用户试图要感知(例如,触摸)的虚拟物体所在的位置。该目标位置可以采用位置信息表征,例如,采用二维坐标或者三维坐标作为位置信息。例如,传感器108可以采用位置传感器。 在一些例子中,该传感器108可以根据用户的手移动的轨迹来确定所述目标位置。例如,用户的手所指向的位置即为目标位置。In some embodiments, wearable device 101 can include sensor 108. The sensor 108 can be configured to detect the target location. The target location is the location of the virtual object that the user is trying to perceive (eg, touch). The target position may be characterized by position information, for example, using two-dimensional coordinates or three-dimensional coordinates as position information. For example, sensor 108 can employ a position sensor. In some examples, the sensor 108 can determine the target location based on the trajectory of the user's hand movement. For example, the location pointed by the user's hand is the target location.
在一些实施例中,可穿戴设备101还可以包括:存储器103,以及处理器102。存储器103可以被配置为存储多个虚拟物体的位置信息,处理器102可以被配置为依据存储器103所存储的多个虚拟物体的位置信息,识别所述目标位置处的虚拟物体。例如,存储器103存储各位置处对应的虚拟物体,当处理器102读取了目标位置后,可以采用匹配策略找到目标位置处的虚拟物体。例如,存储器103中存储了空间位置(1,1,1)处的虚拟物体为冰块,当用户触摸空间位置(1,1,1)时,则处理器103会通过判断得到此时用户触摸的虚拟物体为冰块。In some embodiments, the wearable device 101 can further include: a memory 103, and a processor 102. The memory 103 may be configured to store location information of a plurality of virtual objects, and the processor 102 may be configured to identify virtual objects at the target location according to location information of the plurality of virtual objects stored by the memory 103. For example, the memory 103 stores corresponding virtual objects at various locations. After the processor 102 reads the target location, a matching strategy can be used to find the virtual object at the target location. For example, in the memory 103, the virtual object at the spatial position (1, 1, 1) is stored as an ice block. When the user touches the spatial position (1, 1, 1), the processor 103 determines that the user touches at this time. The virtual object is ice.
在一些实施例中,也可以在虚拟物体上设置标识信息,之后由处理器102通过判断该标识信息进而识别该虚拟物体。例如,将所有虚拟物体进行统一编码,每一个虚拟物体对应一个唯一的编码标识,每一个虚拟物体采用一个标识信息表征。相应的,存储器103可以存储标识信息与虚拟物体的对应关系的映射表。例如,当用户触摸目标位置处的虚拟物体时,可以通过读取目标位置处虚拟物体上存储的标识信息,之后由处理器102通过分析标识信息获得目标位置处的虚拟物体。例如,可以采用二维码等存储编码标识信息。In some embodiments, the identification information may also be set on the virtual object, and then the processor 102 identifies the virtual object by determining the identification information. For example, all virtual objects are uniformly coded, and each virtual object corresponds to a unique coded identifier, and each virtual object is characterized by an identification information. Correspondingly, the memory 103 can store a mapping table that identifies the correspondence between the information and the virtual object. For example, when the user touches the virtual object at the target location, the identification information stored on the virtual object at the target location can be read, and then the processor 102 obtains the virtual object at the target location by analyzing the identification information. For example, the coded identification information may be stored using a two-dimensional code or the like.
上述虚拟物体的种类可以包括不同温度的物体或者导电体等可能被用户触摸感知的现实世界中所有物体。例如,当触摸有危险的虚拟物体时还可以发出报警信号。The types of the above-described virtual objects may include objects of different temperatures, such as objects of different temperatures or electric conductors, which may be perceived by the user's touch. For example, an alarm signal can also be issued when a dangerous virtual object is touched.
在一些实施例中,存储器103还可以被配置为存储所述多个虚拟物体的属性信息;处理器102还被配置为:依据所述多个虚拟物体的属性信息,获取所述目标位置处的虚拟物体的属性信息;以及由处理器102依据目标位置处的虚拟物体的属性信息生成相应的控制信号。In some embodiments, the memory 103 may be further configured to store attribute information of the plurality of virtual objects; the processor 102 is further configured to: acquire, at the target location, according to attribute information of the plurality of virtual objects The attribute information of the virtual object; and the processor 102 generates a corresponding control signal according to the attribute information of the virtual object at the target position.
例如,上述属性信息为能够表征虚拟物体的感知特征的信息,例如,表征虚拟物体的触觉特征的信息。例如,当虚拟物体为冰块时,相应的属性信息可以为凉;当虚拟物体为玉手镯时,相应的属性信息可以为光滑等。For example, the attribute information described above is information capable of characterizing a perceptual feature of a virtual object, for example, information characterizing a tactile feature of the virtual object. For example, when the virtual object is an ice cube, the corresponding attribute information may be cool; when the virtual object is a jade bracelet, the corresponding attribute information may be smooth or the like.
此外,在一些实例中,触觉反馈装置100还可以包括处理设备(图中未示出)。可以仅在可穿戴设备101上设置感知位置的传感器108,而上述存储器103和处理器102的全部或者部分功能可以设置在该处理设备中实现。相应的,可穿戴设备101上需要设置发送器将目标位置传输至该处理设备,由 该处理设备识别出目标位置处的虚拟物体,并进一步由该处理设备得到虚拟物体的属性信息并最终生成控制信号,并将控制信号发生给信号发生器180。例如,可以由该处理设备通过无线通道将控制信号发送至信号发生器180,或者由该处理设备将控制信号发送至可穿戴设备101,之后再由可穿戴设备101通过有线或者无线的方式将控制信号发送至信号发生器180。Moreover, in some examples, haptic feedback device 100 can also include a processing device (not shown). The sensor 108 that senses the location may be provided only on the wearable device 101, and all or part of the functions of the memory 103 and the processor 102 described above may be implemented in the processing device. Correspondingly, the wearable device 101 needs to set a transmitter to transmit the target location to the processing device, and the processing device recognizes the virtual object at the target location, and further obtains the attribute information of the virtual object by the processing device and finally generates the control. The signal is generated and the control signal is generated to the signal generator 180. For example, a control signal can be sent by the processing device to the signal generator 180 via a wireless channel, or a control signal can be sent by the processing device to the wearable device 101, and then controlled by the wearable device 101 by wire or wirelessly. The signal is sent to signal generator 180.
在一些实施例中,信号发生器180的外形可以为球状或者漏斗状。当采用球状信号发生器时,该球状发生器向空间各个方向输出感知信号,因此此时手掌或者手指的放置位置较灵活。当采用漏斗状或者其他形状的信号发生器时需要分析手指或者手掌相对于信号发生器的位置,以便于使信号发生器输出的感知信号能够被手掌或者手指进行感知。该感知信号由信号发生器180依据控制信号产生。In some embodiments, the shape of the signal generator 180 can be spherical or funnel shaped. When a spherical signal generator is used, the spherical generator outputs a sensing signal in all directions of the space, so that the palm or the finger is placed at a flexible position at this time. When using a funnel-shaped or other shaped signal generator, it is necessary to analyze the position of the finger or the palm relative to the signal generator so that the sensing signal output by the signal generator can be sensed by the palm or the finger. The sensing signal is generated by signal generator 180 in accordance with a control signal.
在一些实施例中,信号发生器180可以包括多种种类,其中每一种类的信号发生器可产生一种单一或者复合的感知信号。例如,信号发生器的种类例如可以包括光信号发生器、电信号发生器、风信号发生器、震动器和冷热信号发生器中的一个或多个。In some embodiments, signal generator 180 can include a variety of types, with each type of signal generator producing a single or composite sensing signal. For example, the type of signal generator may include, for example, one or more of an optical signal generator, an electrical signal generator, a wind signal generator, a vibrator, and a cold and heat signal generator.
例如,电信号发生器通过两电极产生能使人有轻微震动或刺感的电流、风信号发生器通过可加热和制冷的微型风扇产生气流从末端喷出,等等。For example, the electric signal generator generates a current that causes a slight vibration or tingling by a person through the two electrodes, and the wind signal generator generates a gas flow from the end through a heatable and cooled micro fan, and the like.
在一些实施例中,上述可穿戴设备101可以包括手环、可穿戴腕带、可穿戴臂环或可穿戴戒指等。In some embodiments, the wearable device 101 described above can include a wristband, a wearable wristband, a wearable armband or a wearable ring, and the like.
下面图2和图3将以智能手环为例进一步介绍本公开的实施例。2 and 3 below will further illustrate an embodiment of the present disclosure by taking a smart bracelet as an example.
下述技术方案涉及的智能手环可以为完整手环或有缺口的手环,对于有缺口的手环只需要保证能被用户佩戴在手腕上即可。The smart bracelet involved in the following technical solutions can be a complete bracelet or a notched wristband. For a notched wristband, it only needs to be worn on the wrist by the user.
如图2所示,本公开实施例提供了一种采用智能手环201作为可穿戴设备101,并采用球状发生器280作为信号发生器180的触觉反馈装置。连接结构260可以采用外壳和外壳内设置信号线的结构,也可以采用一个长杆,该长杆仅用于支撑和固定各个信号发生器。当采用一个长杆作为连接结构时,智能手环20需要采用无线收发器向信号发生器280发送控制信号,或者采用无线收发器发送或者接收与智能手环201有关的信号。例如,与智能手环201有关的信号包括但不限于目标位置信号。各连接结构260的长度不相等。As shown in FIG. 2, an embodiment of the present disclosure provides a tactile feedback device that uses a smart bracelet 201 as the wearable device 101 and a ball generator 280 as the signal generator 180. The connecting structure 260 may adopt a structure in which a signal line is disposed in the outer casing and the outer casing, or a long rod which is only used for supporting and fixing the respective signal generators. When a long pole is used as the connection structure, the smart bracelet 20 needs to transmit a control signal to the signal generator 280 using a wireless transceiver, or send or receive a signal related to the smart bracelet 201 using a wireless transceiver. For example, signals associated with smart bracelet 201 include, but are not limited to, target position signals. The length of each connection structure 260 is not equal.
如图3所示,本公开实施例提供了一种采用图2的触觉感知装置200触摸空间虚拟物体的示意图。用户佩戴触觉感知装置310(相应于图2的触觉反 馈装置200),并触摸空间的某一位置A,该位置A处放置一个五角形的发热单元320。As shown in FIG. 3, an embodiment of the present disclosure provides a schematic diagram of touching a spatial virtual object by using the haptic sensing device 200 of FIG. 2. The user wears a tactile sensing device 310 (corresponding to the tactile feedback device 200 of Fig. 2) and touches a certain position A of the space at which a pentagon firing unit 320 is placed.
上述触觉反馈装置310的工作过程如下:当用户佩戴触觉反馈装置310并触摸空间中放置发热体320的A点时,触觉反馈装置310的智能手环读取目标位置A的坐标信息,之后再根据坐标信息判断目标位置处的虚拟物体为一个五角形的发热体320。智能手环根据发热体的属性信息再产生控制信息,进而控制相应的球状信号发生器产生热辐射信号,因此,用户可以感知到热信号发生器辐射的发热信号。The working process of the haptic feedback device 310 is as follows: when the user wears the haptic feedback device 310 and touches the point A of the heating element 320 in the space, the smart bracelet of the haptic feedback device 310 reads the coordinate information of the target position A, and then according to the coordinate information. The coordinate information determines that the virtual object at the target position is a pentagonal heat generating body 320. The smart bracelet regenerates the control information according to the attribute information of the heating element, and then controls the corresponding spherical signal generator to generate the thermal radiation signal. Therefore, the user can perceive the heating signal radiated by the thermal signal generator.
触觉反馈装置310集成了位置感知功能,虚拟物体识别功能以及控制信号产生功能。为了实现这些功能,触觉反馈装置310的智能手环上需要设置处理器、存储器以及传感器。处理器从存储器读取指令代码、从传感器读取位置感知数据并读取存储器预先存储的相关数据(例如,相关数据可以包括位置信息与虚拟物体的对应关系表或者虚拟物体与属性信息的对应关系表),并根据读取的数据执行相应功能并最终输出控制信号。触觉反馈装置310可以通过有线或者无线的方式向信号发生器输出产生的控制信号。各个信号发生器响应于相应的控制信号产生感知信号,并向各信号发生器周围进行输出。The haptic feedback device 310 integrates a position sensing function, a virtual object recognition function, and a control signal generating function. In order to achieve these functions, a processor, a memory, and a sensor need to be disposed on the smart bracelet of the haptic feedback device 310. The processor reads the instruction code from the memory, reads the position sensing data from the sensor, and reads related data pre-stored by the memory (for example, the related data may include a correspondence relationship between the position information and the virtual object or a correspondence between the virtual object and the attribute information Table), and perform the corresponding function based on the read data and finally output the control signal. The haptic feedback device 310 can output the generated control signal to the signal generator by wire or wirelessly. Each of the signal generators generates a sensing signal in response to a corresponding control signal and outputs to each of the signal generators.
在一些实施例中,触觉反馈装置310包含的智能手环可以仅用于实现位置感知功能,而对于虚拟物体的识别功能和属性信息获取功能均由处理设备实现。智能手环将感知的位置信息(即,目标位置)发送至处理设备,并由处理设备执行虚拟物体识别或者属性信息获取的部分或者全部功能。之后,可以由智能手环通过有线和无线的方式向各个信号发生器发送控制信号。各个信号发生器响应于相应的控制信号产生感知信号,并向各信号发生器周围进行输出。In some embodiments, the smart bracelet included in the haptic feedback device 310 may be used only to implement the location aware function, while the recognition function and the attribute information acquisition function for the virtual object are all implemented by the processing device. The smart bracelet transmits the perceived location information (ie, the target location) to the processing device, and the processing device performs some or all of the functions of virtual object recognition or attribute information acquisition. The control signals can then be sent to the individual signal generators by wired and wireless means by the smart bracelet. Each of the signal generators generates a sensing signal in response to a corresponding control signal and outputs to each of the signal generators.
在一些实施例中,智能手环还设置检测单元(图中未示出),该检测单元能够实时或者周期性检测目标位置。如果检测单元发现目标位置变化后,可以通知处理器102依据新的目标位置获取虚拟物体并最终生成控制信号。相应的,目标位置变化后,处理器102可以生成用于关闭当前开启的信号发生器的指令。In some embodiments, the smart bracelet also provides a detection unit (not shown) that is capable of detecting the target position in real time or periodically. If the detecting unit finds that the target position changes, the processor 102 can be notified to acquire the virtual object according to the new target position and finally generate a control signal. Accordingly, after the target location changes, the processor 102 can generate an instruction to turn off the currently turned on signal generator.
如图4所示,本公开实施例还提供一种触觉反馈方法400。该触觉反馈方法400可以包括:步骤401,检测目标位置;步骤411,确定所述目标位置处的虚拟物体;步骤421,根据所述虚拟物体产生控制信号;以及步骤431,依 据所述控制信号产生感知信号,并输出所述感知信号。As shown in FIG. 4, an embodiment of the present disclosure further provides a haptic feedback method 400. The haptic feedback method 400 may include: step 401, detecting a target position; step 411, determining a virtual object at the target position; step 421, generating a control signal according to the virtual object; and step 431, generating according to the control signal The signal is sensed and the sensed signal is output.
在一些实施例中,检测目标位置可以由传感器感知的手的触摸位置而得到。例如,可以将手掌的中心位置或者手的指尖位置作为目标位置,也可以结合虚拟物体的特征进一步判断是将手掌的中心位置还是将指尖位置作为目标位置。例如,对于需要手掌才能抓握的虚拟物体可以采用手掌中心位置作为目标位置(鸡蛋等虚拟物体),对于需要指尖触碰的虚拟物体可以将手指尖的位置作为目标位置(某些按钮键等)。此外,还可以将手的指向位置作为目标位置,相应的传感器需要读取相应手指的指向信息。In some embodiments, the detection target location may be derived from the touch location of the hand as perceived by the sensor. For example, the center position of the palm or the fingertip position of the hand may be used as the target position, or the feature of the virtual object may be further determined whether the center position of the palm or the fingertip position is the target position. For example, for a virtual object that requires a palm to grasp, a palm center position can be used as a target position (a virtual object such as an egg), and a virtual object that requires a fingertip touch can have a fingertip position as a target position (some button keys, etc.) ). In addition, the pointing position of the hand can also be used as the target position, and the corresponding sensor needs to read the pointing information of the corresponding finger.
在一些实施例中,确定所述目标位置处的虚拟物体例如可以采用目标位置与虚拟物体对应关系表获得目标位置处的虚拟物体。例如,预先存储各个位置与虚拟物体的对应关系表,采集当前手指的目标位置,通过查找对应关系表获得位于目标位置处的虚拟物体。目标位置可以采用二维或者三维坐标进行表征。也可以采用标号等字符串进行表征,这时需要对各个放置虚拟位置的位置点进行统一编码,一个虚拟物体与一个编码对应,采用编码表征触摸的目标位置。相应的关系表需要存放编码与虚拟物体的对应关系。In some embodiments, determining the virtual object at the target location may, for example, obtain a virtual object at the target location using the target location and virtual object correspondence table. For example, a correspondence table between each position and a virtual object is stored in advance, a target position of the current finger is acquired, and a virtual object located at the target position is obtained by finding a correspondence table. The target position can be characterized in two or three dimensions. It can also be characterized by a string such as a label. In this case, the position points of each of the placed virtual positions need to be uniformly coded, and a virtual object corresponds to a code, and the target position of the touch is represented by the code. The corresponding relation table needs to store the correspondence between the code and the virtual object.
在一些实施例中,根据所述虚拟物体产生控制信号例如可以为通过虚拟物体的属性信息产生相应的控制信号。或者直接根据虚拟物体产生相应的控制信号,也就是通过预先分析虚拟物体的感知效果进而生成相应的控制信号,当判断出虚拟物体后直接可以读取相应的控制信号。In some embodiments, generating a control signal according to the virtual object may be, for example, generating a corresponding control signal by attribute information of the virtual object. Or directly generate a corresponding control signal according to the virtual object, that is, by analyzing the sensing effect of the virtual object in advance to generate a corresponding control signal, and directly determining the corresponding control signal after determining the virtual object.
上述的控制信号可以为使相应信号发生器启动工作的开启信号或者关闭信号,此外还可以是使得相应信号发生器改变信号强度的信号等。例如,控制信号携带的信息可以依据触摸的虚拟物体的实际特征实时进行调整。The above control signal may be an on signal or a shutdown signal for causing the corresponding signal generator to start operation, and may be a signal or the like that causes the corresponding signal generator to change the signal strength. For example, the information carried by the control signal can be adjusted in real time depending on the actual characteristics of the touched virtual object.
例如,步骤411包含的确定所述目标位置处的虚拟物体,例如可以包括:获取存储的多个虚拟物体的位置信息;依据所述多个虚拟物体的位置信息,识别所述目标位置处的虚拟物体。在一些实施例中,虚拟物体对应的位置可以为一个坐标范围,也可以为虚拟物体中心处的坐标。采用一个坐标范围与虚拟物体对应时,如果目标位置落在某个虚拟物体B的坐标范围时则可知此时触摸的虚拟物体为B;或者如果目标位置落在与某个虚拟物体C的外边缘相近的某个范围时(通过设定阈值调整该范围大小),则可知此时触摸的虚拟物体为C。采用一个坐标值表征各虚拟物体的位置信息时,如果目标位置与某个虚拟物体D的坐标值相同时,则目标位置处的虚拟物体为D;如果目标 位置与某个虚拟物体E的坐标值的差的绝对值足够小(例如该差值小于预定的阈值),则目标位置处的虚拟物体为E。For example, the determining, by the step 411, the virtual object at the target location may include: acquiring location information of the stored plurality of virtual objects; and identifying the virtual location at the target location according to the location information of the plurality of virtual objects. object. In some embodiments, the position corresponding to the virtual object may be a coordinate range or a coordinate at the center of the virtual object. When a coordinate range is used to correspond to a virtual object, if the target position falls within the coordinate range of a certain virtual object B, it can be known that the virtual object touched at this time is B; or if the target position falls on the outer edge of a virtual object C When a certain range is similar (the size of the range is adjusted by setting the threshold), it can be seen that the virtual object touched at this time is C. When a coordinate value is used to represent the position information of each virtual object, if the target position is the same as the coordinate value of a certain virtual object D, the virtual object at the target position is D; if the target position and the coordinate value of a certain virtual object E The absolute value of the difference is small enough (for example, the difference is less than a predetermined threshold), and the virtual object at the target position is E.
例如,步骤421根据所述虚拟物体产生所述控制信号可以包括:获取存储的所述多个虚拟物体的属性信息;依据所述多个虚拟物体的属性信息,获取所述目标位置处的虚拟物体的属性信息;以及依据所述目标位置处的虚拟物体的属性信息生成所述控制信号。例如,属性信息种类可以包括,凉、热、光滑、粗糙、振动等。例如,依据属性信息产生控制信号可以为根据属性信息判断需要开启的信号发生器,并根据属性信息判断信号发生器产生的感知信号的强度或频率等特征信息,之后将该开启信号与特征信息依据通信协议进行封装,生成最终的控制信号。For example, the step 421 of generating the control signal according to the virtual object may include: acquiring the stored attribute information of the plurality of virtual objects; acquiring the virtual object at the target location according to the attribute information of the plurality of virtual objects Attribute information; and generating the control signal according to attribute information of the virtual object at the target location. For example, the attribute information types may include, cool, hot, smooth, rough, vibration, and the like. For example, generating the control signal according to the attribute information may be determining a signal generator that needs to be turned on according to the attribute information, and determining characteristic information such as the intensity or frequency of the sensing signal generated by the signal generator according to the attribute information, and then the opening signal and the characteristic information are based on the information. The communication protocol is encapsulated to generate the final control signal.
例如,步骤431依据所述控制信号产生所述感知信号可以包括:依据所述控制信号产生光信号、电信号、风信号、震动信号、冷信号和热信号中的一个或多个。在一些实施例中,控制信号可以携带光信号的强度信息、或者振动信号的振动频率与振动幅度信息,或者冷热信号的强度信息等。For example, the generating, by the step 431, the sensing signal according to the control signal may include: generating one or more of an optical signal, an electrical signal, a wind signal, a vibration signal, a cold signal, and a thermal signal according to the control signal. In some embodiments, the control signal may carry intensity information of the optical signal, or vibration frequency and vibration amplitude information of the vibration signal, or intensity information of the cold and hot signal, and the like.
在一些实施例中,用户触摸结束时,控制信号还可以包括关闭相应信号发生器的信号指令。In some embodiments, the control signal may also include a signal command to turn off the respective signal generator when the user touch ends.
在一些实施例中,还包括实时监测目标位置是否发生变化的步骤,通过这个步骤可以更新目标位置,并依据更新后的目标位置重复执行上述步骤411至步骤431的操作。In some embodiments, the method further includes the step of monitoring whether the target location changes in real time, by which the target location can be updated, and the operations of the foregoing steps 411 to 431 are repeatedly performed according to the updated target location.
在一些实施例中,由各个信号发生器响应于控制信号分别产生光信号、电信号、风信号、震动信号、冷信号和热信号中的一个或多个。In some embodiments, one or more of the optical signal, the electrical signal, the wind signal, the shock signal, the cold signal, and the thermal signal are generated by the respective signal generators in response to the control signals.
本公开的至少一个实施例提供一种计算机可读存储介质,其上存储有计算机指令,所述计算机指令被处理器执行时实现所述的触觉反馈方法400的一个或多个步骤。At least one embodiment of the present disclosure provides a computer readable storage medium having stored thereon computer instructions that, when executed by a processor, implement one or more steps of the haptic feedback method 400.
本公开的至少一个实施例提供一种电子产品,包括一个或多个处理器,所述处理器被配置为运行计算机指令以执行所述的触觉反馈方法400的一个或多个步骤。At least one embodiment of the present disclosure provides an electronic product comprising one or more processors configured to execute computer instructions to perform one or more steps of the haptic feedback method 400.
本公开实施例在用户手腕处安装传感手环,并有电流、风力发生器通过手环连接悬在手掌周围,当用户的手移动到虚拟物体所处坐标时球状发生器会根据该物体的质地(即属性信息)在手掌周围发出微弱电流、风、冷热等刺激模拟该物体的触感,使得感官体验更加丰富,而由于皮肤裸露在空气中 接触到模拟触感,所以用户体验更加真实。The embodiment of the present disclosure installs a sensing bracelet at the wrist of the user, and has a current, and the wind generator is suspended around the palm of the hand through the wristband. When the user's hand moves to the coordinates of the virtual object, the spherical generator according to the object The texture (ie, attribute information) emits weak current, wind, hot and cold stimuli around the palm to simulate the touch of the object, which makes the sensory experience richer, and the user experience is more realistic because the skin is exposed to the simulated touch in the air.
以上所述,仅为本公开的具体实施方式,但本公开的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本公开揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本公开的保护范围之内。因此,本公开的保护范围应以所述权利要求的保护范围为准。The above is only the specific embodiment of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the disclosure. It should be covered within the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be determined by the scope of the claims.
本公开要求于2017年6月22日递交的中国专利申请第201710481030.2号的优先权,在此全文引用上述中国专利申请公开的内容以作为本申请的一部分。The present disclosure claims priority to Chinese Patent Application No. 201710481030.2, filed on Jun. 22, 2009, the entire disclosure of which is hereby incorporated by reference.

Claims (19)

  1. 一种触觉反馈装置,包括:至少一个连接结构、可穿戴设备和至少一个信号发生器;其中,A haptic feedback device comprising: at least one connection structure, a wearable device and at least one signal generator; wherein
    所述连接结构的一端与所述可穿戴设备相连,所述连接结构的另一端与所述信号发生器相连;One end of the connecting structure is connected to the wearable device, and the other end of the connecting structure is connected to the signal generator;
    所述可穿戴设备被配置为检测目标位置;The wearable device is configured to detect a target location;
    所述信号发生器被配置为依据控制信号产生感知信号,并输出所述感知信号。The signal generator is configured to generate a sensing signal in accordance with the control signal and output the sensing signal.
  2. 根据权利要求1所述的触觉反馈装置,其中,所述可穿戴设备还被配置为:The haptic feedback device of claim 1, wherein the wearable device is further configured to:
    确定所述目标位置处的虚拟物体;Determining a virtual object at the target location;
    根据所述虚拟物体产生所述控制信号;以及Generating the control signal according to the virtual object;
    发送所述控制信号至所述信号发生器。Sending the control signal to the signal generator.
  3. 根据权利要求1所述的触觉反馈装置,还包括,处理设备;The haptic feedback device of claim 1 further comprising a processing device;
    所述处理设备被配置为:The processing device is configured to:
    确定所述目标位置处的虚拟物体;Determining a virtual object at the target location;
    根据所述虚拟物体产生所述控制信号;以及Generating the control signal according to the virtual object;
    发送所述控制信号至所述信号发生器。Sending the control signal to the signal generator.
  4. 根据权利要求2-3任一项所述的触觉反馈装置,其中,A haptic feedback device according to any one of claims 2-3, wherein
    所述连接结构包括:外壳和位于所述外壳内部的信号线;The connection structure includes: a housing and a signal line located inside the housing;
    所述信号线被配置为将所述控制信号从所述可穿戴设备传输至所述信号发生器。The signal line is configured to transmit the control signal from the wearable device to the signal generator.
  5. 根据权利要求4所述的触觉反馈装置,其中,The haptic feedback device according to claim 4, wherein
    所述外壳为可形变材质;以及The outer casing is a deformable material;
    所述可形变材质包括金属。The deformable material comprises a metal.
  6. 根据权利要求1-5任一项所述的触觉反馈装置,其中,所述连接结构为可形变的长杆。The haptic feedback device according to any one of claims 1 to 5, wherein the connecting structure is a deformable long rod.
  7. 根据权利要求1-6任一项所述的触觉反馈装置,其中,The haptic feedback device according to any one of claims 1 to 6, wherein
    所述触觉反馈装置包括多个连接结构和多个信号发生器,所述多个连接结构与所述多个信号发生器一一对应连接;The haptic feedback device includes a plurality of connection structures and a plurality of signal generators, and the plurality of connection structures are connected to the plurality of signal generators in one-to-one correspondence;
    所述多个连接结构分散地设置于所述可穿戴设备;以及The plurality of connection structures are discretely disposed on the wearable device;
    所述多个连接结构的长度不相等。The lengths of the plurality of connection structures are not equal.
  8. 根据权利要求1-7任一项所述的触觉反馈装置,其中,所述可穿戴设备包括第一无线收发器,所述信号发生器包括第二无线收发器,所述可穿戴设备和所述信号放生器通过所述第一无线收发器和所述第二无线收发器进行通信。The haptic feedback device of any of claims 1-7, wherein the wearable device comprises a first wireless transceiver, the signal generator comprises a second wireless transceiver, the wearable device and the A signal producer communicates through the first wireless transceiver and the second wireless transceiver.
  9. 根据权利要求1-8任一项所述的触觉反馈装置,其中,所述可穿戴设备包括传感器,被配置为检测所述目标位置。A haptic feedback device according to any of claims 1-8, wherein the wearable device comprises a sensor configured to detect the target location.
  10. 根据权利要求1-2以及4-9任一项所述的触觉反馈装置,其中,所述可穿戴设备还包括:The haptic feedback device of any of claims 1-2 and 4-9, wherein the wearable device further comprises:
    存储器,被配置为存储多个虚拟物体的位置信息;以及a memory configured to store location information of a plurality of virtual objects;
    处理器,被配置为依据所述多个虚拟物体的位置信息,识别所述目标位置处的虚拟物体。And a processor configured to identify the virtual object at the target location according to the location information of the plurality of virtual objects.
  11. 根据权利要求10所述的触觉反馈装置,其中,The haptic feedback device according to claim 10, wherein
    所述存储器,还被配置为存储所述多个虚拟物体的属性信息;The memory is further configured to store attribute information of the plurality of virtual objects;
    所述处理器,还被配置为:The processor is further configured to:
    依据所述多个虚拟物体的属性信息,获取所述目标位置处的虚拟物体的属性信息;以及Obtaining attribute information of the virtual object at the target location according to the attribute information of the plurality of virtual objects;
    依据所述目标位置处的虚拟物体的属性信息生成所述控制信号。The control signal is generated according to attribute information of the virtual object at the target location.
  12. 根据权利要求1-11任一项所述的触觉反馈装置,其中,The haptic feedback device according to any one of claims 1 to 11, wherein
    所述信号发生器的外形为球状或者漏斗状。The signal generator has a spherical shape or a funnel shape.
  13. 根据权利要求1-11任一项所述的触觉反馈装置,其中,The haptic feedback device according to any one of claims 1 to 11, wherein
    所述信号发生器包括光信号发生器、电信号发生器、风信号发生器、震动器和冷热信号发生器中的一个或多个。The signal generator includes one or more of an optical signal generator, an electrical signal generator, a wind signal generator, a vibrator, and a thermal signal generator.
  14. 一种触觉反馈方法,包括:A method of haptic feedback, comprising:
    检测目标位置;Detecting the target position;
    确定所述目标位置处的虚拟物体;Determining a virtual object at the target location;
    根据所述虚拟物体产生控制信号;以及Generating a control signal based on the virtual object;
    依据所述控制信号产生感知信号,并输出所述感知信号。A sensing signal is generated according to the control signal, and the sensing signal is output.
  15. 如权利要求14所述的触觉反馈方法,其中,所述确定所述目标位置处的虚拟物体,包括:The haptic feedback method of claim 14, wherein the determining the virtual object at the target location comprises:
    获取存储的多个虚拟物体的位置信息;Obtaining location information of the stored plurality of virtual objects;
    依据所述多个虚拟物体的位置信息,识别所述目标位置处的虚拟物体。Identifying the virtual object at the target location according to the location information of the plurality of virtual objects.
  16. 如权利要求14-15任一项所述的触觉反馈方法,其中,根据所述虚拟物体产生所述控制信号,包括:The haptic feedback method according to any one of claims 14-15, wherein generating the control signal according to the virtual object comprises:
    获取存储的所述多个虚拟物体的属性信息;Obtaining attribute information of the stored plurality of virtual objects;
    依据所述多个虚拟物体的属性信息,获取所述目标位置处的虚拟物体的属性信息;以及Obtaining attribute information of the virtual object at the target location according to the attribute information of the plurality of virtual objects;
    依据所述目标位置处的虚拟物体的属性信息生成所述控制信号。The control signal is generated according to attribute information of the virtual object at the target location.
  17. 如权利要求14-16任一项所述的触觉反馈方法,其中,所述依据所述控制信号产生所述感知信号,包括:The haptic feedback method according to any one of claims 14 to 16, wherein the generating the sensing signal according to the control signal comprises:
    依据所述控制信号产生光信号、电信号、风信号、震动信号、冷信号和热信号中的一个或多个。One or more of an optical signal, an electrical signal, a wind signal, a vibration signal, a cold signal, and a thermal signal are generated according to the control signal.
  18. 一种计算机可读存储介质,其上存储有计算机指令,所述计算机指令被处理器执行时实现如权利要求14-17中任一项所述的方法的一个或多个步骤。A computer readable storage medium having stored thereon computer instructions that, when executed by a processor, implement one or more steps of the method of any of claims 14-17.
  19. 一种电子产品,包括一个或多个处理器,所述处理器被配置为运行计算机指令以执行如权利要求14-17中任一项所述的方法的一个或多个步骤。An electronic product comprising one or more processors, the processor being configured to execute computer instructions to perform one or more steps of the method of any of claims 14-17.
PCT/CN2018/081724 2017-06-22 2018-04-03 Haptic feedback apparatus and method, readable storage medium and electronic product WO2018233344A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710481030.2A CN107239145B (en) 2017-06-22 2017-06-22 Haptic feedback device and method
CN201710481030.2 2017-06-22

Publications (1)

Publication Number Publication Date
WO2018233344A1 true WO2018233344A1 (en) 2018-12-27

Family

ID=59987740

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/081724 WO2018233344A1 (en) 2017-06-22 2018-04-03 Haptic feedback apparatus and method, readable storage medium and electronic product

Country Status (2)

Country Link
CN (1) CN107239145B (en)
WO (1) WO2018233344A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107239145B (en) * 2017-06-22 2020-03-31 京东方科技集团股份有限公司 Haptic feedback device and method
TWI707251B (en) * 2019-01-03 2020-10-11 晶翔機電股份有限公司 Operating method of interacting with a virtual reality for depending on a wearable device and operating device thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105630156A (en) * 2014-11-25 2016-06-01 意美森公司 Systems and methods for deformation-based haptic effects
CN106227339A (en) * 2016-08-16 2016-12-14 西安中科比奇创新科技有限责任公司 wearable device, virtual reality human-computer interaction system and method
CN106873775A (en) * 2017-01-16 2017-06-20 深圳中科呼图电子商务有限公司 A kind of implementation method of virtual reality interaction, system and MR gloves
CN107239145A (en) * 2017-06-22 2017-10-10 京东方科技集团股份有限公司 Haptic feedback devices and method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015015428A1 (en) * 2013-08-01 2015-02-05 Woodroffe Mark Touch communications device and method
US9645647B2 (en) * 2015-05-13 2017-05-09 Immersion Corporation Systems and methods for haptic feedback for modular devices
CN106557155A (en) * 2015-09-29 2017-04-05 杨挺 Virtual reality impression system based on VR glasses

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105630156A (en) * 2014-11-25 2016-06-01 意美森公司 Systems and methods for deformation-based haptic effects
CN106227339A (en) * 2016-08-16 2016-12-14 西安中科比奇创新科技有限责任公司 wearable device, virtual reality human-computer interaction system and method
CN106873775A (en) * 2017-01-16 2017-06-20 深圳中科呼图电子商务有限公司 A kind of implementation method of virtual reality interaction, system and MR gloves
CN107239145A (en) * 2017-06-22 2017-10-10 京东方科技集团股份有限公司 Haptic feedback devices and method

Also Published As

Publication number Publication date
CN107239145B (en) 2020-03-31
CN107239145A (en) 2017-10-10

Similar Documents

Publication Publication Date Title
CN108170262B (en) Haptic surround function
US11360558B2 (en) Computer systems with finger devices
US11016569B2 (en) Wearable device and method for providing feedback of wearable device
JP6669069B2 (en) Detection device, detection method, control device, and control method
JP6155448B2 (en) Wireless wrist computing and controlling device and method for 3D imaging, mapping, networking and interfacing
EP3588250A1 (en) Real-world haptic interactions for a virtual reality user
CN104094196B (en) For the system and method for the enhanced interaction based on posture
US6222523B1 (en) Tactile feedback mechanism for a data processing system
KR20150129621A (en) Systems and methods for providing haptic feedback for remote interactions
KR101548156B1 (en) A wireless exoskeleton haptic interface device for simultaneously delivering tactile and joint resistance and the method for comprising the same
KR20170069936A (en) Systems and methods for position-based haptic effects
JP2017527039A (en) 3D Contextual Feedback
CN110168485A (en) Augmented reality control to Internet of things device
JP2018136938A (en) Automatic localized haptics generation system
US6885361B1 (en) Tactile feedback mechanism for a data processing system
KR20140107062A (en) Posture training system and method of control thereof
US20230070523A1 (en) System and method for representing virtual object information with haptic stimulation
EP3489804A1 (en) Haptic accessory apparatus
CN114730215A (en) System and method for remotely controlling devices in an environment
WO2014185808A1 (en) System and method for controlling multiple electronic devices
WO2018233344A1 (en) Haptic feedback apparatus and method, readable storage medium and electronic product
WO2019083406A1 (en) Method of producing a virtual reality glove (embodiments)
CN106020468A (en) Glove controlled augmented reality system
US20200166990A1 (en) Device and methodology for the interaction through gestures and movements of human limbs and fingers
KR20140106309A (en) Input device for virual reality having the fuction of forth-feedback

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18821422

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 29.05.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18821422

Country of ref document: EP

Kind code of ref document: A1