WO2018126682A1 - 用于在虚拟现实系统中提供触觉反馈的方法及装置 - Google Patents
用于在虚拟现实系统中提供触觉反馈的方法及装置 Download PDFInfo
- Publication number
- WO2018126682A1 WO2018126682A1 PCT/CN2017/096617 CN2017096617W WO2018126682A1 WO 2018126682 A1 WO2018126682 A1 WO 2018126682A1 CN 2017096617 W CN2017096617 W CN 2017096617W WO 2018126682 A1 WO2018126682 A1 WO 2018126682A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- information
- virtual
- state information
- objects
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
Definitions
- This document relates to, but is not limited to, virtual reality technology and, more particularly, to methods and apparatus for providing haptic feedback in a virtual reality system.
- Virtual reality technology is a computer simulation system that can create and experience a virtual world. It uses a computer to generate a simulation environment. The user is immersed in the environment through interactive 3D dynamic view of multi-source information fusion and system simulation of physical behavior.
- the display screen is filled with the viewer's line of sight mainly through a computer simulation system. Users get a good sense of immersion through a computer-generated simulation environment.
- virtual reality technology mainly gives users a sense of immersion in visual display, and the user's experience of using virtual reality is single.
- the user when the user wears the virtual display device, the user generally needs to be fixed within a certain range (sitting or standing) because the location of the person and the object in the user's environment cannot be accurately grasped. Users are affected by the scope of activities and cannot be fully invested in virtual reality scenarios. If the user is fully engaged in the virtual display scene, the user involuntarily generates physical activity, it is easy to collide with the person or object in the user's environment, causing human body collision or object damage, affecting the user's experience.
- Embodiments of the present disclosure provide a method for providing haptic feedback in a virtual reality system And devices that can enhance the user experience of virtual reality.
- a method for providing haptic feedback in a virtual reality system is provided.
- state information of one or more virtual objects in a virtual scene presented in the virtual reality system and/or one or more real objects in an external environment of a user using the virtual reality system is acquired.
- the haptic feedback information is generated based on the status information.
- Tactile feedback is provided to the user based on the tactile feedback information.
- acquiring state information of one or more real objects in an external environment of a user using the virtual reality system includes detecting motion state information of one or more real objects in the external environment.
- the motion state information includes at least one of the following: a position, a moving direction, and a moving speed.
- generating the haptic feedback information according to the state information includes determining a distance between the user and the one or more real objects according to the motion state information of the one or more real objects.
- the distance-based feedback strength information corresponding to one or more real objects is generated as touch feedback information.
- providing the tactile feedback to the user according to the tactile feedback information includes: providing a pressure corresponding to the feedback intensity information to the user; and/or providing the user with a shock corresponding to the feedback intensity information.
- acquiring state information of one or more virtual objects in the virtual scene presented in the virtual reality system includes: identifying one or more virtual objects in the virtual scene; and determining one or more The physical state information corresponding to the virtual objects.
- Physical state information includes softness and/or roughness.
- generating the haptic feedback information according to the state information includes: generating, according to the physical state information of the one or more virtual objects, touch sensing information respectively corresponding to the one or more virtual objects as the haptic feedback information.
- the touch sensing information includes the magnitude of the force required to sense the softness and/or roughness of the object.
- providing the haptic feedback to the user according to the haptic feedback information includes determining the touched virtual object in the image according to a touch position of the user on the touch screen displaying the image of the virtual scene.
- providing tactile feedback to the user according to the tactile feedback information further includes detecting a touch pressure of the user.
- a voltage signal is provided to the touch screen in response to the touch pressure being greater than a predetermined threshold.
- an apparatus for providing haptic feedback in a virtual reality system comprising: one or more processors; a memory coupled to the processor and storing the computer Program instructions, wherein the computer program instructions, when executed by the processor, cause the apparatus to: acquire one of a virtual object in a virtual scene presented in the virtual reality system and/or one of an external environment of a user using the virtual reality system Or status information of the plurality of real objects; generating haptic feedback information according to the status information; and providing haptic feedback to the user according to the haptic feedback information.
- the computer program instructions when executed by the processor, cause the device to detect motion state information for one or more real objects in the external environment.
- the motion state information includes at least one of the following: a position, a moving direction, and a moving speed.
- the computer program instructions when executed by the processor, cause the apparatus to determine a distance between the user and the one or more real objects based on motion state information of the one or more real objects; and generate an The distance-based feedback strength information corresponding to the plurality of real objects is used as the haptic feedback information.
- the computer program instructions when executed by the processor, cause the device to provide pressure to the user corresponding to the feedback strength information; and/or provide the user with a shock corresponding to the feedback strength information.
- the computer program instructions when executed by the processor, cause the device to identify one or more virtual objects in the virtual scene and determine physical state information corresponding to the one or more virtual objects, respectively.
- Physical state information including softness and/or roughness
- the computer program instructions when executed by the processor, cause the device to generate touch sensing information corresponding to one or more virtual objects according to physical state information of the one or more virtual objects as haptic feedback. information.
- the touch sensing information includes the magnitude of the force required to sense the softness and/or roughness of the object.
- the computer program instructions when executed by the processor, cause the apparatus to determine a touched virtual object in the image according to a touch location of the user on the touch screen displaying the image of the virtual scene; based on the touch perception information, A voltage signal is provided to the touch screen; and based on the voltage signal, an induced capacitance and an electrostatic force are generated at the touched position.
- the computer program instructions when executed by the processor, cause the device to detect a user's touch pressure; wherein the voltage signal is provided to the touch screen in response to the touch pressure being greater than a predetermined threshold.
- FIG. 1 is a flowchart of a method for providing haptic feedback in a virtual reality system, in accordance with an embodiment of the present disclosure
- FIG. 2 is a schematic diagram of analysis of establishing a difference frequency and a target distance
- Figure 3 is a schematic diagram of the comparison of actual speed and radial speed
- FIG. 4 is a schematic diagram showing the geometric structure of calculating a plane direction angle
- Figure 5 is a schematic diagram showing the geometric distribution of positioning
- FIG. 6 is a schematic structural diagram of a touch screen in the related art
- FIG. 7 is a schematic block diagram of an apparatus for providing haptic feedback in a virtual reality system, in accordance with an embodiment of the present disclosure
- FIG. 8 is a schematic block diagram of an apparatus for providing haptic feedback in a virtual reality system, in accordance with another embodiment of the present disclosure.
- FIG. 1 is a flow chart of a method for providing haptic feedback in a virtual reality system, in accordance with an embodiment of the present disclosure.
- step 110 one or more virtual objects in a virtual scene presented in a virtual reality system and/or states of one or more real objects in an external environment of a user using the virtual reality system are acquired. information.
- step 120 haptic feedback information is generated based on the acquired status information.
- step 130 haptic feedback is provided to the user based on the generated haptic feedback information.
- step 110 motion state information of one or more real objects in the external environment, such as at least one of a position, a moving direction, and a moving speed information, is first detected.
- a motion sensor such as a radar sensor or an infrared sensor.
- Radar sensors may include antennas, transceivers, signal generation and modulation units, signal processing units, and the like.
- the radar sensor will generate and modulate the radar signal used to detect the motion state information, and transmit the radar signal through the antenna to the external environment where the user is located.
- the radar signal reflects the object and reflects it to form a reflected signal.
- Signal processing and calculation of the reflected signal such as amplification, filtering, mixing, etc., to obtain the position, moving direction and moving speed of the detected object.
- the relative velocity of the object can be calculated by the direction of movement and the speed of movement.
- the radar signal can be a frequency modulated continuous wave, and there is a frequency difference between the echo signal and the transmitted signal.
- the frequency difference is a function of distance and can be measured by a mixer.
- the target distance (the distance between the user and the object) can be obtained by substituting the frequency difference into the function.
- Figure 2 shows an analytical diagram for establishing the relationship between the frequency difference and the target distance.
- the solid line portion indicates the transmission signal (i.e., the transmission signal), and the broken line portion indicates the reception signal (i.e., the echo signal). Referring to the relevant parameters in Fig. 2, the process of calculating the target distance can be understood.
- the relative velocity of the object may be calculated based on the Doppler principle.
- the measured frequency difference signal is substituted into a second function to obtain a relative speed.
- Figure 3 shows a comparison of actual speed versus radial speed. Referring to Figure 3, the amount of frequency shift produced by the object moving toward or away from the radar is the same, with the target moving to the radar frequency shift positive and the target moving away from the radar frequency shift negative.
- the relative angle of the object can be calculated based on the phase difference of the receiving array.
- the phase difference of the echo signal reaching the adjacent receiving array unit is measured, and the third function is substituted to obtain the plane direction angle.
- the third function can be expressed as: 4 is a schematic diagram of the geometrical structure for calculating the plane direction angle, as shown in FIG. 4, ⁇ is the direction angle of the measurement target, For the phase difference, ⁇ is the wavelength and d is the spacing of the two receiving elements. Positioning can be achieved by accepting the array in a reasonable arrangement, for example using three receiving elements.
- Figure 5 is a schematic diagram of the geometric distribution of positioning. As shown in FIG. 5, the array element 1 is centered, and the azimuth angle is measured according to the array element 2 of the peer. The elevation angle ⁇ is measured based on the array element 3 in the same column.
- the distance between the user and the one or more real objects may be determined based on the acquired motion state information of the one or more real objects. Thereby, distance-based feedback strength information respectively corresponding to one or more real objects is generated as haptic feedback information.
- step 130 the user is provided with a pressure corresponding to the feedback strength information, such as with a pressure device.
- the user is provided with a shock corresponding to the feedback strength information, for example, using a vibration device.
- a predetermined ultrasonic device may be employed to transmit ultrasonic waves to the user according to the generated feedback intensity information to apply a force corresponding to the distance to the user.
- ultrasound The wave device applies a distance-based pressure to the user's face and/or chest based on the tactile feedback information.
- the vibration device is driven to vibrate according to the generated feedback strength information by using a preset vibration device to generate a vibration corresponding to the distance.
- the force of the ultrasonic wave should be increased accordingly.
- the vibration frequency is correspondingly increased, and the tactile feedback is used to prompt the user that the object is constantly approaching.
- the ultrasonic and/or vibrating device performs the opposite process.
- Embodiments of the present disclosure may provide tactile feedback based on the distance of the user from the object. That is to say, when using the virtual reality technology, if the distance between the user and the object changes in the environment where the user is located, the dynamically changing feedback strength information can be set. For example, in the external environment in which the user wearing the virtual reality device is located, if the user quickly approaches the object or someone approaches the user quickly, the user can clearly feel the pressure due to the reduced distance based on the feedback strength information. Conversely, when a person quickly moves away from the user or the user is away from the object, according to the tactile feedback, the user can clearly feel that the pressure gradually decreases due to the increase in the distance.
- the user can know the motion state of the surrounding human body or object through tactile sensing. Therefore, the user can be more relaxed and devoted to the virtual reality scene without worrying about the human body or object colliding with the user's environment, thereby obtaining a better user experience.
- the pressure can be set to be related to the moving speed of the object. For example, when the speed changes rapidly, the pressure can be set to change faster. When the speed changes slowly, the pressure change can be set to be slower.
- step 110 one or more virtual objects in the virtual scene are identified and physical state information corresponding to the one or more virtual objects are determined.
- the physical state information is, for example, the softness and roughness of the object that the user feels when touching the real object.
- the image capture device may be used to acquire an image in the virtual scene, and after the feature image is extracted from the acquired image, the extracted feature points are matched with the feature points used for image matching stored in the database in advance, and the virtual The virtual object contained in the scene.
- an object in the virtual scene can be identified by a preset identifier to acquire an object displayed in the display screen. The identifier of the displayed object is determined by the acquired identifier.
- Image matching can also be used to perform image matching processing using an existing feature database and perform certain calculations. It is also possible to identify the object by using the identifier, which requires the identifier to be set in advance in a one-to-one correspondence, and the method does not need to perform matching calculation.
- the touch sensing information corresponding to the one or more virtual objects may be generated according to the physical state information of the one or more virtual objects, as the tactile feedback information, for example, the softness of the perceived object And/or the amount of force required for roughness.
- step 130 an image corresponding to the image in the virtual scene is displayed on the touch screen, and the touched virtual object in the image is determined according to the touch position of the user on the touch screen.
- a voltage signal is supplied to the touch screen based on the generated touch sensing information. And based on the supplied voltage signal, an induced capacitance and an electrostatic force are generated at the touch position of the touch screen.
- the touch screen includes a glass substrate, a transfer (Tx) electrode and a receiving (Rx) electrode at the glass, and an insulating layer.
- the Tx electrode can receive the first voltage signal and Rx can receive the second voltage signal.
- the touched object may be determined according to the touch position of the user, and based on the attribute information of the touched object, the first voltage signal and the second voltage signal are generated to be provided at the touch position Tx electrode and Rx electrode.
- an induced capacitance can be generated between the finger and the overlapping region of the Tx electrode and the Rx electrode, and an electrostatic force acting on the finger is generated, so that the user can obtain a tactile sense of the touched object. Therefore, when the user's finger touches the touch screen, the finger can obtain an electrostatic force, so that tactile sensing can be obtained. Further, when the user's finger slides, the electrostatic force can also change due to the change in the area of the overlapping area of the finger with the Tx electrode and the Rx electrode.
- first voltage signals and second voltage signals may be provided for different touched objects. Since different voltage signals can match different electrostatic forces, Different electrostatic forces correspond to different tactile sensations, so the user can feel different objects (such as cashmere, linen, rock, etc.).
- the attribute information of the various objects and the voltage signal corresponding thereto may be stored in the storage unit in advance so that a voltage signal corresponding to the attribute information of the touched object can be acquired from the storage unit.
- a voltage signal is provided to the touch screen in response to the touch pressure being greater than a predetermined threshold. Therefore, in the case that the pressure on the touch screen is greater than the set preset threshold, it is determined that the user performs an operation of touching the object in the virtual scene, so that the time for the user to obtain the tactile feedback is more accurate and the experience is better.
- the virtual button of the embodiment of the present disclosure may generate a texture pattern corresponding to the content represented by the virtual button based on the method for generating the haptic sensing information according to the embodiment of the present disclosure.
- the principle of tactile feedback based on tactile perception information on the display screen generates a button that can touch the direction icon.
- a method for providing haptic feedback in a virtual reality system is capable of performing haptic feedback according to state information of an object.
- the user can know the motion state of the human body or the object in the environment where the user is in the virtual reality technology, so that the user can deeply invest in the virtual scene according to the tactile feedback.
- the experience of the virtual reality technology can be improved according to the tactile feedback.
- the embodiments of the present disclosure implement haptic feedback when the virtual reality interacts, and improve the user experience of the virtual reality.
- FIG. 7 shows a schematic block diagram of an apparatus 700 for providing haptic feedback in a virtual reality system, in accordance with an embodiment of the present disclosure.
- device 700 includes one or more processors 710 and memory 720.
- the memory 720 and the processor 710 are coupled to the I/O interface via a bus and store computer program instructions.
- the computer program instructions when executed by the processor 710, cause the apparatus 700 to perform: acquiring one or more virtual objects in a virtual scene presented in the virtual reality system and/or one or more of an external environment of a user using the virtual reality system
- the status information of the real objects, the haptic feedback information is generated according to the status information, and the haptic feedback is provided to the user according to the haptic feedback information.
- the device 700 can detect a motion status letter of one or more real objects in the external environment by a motion sensor, such as a radar sensor or the like. Information such as position, direction of movement and speed of movement.
- the device 700 can determine the distance between the user and one or more real objects based on the motion state information of one or more real objects.
- the device 700 generates distance-based feedback strength information corresponding to one or more real objects, respectively, as haptic feedback information.
- the device 700 may provide a pressure to the user corresponding to the feedback intensity information through the pressure device, and/or provide the user with a shock corresponding to the feedback intensity information through the vibration device.
- the device 700 can identify one or more virtual objects in the virtual scene, and determine physical state information corresponding to one or more virtual objects, such as softness, roughness, and the like.
- the device 700 may further generate touch sensing information corresponding to the virtual object according to the physical state information of the virtual object as the haptic feedback information.
- the touch sensing information includes, for example, the softness of the object, the magnitude of the force required for the roughness, and the like.
- the device 700 may determine the touched virtual object in the image according to the touch position of the user on the touch screen displaying the image of the virtual scene, and provide a voltage signal to the touch screen based on the touch sensing information of the touched virtual object, thereby based on the voltage
- the signal produces induced capacitance and electrostatic force on the touch screen.
- device 700 can also detect the user's touch pressure. A voltage signal is provided to the touch screen in response to the touch pressure being greater than a predetermined threshold.
- FIG. 8 shows a schematic block diagram of an apparatus 800 for providing haptic feedback in a virtual reality system, in accordance with an embodiment of the present disclosure.
- device 800 includes an acquisition device 810, a generation device 820, and a feedback device 830.
- the acquisition device 810 can acquire state information of one or more virtual objects in the virtual scene presented in the virtual reality system and/or one or more real objects in the external environment of the user using the virtual reality system.
- the generating device 820 can generate haptic feedback information based on the status information.
- Feedback device 830 can provide haptic feedback to the user based on the haptic feedback information.
- the acquisition device 810 includes a detection determination unit 812 and/or an identification determination unit 814.
- the detection determination unit 812 can detect motion state information of one or more real objects in the external environment, such as a position, a moving direction, a moving speed, and the like.
- the recognition determining unit 814 can identify one or more virtual objects in the virtual scene and determine physical state information corresponding to one or more virtual objects, such as softness, roughness, and the like.
- the generating device 820 includes an intensity generating unit 822 and/or a perceptual generating unit 824.
- the intensity generating unit 822 may determine a distance between the user and the one or more real objects according to the motion state information of the one or more real objects, and generate distance-based feedback strength information corresponding to the one or more real objects, respectively.
- the sensing generation unit 824 may generate touch sensing information corresponding to one or more virtual objects as haptic feedback information according to physical state information of one or more virtual objects.
- the touch sensing information includes the magnitude of the force required to sense the softness and/or roughness of the object, and the like.
- the Feedback device 830 includes an intensity feedback unit 834.
- the intensity feedback unit 834 can provide the user with a pressure corresponding to the feedback strength information, and/or provide the user with a shock corresponding to the feedback intensity information.
- the intensity feedback unit 834 can also determine the touched virtual object in the image according to the touch position of the user on the touch screen displaying the image of the virtual scene, and provide the touch screen based on the touch sensing information of the touched virtual object.
- the voltage signal and based on the voltage signal, generates an induced capacitance and an electrostatic force on the touch screen.
- the feedback device 830 may further include a trigger unit 832 to detect a user's touch pressure. In response to the touch pressure being greater than a predetermined threshold, the trigger unit 832 can provide a voltage signal to the touch screen.
- each module/unit/device in the foregoing embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, being stored in a memory by a processor.
- the program/instruction in it to implement its corresponding function is not limited to any specific form of combination of hardware and software.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (16)
- 一种用于在虚拟现实系统中提供触觉反馈的方法,包括:获取在所述虚拟现实系统中呈现的虚拟场景中的一个或多个虚拟物体和/或使用所述虚拟现实系统的用户的外部环境中的一个或多个真实物体的状态信息;根据所述状态信息生成触觉反馈信息;以及根据所述触觉反馈信息向所述用户提供触觉反馈。
- 根据权利要求1所述的方法,其中,所述获取使用虚拟现实系统的用户的外部环境中的一个或多个真实物体的状态信息包括:检测所述外部环境中的所述一个或多个真实物体的运动状态信息;其中,所述运动状态信息包括以下的至少一个:位置、移动方向、和移动速度。
- 根据权利要求2所述的方法,其中,所述根据所述状态信息生成触觉反馈信息包括:根据所述一个或多个真实物体的运动状态信息,确定所述用户与所述一个或多个真实物体之间的距离;以及生成与所述一个或多个真实物体分别对应的基于所述距离的反馈强度信息,作为所述触觉反馈信息。
- 根据权利要求3所述的方法,其中,所述根据所述触觉反馈信息向所述用户提供触觉反馈包括:向所述用户提供与所述反馈强度信息相对应的压力;和/或向所述用户提供与所述反馈强度信息相对应的震动。
- 根据权利要求1至4中的任一项所述的方法,其中,所述获取在虚拟现实系统中呈现的虚拟场景中的一个或多个虚拟物体的状态信息包括:识别所述虚拟场景中的所述一个或多个虚拟物体;以及确定与所述一个或多个虚拟物体分别对应的物理状态信息;其中,所述物理状态信息包括软硬度和/或粗糙度。
- 根据权利要求5所述的方法,其中,所述根据所述状态信息生成触 觉反馈信息包括:根据所述一个或多个虚拟物体的所述物理状态信息,生成与所述一个或多个虚拟物体分别对应的触碰感知信息,作为所述触觉反馈信息;其中,所述触碰感知信息包括:感知物体的软硬度和/或粗糙度所需的力的大小。
- 根据权利要求6所述的方法,其中,所述根据所述触觉反馈信息向所述用户提供触觉反馈包括:根据所述用户在显示所述虚拟场景的图像的触摸屏上的触摸位置,确定所述图像中的被触摸的虚拟物体;基于所述被触摸的虚拟物体的所述触碰感知信息,向所述触摸屏提供电压信号;以及基于所述电压信号,在所述触摸位置处产生感应电容和静电力。
- 根据权利要求7所述的方法,其中,所述根据所述触觉反馈信息向所述用户提供触觉反馈还包括:检测所述用户的触摸压力;其中,响应于所述触摸压力大于预设阈值,向所述触摸屏提供所述电压信号。
- 一种用于在虚拟现实系统中提供触觉反馈的装置,包括:一个或多个处理器;存储器,其与所述处理器耦接,并存储有计算机程序指令,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:获取在所述虚拟现实系统中呈现的虚拟场景中的一个或多个虚拟物体和/或使用所述虚拟现实系统的用户的外部环境中的一个或多个真实物体的状态信息;根据所述状态信息生成触觉反馈信息;以及根据所述触觉反馈信息向所述用户提供触觉反馈。
- 根据权利要求9所述的装置,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:检测所述外部环境中的所述一个或多个真实物体的运动状态信息;其中,所述运动状态信息包括以下的至少一个:位置、移动方向、和移动速度。
- 根据权利要求10所述的装置,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:根据所述一个或多个真实物体的运动状态信息,确定所述用户与所述一个或多个真实物体之间的距离,并生成与所述一个或多个真实物体分别对应的基于所述距离的反馈强度信息,作为所述触觉反馈信息。
- 根据权利要求11所述的装置,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:向所述用户提供与所述反馈强度信息相对应的压力;和/或向所述用户提供与所述反馈强度信息相对应的震动。
- 根据权利要求9至12中的任一项所述的装置,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:识别所述虚拟场景中的所述一个或多个虚拟物体;以及确定与所述一个或多个虚拟物体分别对应的物理状态信息;其中,所述物理状态信息包括软硬度和/或粗糙度。
- 根据权利要求13所述的装置,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:根据所述一个或多个虚拟物体的所述物理状态信息,生成与所述一个或多个虚拟物体分别对应的触碰感知信息,作为所述触觉反馈信息;其中,所述触碰感知信息包括:感知物体的软硬度和/或粗糙度所需的力的大小。
- 根据权利要求14所述的装置,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:根据所述用户在显示所述虚拟场景的图像的触摸屏上的触摸位置,确定所述图像中的被触摸的虚拟物体;基于所述被触摸的虚拟物体的所述触碰感知信息,向所述触摸屏提供 电压信号;以及基于所述电压信号,在所述触摸位置处产生感应电容和静电力。
- 根据权利要求15所述的装置,其中,所述计算机程序指令在被所述处理器执行时使得所述装置:检测所述用户的触摸压力;其中,响应于所述触摸压力大于预设阈值,向所述触摸屏提供所述电压信号。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/751,211 US20200201436A1 (en) | 2017-01-03 | 2017-08-09 | Method and device for providing haptic feedback in virtual reality system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710002398.6 | 2017-01-03 | ||
CN201710002398.6A CN106843475A (zh) | 2017-01-03 | 2017-01-03 | 一种实现虚拟现实交互的方法及系统 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018126682A1 true WO2018126682A1 (zh) | 2018-07-12 |
Family
ID=59117177
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/096617 WO2018126682A1 (zh) | 2017-01-03 | 2017-08-09 | 用于在虚拟现实系统中提供触觉反馈的方法及装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20200201436A1 (zh) |
CN (1) | CN106843475A (zh) |
WO (1) | WO2018126682A1 (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112991552A (zh) * | 2021-03-10 | 2021-06-18 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | 人体虚实匹配方法、装置、设备及存储介质 |
CN113342171A (zh) * | 2021-06-15 | 2021-09-03 | 华北科技学院(中国煤矿安全技术培训中心) | 一种在虚拟现实空间中实时生成可触摸实体的方法和装置 |
CN114428483A (zh) * | 2022-01-26 | 2022-05-03 | 上海三一重机股份有限公司 | 作业机械遥控端力反馈控制方法、装置及系统 |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106843475A (zh) * | 2017-01-03 | 2017-06-13 | 京东方科技集团股份有限公司 | 一种实现虚拟现实交互的方法及系统 |
US11402910B2 (en) * | 2017-12-01 | 2022-08-02 | Verizon Patent And Licensing Inc. | Tactile feedback array control |
CN108008820B (zh) * | 2017-12-14 | 2021-09-21 | 深圳位形空间科技有限公司 | 重定向行走方法、重定向行走服务器及重定向行走系统 |
CN108874123A (zh) * | 2018-05-07 | 2018-11-23 | 北京理工大学 | 一种通用的模块化的虚拟现实被动力触觉反馈系统 |
CN108874125A (zh) * | 2018-05-28 | 2018-11-23 | 徐州昇科源信息技术有限公司 | 一种虚拟皮肤表面实时力反馈交互系统 |
DE102018209212A1 (de) * | 2018-06-11 | 2019-12-12 | Robert Bosch Gmbh | Verfahren und Vorrichtung zum Erzeugen eines vorbestimmten Schallwellensolldrucks an einer variablen Position eines Bedienraums und Bedienvorrichtung mit einer Vorrichtung für ein Fahrzeug |
CN112673334B (zh) * | 2018-09-11 | 2024-06-25 | 索尼公司 | 信息处理装置、信息处理方法和记录介质 |
CN110928472B (zh) * | 2018-09-19 | 2023-05-05 | 阿里巴巴集团控股有限公司 | 物品处理方法、装置及电子设备 |
CN109582132B (zh) * | 2018-11-01 | 2024-03-22 | 深圳岱仕科技有限公司 | 手部机械外骨骼及其反馈控制方法 |
CN109656361B (zh) * | 2018-12-11 | 2021-06-04 | 吉林大学 | 一种以平移交互效率为指标的最优驱动电压选择方法 |
CN109683713A (zh) * | 2018-12-27 | 2019-04-26 | 珠海市魅族科技有限公司 | 一种基于触觉反馈的交互方法及其相关设备 |
CN109960411A (zh) * | 2019-03-19 | 2019-07-02 | 上海俊明网络科技有限公司 | 一种辅助vr观测的可触摸式建筑素材数据库 |
CN110322268A (zh) * | 2019-05-09 | 2019-10-11 | 深圳报业集团控股公司 | 一种基于回波信号的场景交互系统及交互方法 |
CN110321002A (zh) * | 2019-05-09 | 2019-10-11 | 深圳报业集团控股公司 | 一种场景交互系统及交互方法 |
CN110286760B (zh) * | 2019-06-19 | 2023-05-12 | 重庆城市管理职业学院 | 一种用于虚拟现实的力反馈控制方法及装置 |
US11347312B1 (en) * | 2019-09-23 | 2022-05-31 | Apple Inc. | Ultrasonic haptic output devices |
CN111103973A (zh) * | 2019-11-11 | 2020-05-05 | 深圳岱仕科技有限公司 | 模型处理方法、装置、计算机设备和存储介质 |
CN112034979B (zh) * | 2020-07-31 | 2022-03-08 | 西安交通大学 | 一种基于力反馈的可穿戴飞行感觉反馈系统 |
CN112540674A (zh) * | 2020-12-09 | 2021-03-23 | 吉林建筑大学 | 虚拟环境交互方法及设备 |
CN116136720A (zh) * | 2021-11-18 | 2023-05-19 | 华为技术有限公司 | 触觉反馈装置及虚拟现实交互设备 |
US11983321B1 (en) * | 2023-04-10 | 2024-05-14 | Htc Corporation | Hand-free haptic feedback system and method |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080094351A1 (en) * | 2006-10-23 | 2008-04-24 | Canon Kabushiki Kaisha | Information processing apparatus and information processing method |
CN104035561A (zh) * | 2014-06-11 | 2014-09-10 | 京东方科技集团股份有限公司 | 触觉反馈系统、方法和触摸显示装置 |
CN105893928A (zh) * | 2015-12-21 | 2016-08-24 | 乐视致新电子科技(天津)有限公司 | 虚拟现实设备及虚拟现实设备提供的避障方法 |
CN106155322A (zh) * | 2016-06-30 | 2016-11-23 | 联想(北京)有限公司 | 信息处理方法、电子设备以及控制系统 |
CN106843475A (zh) * | 2017-01-03 | 2017-06-13 | 京东方科技集团股份有限公司 | 一种实现虚拟现实交互的方法及系统 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130063560A1 (en) * | 2011-09-12 | 2013-03-14 | Palo Alto Research Center Incorporated | Combined stereo camera and stereo display interaction |
US9235265B2 (en) * | 2012-05-17 | 2016-01-12 | Sharp Kabushiki Kaisha | Touch-screen device including tactile feedback actuator |
TWI501109B (zh) * | 2012-11-05 | 2015-09-21 | Univ Nat Taiwan | 擬真觸覺力回饋裝置及其方法 |
CN103793062B (zh) * | 2014-03-05 | 2016-09-28 | 吉林大学 | 应用阻抗检测的自适应多点静电力触觉再现装置及方法 |
US10449445B2 (en) * | 2014-12-11 | 2019-10-22 | Elwha Llc | Feedback for enhanced situational awareness |
US10225442B2 (en) * | 2015-02-16 | 2019-03-05 | Mediatek Inc. | Electronic device and method for sensing air quality |
US9690374B2 (en) * | 2015-04-27 | 2017-06-27 | Google Inc. | Virtual/augmented reality transition system and method |
CN106200899A (zh) * | 2016-06-24 | 2016-12-07 | 北京奇思信息技术有限公司 | 根据用户头部动作控制虚拟现实交互的方法及系统 |
US10296091B2 (en) * | 2016-10-13 | 2019-05-21 | Immersion Corporation | Contextual pressure sensing haptic responses |
-
2017
- 2017-01-03 CN CN201710002398.6A patent/CN106843475A/zh active Pending
- 2017-08-09 WO PCT/CN2017/096617 patent/WO2018126682A1/zh active Application Filing
- 2017-08-09 US US15/751,211 patent/US20200201436A1/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080094351A1 (en) * | 2006-10-23 | 2008-04-24 | Canon Kabushiki Kaisha | Information processing apparatus and information processing method |
CN104035561A (zh) * | 2014-06-11 | 2014-09-10 | 京东方科技集团股份有限公司 | 触觉反馈系统、方法和触摸显示装置 |
CN105893928A (zh) * | 2015-12-21 | 2016-08-24 | 乐视致新电子科技(天津)有限公司 | 虚拟现实设备及虚拟现实设备提供的避障方法 |
CN106155322A (zh) * | 2016-06-30 | 2016-11-23 | 联想(北京)有限公司 | 信息处理方法、电子设备以及控制系统 |
CN106843475A (zh) * | 2017-01-03 | 2017-06-13 | 京东方科技集团股份有限公司 | 一种实现虚拟现实交互的方法及系统 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112991552A (zh) * | 2021-03-10 | 2021-06-18 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | 人体虚实匹配方法、装置、设备及存储介质 |
CN112991552B (zh) * | 2021-03-10 | 2024-03-22 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | 人体虚实匹配方法、装置、设备及存储介质 |
CN113342171A (zh) * | 2021-06-15 | 2021-09-03 | 华北科技学院(中国煤矿安全技术培训中心) | 一种在虚拟现实空间中实时生成可触摸实体的方法和装置 |
CN113342171B (zh) * | 2021-06-15 | 2023-04-07 | 华北科技学院(中国煤矿安全技术培训中心) | 一种在虚拟现实空间中实时生成可触摸实体的方法和装置 |
CN114428483A (zh) * | 2022-01-26 | 2022-05-03 | 上海三一重机股份有限公司 | 作业机械遥控端力反馈控制方法、装置及系统 |
CN114428483B (zh) * | 2022-01-26 | 2023-07-21 | 上海三一重机股份有限公司 | 作业机械遥控端力反馈控制方法、装置及系统 |
Also Published As
Publication number | Publication date |
---|---|
US20200201436A1 (en) | 2020-06-25 |
CN106843475A (zh) | 2017-06-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018126682A1 (zh) | 用于在虚拟现实系统中提供触觉反馈的方法及装置 | |
US20200409529A1 (en) | Touch-free gesture recognition system and method | |
US20200285383A1 (en) | Smartphone-Based Radar System Facilitating Ease and Accuracy of User Interactions with Displayed Objects in an Augmented-Reality Interface | |
CN105229582B (zh) | 基于近距离传感器和图像传感器的手势检测 | |
EP1604266B1 (en) | Multi-view display | |
US8169404B1 (en) | Method and device for planary sensory detection | |
JP2019087279A (ja) | デジタルデバイスとの対話のための直接的なポインティング検出のためのシステムおよび方法 | |
US8525780B2 (en) | Method and apparatus for inputting three-dimensional location | |
US10936053B2 (en) | Interaction system of three-dimensional space and method for operating same | |
US11959997B2 (en) | System and method for tracking a wearable device | |
US20130278494A1 (en) | Three-dimensional interactive system | |
KR20120067064A (ko) | 좌표 인식 장치 및 이를 포함하는 디스플레이 장치, 시큐리티 장치 및 전자 칠판 | |
KR101019255B1 (ko) | 깊이 센서 방식의 공간 터치 무선단말기, 이의 데이터 처리방법 및 스크린장치 | |
TWI454653B (zh) | 三維絕對座標偵測系統、互動三維顯示系統以及辨識物體之三維座標的方法 | |
KR101535738B1 (ko) | 비접촉 동작 제어가 가능한 스마트 디바이스 및 이를 이용한 비접촉 동작 제어 방법 | |
CN108227968B (zh) | 光标控制方法和装置 | |
JP2012242901A (ja) | 操作入力装置、プログラム | |
Chiu et al. | Implementation of ultrasonic touchless interactive panel using the polymer-based CMUT array | |
KR20090116543A (ko) | 깊이 센서 방식의 공간 터치 감지 장치, 방법 및 스크린장치 | |
CN107368189A (zh) | 一种实现三维触控功能的触控显示装置及方法 | |
CN211180788U (zh) | 一种超声波全息投影触控系统 | |
CN104281301A (zh) | 一种输入方法及电子设备 | |
US11934585B2 (en) | Method for performing interactive operation upon a stereoscopic image and stereoscopic image display system | |
CN116243786A (zh) | 在立体影像上执行互动的方法与立体影像显示系统 | |
TWI697810B (zh) | 具備手勢感測功能之三維顯示器 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17890612 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17890612 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17890612 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: 1205A 11.12.2019 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17890612 Country of ref document: EP Kind code of ref document: A1 |