WO2018076454A1 - Procédé de traitement de données et dispositif associé correspondant - Google Patents

Procédé de traitement de données et dispositif associé correspondant Download PDF

Info

Publication number
WO2018076454A1
WO2018076454A1 PCT/CN2016/108026 CN2016108026W WO2018076454A1 WO 2018076454 A1 WO2018076454 A1 WO 2018076454A1 CN 2016108026 W CN2016108026 W CN 2016108026W WO 2018076454 A1 WO2018076454 A1 WO 2018076454A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
virtual reality
reality glasses
data glove
human hand
Prior art date
Application number
PCT/CN2016/108026
Other languages
English (en)
Chinese (zh)
Inventor
梅各各
涂欣
张娜
唐冬兰
Original Assignee
宇龙计算机通信科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宇龙计算机通信科技(深圳)有限公司 filed Critical 宇龙计算机通信科技(深圳)有限公司
Publication of WO2018076454A1 publication Critical patent/WO2018076454A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user

Definitions

  • the present invention relates to the field of virtual reality technologies, and in particular, to a data processing method and related devices.
  • Virtual Reality is a virtual world that uses program simulation to generate a three-dimensional space.
  • the simulation simulates the senses such as sight, hearing, and touch.
  • the user can observe the three-dimensional space in a timely and unrestricted manner as if they were there.
  • the real thing When the user moves back and forth or rotates up, down, left, and right, the sensor communicates this information to the computer, and the computer passes the fast and complicated calculations and then returns the accurate three-dimensional graphics to produce a sense of presence.
  • the conventional single display screen is improved into two display screens with certain angles as an image display system, and the conventional convex lens is improved to
  • the eyepiece system consists of four plano-convex lenses, which increases the angle of view and realizes the viewing of real three-dimensional images without panoramic black edges. Compared with the traditional virtual reality glasses, the visual experience is improved.
  • the home experience adds visual 3D scene picture presentation through virtual reality technology, but lacks the user's tactile experience, and has not really increased the user's immersive feeling, resulting in low user experience.
  • the embodiment of the invention provides a data processing method and related device, which can increase tactile feedback in a visual virtual reality scene, and interact with the virtual scene through the activity of the finger, thereby providing a universal and direct operation for the operator.
  • the human-computer interaction method improves the user experience.
  • a first aspect of the embodiments of the present invention provides a data processing method, the method is applied to a data glove, the data glove is connected with the virtual reality glasses, the data glove includes multiple sensors, and the virtual reality glasses are connected with the terminal, and the virtual reality The glasses obtain virtual environment information from the terminal, including:
  • the data glove acquires the posture information of the human hand through a plurality of sensors
  • the data glove sends the human hand gesture information to the virtual reality glasses;
  • the data glove receives the attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information;
  • the data glove generates contact information based on the attitude feedback information.
  • a second aspect of the embodiments of the present invention provides a data processing method, where the method is applied to a virtual reality glasses, and the virtual reality glasses are respectively connected to the terminal and the data glove, and the virtual reality glasses obtain the virtual environment information from the terminal, which specifically includes:
  • the virtual reality glasses receive the gesture information of the human hand sent by the data glove, and the posture information of the human hand is obtained by the data glove through the sensor, and the sensor is included in the data glove;
  • the virtual reality glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information;
  • the virtual reality glasses send attitude feedback information to the data glove such that the data glove generates contact information based on the attitude feedback information.
  • a third aspect of the present invention provides a data glove.
  • the data glove is connected to the virtual reality glasses.
  • the data glove includes multiple sensors.
  • the virtual reality glasses are connected to the terminal, and the virtual reality glasses obtain virtual environment information from the terminal. Specifically include:
  • the acquiring unit is configured to acquire the posture information of the human hand through the plurality of sensors;
  • a first sending unit configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses
  • the first receiving unit is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
  • the first generating unit is configured to generate contact information according to the attitude feedback information received by the receiving unit.
  • a fourth aspect of the embodiments of the present invention provides a virtual reality glasses, where the virtual reality glasses are connected to the terminal and the data gloves, and the virtual reality glasses obtain the virtual environment information from the terminal, which specifically includes:
  • the second receiving unit is configured to receive the posture information of the human hand sent by the data glove, the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
  • a second generating unit configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit
  • the second sending unit is configured to send the posture feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • the data glove is communicatively connected with the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected with the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the data glove acquires the human hand gesture through multiple sensors.
  • the information is sent to the virtual reality glasses, and the data glove receives the attitude feedback information.
  • the attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information, and finally the contact information is generated according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 1 is a schematic diagram of a scenario structure of a data processing method according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of an embodiment of a data processing method according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of another embodiment of a data processing method according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of another embodiment of a data processing method according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of an embodiment of a data glove according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of another embodiment of a data glove according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of an embodiment of virtual reality glasses according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of another embodiment of virtual reality glasses according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of another embodiment of a data glove according to an embodiment of the present invention.
  • the embodiment of the invention provides a data processing method and related device, which can increase tactile feedback in a visual virtual reality scene, and interact with the virtual scene through the activity of the finger, thereby providing a universal and direct operation for the operator.
  • the human-computer interaction method improves the user experience.
  • Virtual Reality is a virtual world that uses program simulation to generate a three-dimensional space.
  • the simulation simulates the senses such as sight, hearing, and touch.
  • the user can observe the three-dimensional space in a timely and unrestricted manner as if they were there. Things.
  • the sensor communicates this information to the computer, and the computer passes the fast and complicated calculations and then returns the accurate three-dimensional image to produce a sense of presence.
  • the embodiment of the present invention can be applied to the scenario architecture shown in FIG. 1 , in which the user can interact with information through data gloves, virtual reality glasses, terminals (such as personal computers, laptops, tablets, mobile phones, etc.). Interact with the virtual world to experience the visual and tactile sensations in the virtual world.
  • data gloves such as personal computers, laptops, tablets, mobile phones, etc.
  • terminals such as personal computers, laptops, tablets, mobile phones, etc.
  • an embodiment of data processing in an embodiment of the present invention includes:
  • the virtual reality glasses are connected to the terminal in communication.
  • the virtual reality glasses can be connected to the terminal through the wifi, and the terminal can be connected to the terminal in other manners, such as a Bluetooth connection, which is not limited herein.
  • the terminal to which the virtual reality glasses are connected may be a mobile phone, or may be another terminal, such as a tablet computer, which is not limited herein.
  • the terminal sends the virtual environment information to the virtual reality glasses.
  • the terminal after the terminal completes the communication connection with the virtual reality glasses, the terminal sends the virtual environment information to the virtual reality glasses.
  • the user can select the virtual environment information that he wants to experience in the terminal virtual virtual environment software, and then the terminal sends the corresponding virtual environment information to the virtual reality glasses according to the user's selection.
  • the data glove is connected to the virtual reality glasses.
  • the data glove and the virtual reality glasses are first connected in communication.
  • step 203 may be performed before step 201 or may be performed simultaneously with step 201, which is not limited herein.
  • the data glove acquires the posture information of the human hand through multiple sensors.
  • the operator wears the data glove, and the data glove acquires the hand posture information through the plurality of sensors.
  • the plurality of sensors include a positioning sensor and a bending sensor.
  • the positioning sensor is used to collect position information of each part of the human hand, and the data glove acquires the posture information of the human hand through multiple sensors, and the data glove is based on the position information of each part of the human hand. Determine the posture information of the human hand.
  • the posture information of the human hand includes the grab information, the movement information, the rotation information, and the like.
  • the gripping, moving and rotating operations of the object in the virtual environment can be displayed in real time in the virtual reality glasses, so that the user can feel the change of the virtual environment and increase the interaction with the virtual environment. .
  • the human hand posture information is real-time human hand posture information.
  • the data glove sends the gesture information of the hand to the virtual reality glasses.
  • the gesture information of the human hand is sent to the virtual reality glasses.
  • the virtual reality glasses generate attitude feedback information according to the posture information of the human hand and the virtual environment information.
  • the virtual reality glasses communication connection terminal after acquiring the virtual environment information from the terminal, the lens group of the virtual reality glasses generates attitude feedback information in combination with the human hand posture information received from the data glove.
  • the virtual reality glasses generate position weight information according to the analysis of the human hand posture information and the virtual environment information, and the virtual reality glasses generate the posture feedback information according to the position weight information.
  • the virtual reality glasses send attitude feedback information to the data glove.
  • the attitude feedback information is sent to the data glove, so that the data glove generates the contact information according to the attitude feedback information, so that the operator can feel the tactile feeling with the virtual home in real time.
  • the data glove generates contact information according to the attitude feedback information.
  • the data glove after the data glove receives the attitude feedback information, the data glove will generate the contact information by analyzing the posture feedback information by the bending sensor, so that the operator can feel the tactile sensation with the virtual environment in real time.
  • the virtual reality glasses include: a virtual reality display, a lens group connected to the virtual reality display, the virtual reality display is configured to display the display source signal, and the two display screens are connected at an angle, respectively The first display screen and the second display screen, wherein an angle between the display surfaces of the first display screen and the second display screen is greater than 90 degrees.
  • the lens group comprises a combination of at least two lenses, a positive lens and a negative lens for processing the acquired image information and transmitting to the virtual reality display for display.
  • a dust seal is installed between the lenses in the lens group, which can play a dustproof function, ensure the cleaning of the lens, and prolong the service life of the device.
  • the lenses in the lens group may be high molecular polymer lenses or other lenses, such as magnetic crystal lenses, which are not limited herein.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, the data glove acquires the posture information of the human hand through the sensor, and then sends the posture information of the human hand to the virtual reality glasses, and virtual The realistic glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information, the virtual reality glasses send the attitude feedback information to the data glove, and the data glove generates the contact information according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • an embodiment of the data processing in the embodiment of the present invention includes:
  • the data glove acquires the posture information of the human hand through multiple sensors.
  • the operator wears the data glove, and the data glove acquires the hand posture information through the plurality of sensors.
  • the plurality of sensors include a positioning sensor and a bending sensor.
  • the positioning sensor is used to collect position information of each part of the human hand, and the data glove acquires the posture information of the human hand through multiple sensors, and the data glove is based on the position information of each part of the human hand. Determine the posture information of the human hand.
  • the posture information of the human hand includes the grab information, the movement information, the rotation information, and the like.
  • the gripping, moving and rotating operations of the object in the virtual environment can be displayed in real time in the virtual reality glasses, so that the user can feel the change of the virtual environment and increase the interaction with the virtual environment. .
  • the human hand posture information is real-time human hand posture information.
  • the data glove sends the gesture information of the hand to the virtual reality glasses.
  • the gesture information of the human hand is sent to the virtual reality glasses.
  • the data glove receives the attitude feedback information.
  • the posture feedback information is generated according to the posture information of the human hand and the virtual environment information acquired from the terminal, and the attitude feedback information is sent to the data. gloves.
  • the data glove generates contact information according to the attitude feedback information.
  • the data glove after the data glove receives the attitude feedback information, the data glove will generate the contact information by analyzing the posture feedback information by the bending sensor, so that the operator can feel the tactile sensation with the virtual environment in real time.
  • the data glove is communicatively connected with the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected with the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the data glove acquires the human hand gesture through multiple sensors.
  • the information is sent to the virtual reality glasses, and the data glove receives the attitude feedback information.
  • the attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information, and finally the contact information is generated according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 4 another embodiment of data processing in an embodiment of the present invention includes:
  • the virtual reality glasses receive the posture information of the human hand sent by the data glove.
  • the virtual reality glasses after the virtual reality glasses are connected to the data glove, and the data glove acquires the human hand posture information through the sensor, the virtual reality glasses receive the human hand posture information sent by the data glove.
  • the virtual reality glasses generate attitude feedback information according to the posture information of the human hand and the virtual environment information.
  • the virtual reality glasses communication connection terminal after acquiring the virtual environment information from the terminal, the lens group of the virtual reality glasses generates attitude feedback information in combination with the human hand posture information received from the data glove.
  • the virtual reality glasses generate position weight information according to the analysis of the human hand posture information and the virtual environment information, and the virtual reality glasses generate the posture feedback information according to the position weight information.
  • the virtual reality glasses can be connected to the terminal through the wifi, and the terminal can be connected to the terminal in other manners, such as a Bluetooth connection, which is not limited herein.
  • the terminal to which the virtual reality glasses are connected may be a mobile phone, or may be another terminal, such as a tablet computer, which is not limited herein.
  • the virtual reality glasses send attitude feedback information to the data glove.
  • the attitude feedback information is sent to the data glove, so that the data glove generates the contact information according to the attitude feedback information, so that the operator can feel the tactile feeling with the virtual home in real time.
  • the virtual reality glasses include: a virtual reality display, a lens group connected to the virtual reality display, the virtual reality display is configured to display the display source signal, and the two display screens are connected at an angle, respectively The first display screen and the second display screen, wherein an angle between the display surfaces of the first display screen and the second display screen is greater than 90 degrees.
  • the lens group comprises a combination of at least two lenses, a positive lens and a negative lens for processing the acquired image information and transmitting to the virtual reality display for display.
  • a dust seal is installed between the lenses in the lens group, which can play a dustproof function, ensure the cleaning of the lens, and prolong the service life of the device.
  • the lenses in the lens group may be high molecular polymer lenses or other lenses, such as magnetic crystal lenses, which are not limited herein.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, and the virtual reality glasses receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor.
  • the sensor is included in the data glove, and the virtual reality glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information, and the virtual reality glasses send the attitude feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • User A wants to renovate the layout of his home. In order to better understand the effect of the decoration layout, User A has experienced the home decoration experience system.
  • the specific scene is shown in Figure 1.
  • User A connects the virtual reality glasses to the mobile phone via wifi.
  • Select the appropriate home scene information on the software corresponding to the mobile phone wirelessly connect the virtual reality glasses with the data gloves, and put on virtual reality glasses and data gloves.
  • the lens group of the virtual reality glasses obtains the home scene information from the mobile phone, and triggers the display to display the home scene information, processes the home scene information according to the current angle information of the glasses, and sends the processed image information to the glasses. , projection display by glasses.
  • the positioning sensor in the data glove worn by the user A acquires the posture information of the user A, for example, the posture motion information such as rotation, movement, and grabbing, and the data glove sends the information to the virtual reality glasses in real time, and the virtual reality glasses
  • the attitude motion information is combined with the home scene information to obtain the attitude feedback information, and then the virtual reality glasses send the gesture motion information to the data glove, so that the bending sensor in the data glove makes a corresponding deformation according to the posture motion information, so that the user A Produces a touch like touch furniture.
  • the user A can also use the smart glove to move and grab the home furnishings and the like in the virtual home scene, and the grabbing and moving operations can be displayed in the virtual reality glasses, so that the user A can experience better.
  • the appropriate placement effect to the home scene can be used.
  • User A can not only see the 3D scene picture presentation of the home through the virtual reality glasses, but also feel the feeling of touching the furniture through the data glove, and can interact with the virtual world in a more direct, more natural and more effective way, greatly enhancing the Interactivity and immersion provide operators with a universal and direct way of human-computer interaction.
  • the data processing method in the embodiment of the present invention is described above.
  • the data glove in the embodiment of the present invention is described below.
  • the data glove is connected with the virtual reality glasses, and the data glove includes multiple sensors, virtual reality.
  • the glasses are connected to the terminal, and the virtual reality glasses obtain the virtual environment information from the terminal, and the data gloves include:
  • the obtaining unit 501 is configured to acquire the posture information of the human hand through the plurality of sensors;
  • the first sending unit 502 is configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
  • the first receiving unit 503 is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
  • the first generating unit 504 is configured to generate contact information according to the attitude feedback information received by the receiving unit.
  • the data glove is connected to the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected to the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the acquiring unit 501 acquires the human hand through the multiple sensors.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 6 another embodiment of the data glove in the embodiment of the present invention includes:
  • the obtaining unit 601 is configured to acquire the posture information of the human hand through the plurality of sensors;
  • the obtaining unit 601 includes:
  • the determining subunit 6011 is configured to determine the human hand posture information based on the position information of each part of the human hand.
  • the first sending unit 602 is configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
  • the first receiving unit 603 is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
  • the first generating unit 604 is configured to generate contact information according to the attitude feedback information received by the receiving unit.
  • the first generating unit 604 includes:
  • the analysis subunit 6041 is configured to generate contact information by analyzing the attitude feedback information by the bending sensor.
  • the data glove is connected to the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected to the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the obtaining unit 601 acquires the human hand through the plurality of sensors.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • the data glove in the embodiment of the present invention is described above.
  • the virtual reality glasses in the embodiment of the present invention are described below. Referring to FIG. 7, the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses obtain virtual from the terminal.
  • Environmental information including:
  • the second receiving unit 701 is configured to receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
  • the second generating unit 702 is configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit;
  • the second sending unit 703 is configured to send the attitude feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, and the second receiving unit 701 receives the posture information of the human hand sent by the data glove, and the posture information of the human hand passes the sensor through the data glove.
  • the sensor is included in the data glove
  • the second generating unit 702 generates the attitude feedback information according to the human hand posture information and the virtual environment information
  • the second sending unit 703 sends the posture feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 8 another embodiment of the virtual reality glasses in the embodiment of the present invention includes:
  • the second receiving unit 801 is configured to receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
  • the second generating unit 802 is configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit;
  • the second generating unit 802 includes:
  • the first generating sub-unit 8021 is configured to generate location weight information according to the analysis of the human hand posture information and the virtual environment information;
  • the second generation subunit 8022 is configured to generate attitude feedback information according to the location weight information generated by the first generation subunit.
  • the second sending unit 803 is configured to send the attitude feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, the virtual reality glasses acquire the virtual environment information from the terminal, the second receiving unit 801 receives the posture information of the human hand sent by the data glove, and the posture information of the human hand passes the sensor through the data glove. Acquiring, the sensor is included in the data glove, the second generating unit 802 generates the attitude feedback information according to the human hand posture information and the virtual environment information, and the second sending unit 803 sends the posture feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information. .
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 9 is a schematic structural diagram of a data glove according to an embodiment of the present invention.
  • the data glove 900 may have a large difference due to different configurations or performances, and may include one or more central processing units (CPUs) 922. (eg, one or more processors) and memory 932, one or more storage media 930 that store application 942 or data 944 (eg, one or one storage device in Shanghai).
  • the memory 932 and the storage medium 930 may be short-term storage or persistent storage.
  • the program stored on storage medium 930 may include one or more modules (not shown), each of which may include a series of instruction operations in the data glove.
  • central processor 922 can be configured to communicate with storage medium 930 to perform a series of instruction operations in storage medium 930 on data glove 900.
  • the storage medium 930 stores a plurality of instructions that are executed by the central processor 922 to implement a data processing method.
  • the execution of the plurality of instructions by the central processing unit 922 includes: acquiring human hand posture information by using a plurality of sensors; transmitting the human hand posture information to the virtual reality glasses; and receiving attitude feedback information, the posture The feedback information is generated by the virtual reality glasses according to the human hand posture information and the virtual environment information; and the contact information is generated according to the posture feedback information.
  • the central processing unit 922 can also determine the human hand posture information according to the position information of each part of the human hand.
  • the central processing unit 922 can also generate the contact information by analyzing the attitude feedback information by the bending sensor.
  • Data glove 900 may also include one or more power supplies 926, one or more wired or wireless network interfaces 950, one or more input and output interfaces 958, and/or one or more operating systems 941, such as Windows ServerTM, Mac. OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
  • operating systems 941 such as Windows ServerTM, Mac. OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
  • the steps performed by the server in the above embodiment may be based on the server structure shown in FIG.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Selon des modes de réalisation, la présente invention concerne un procédé de traitement de données et un dispositif associé correspondant, destinés à améliorer l'expérience de l'utilisateur. Le procédé décrit dans un mode de réalisation de la présente invention comprend les étapes suivantes : des gants de données établissent une connexion de communication avec des lunettes de réalité virtuelle, les gants de données comprenant de multiples capteurs ; les lunettes de réalité virtuelle établissent une connexion de communication avec un terminal, et les lunettes de réalité virtuelle obtiennent des informations sur l'environnement de réalité virtuelle de la part du terminal ; les gants de données obtiennent des informations sur les gestes des mains humaines au moyen des multiples capteurs et envoient les informations sur les gestes des mains humaines aux lunettes de réalité virtuelle, et reçoivent des informations de rétroaction de gestes, les informations de rétroaction de gestes étant générées par les lunettes de réalité virtuelle selon les informations de gestes des mains humaines et les informations sur l'environnement virtuel ; et enfin, les gants de données génèrent des informations tactiles selon les informations de rétroaction de gestes. Au moyen des modes de réalisation de la présente invention, l'expérience de l'utilisateur peut être améliorée.
PCT/CN2016/108026 2016-10-25 2016-11-30 Procédé de traitement de données et dispositif associé correspondant WO2018076454A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610949073.4 2016-10-25
CN201610949073.4A CN106502407A (zh) 2016-10-25 2016-10-25 一种数据处理方法及其相关设备

Publications (1)

Publication Number Publication Date
WO2018076454A1 true WO2018076454A1 (fr) 2018-05-03

Family

ID=58323014

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/108026 WO2018076454A1 (fr) 2016-10-25 2016-11-30 Procédé de traitement de données et dispositif associé correspondant

Country Status (2)

Country Link
CN (1) CN106502407A (fr)
WO (1) WO2018076454A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114727676A (zh) * 2020-04-16 2022-07-08 鹏鼎控股(深圳)股份有限公司 虚拟现实手套及其制作方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107422845A (zh) * 2017-04-18 2017-12-01 小派科技（上海）有限责任公司 一种虚拟现实头戴显示设备及画面显示方法
CN108681401A (zh) * 2018-05-14 2018-10-19 南京联迈信息科技有限公司 一种vr体验式家装网络平台系统
CN109032343B (zh) * 2018-07-04 2022-02-11 青岛理工大学 基于视觉和力觉触觉增强现实的工业人机交互系统及方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102176888A (zh) * 2008-08-25 2011-09-07 苏黎世大学数学和自然科学部 可调整的虚拟现实系统
CN102789313A (zh) * 2012-03-19 2012-11-21 乾行讯科（北京）科技有限公司 一种用户交互系统和方法
CN102906623A (zh) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 交互式头戴目镜上的本地广告内容
CN104007844A (zh) * 2014-06-18 2014-08-27 原硕朋 电子设备和用于电子设备的可穿戴式输入装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1696872A (zh) * 2004-05-13 2005-11-16 中国科学院自动化研究所 一种触觉反馈数据手套
CN103823911A (zh) * 2012-11-19 2014-05-28 大连鑫奇辉科技有限公司 一种基于虚拟现实的数字装配系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102176888A (zh) * 2008-08-25 2011-09-07 苏黎世大学数学和自然科学部 可调整的虚拟现实系统
CN102906623A (zh) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 交互式头戴目镜上的本地广告内容
CN102789313A (zh) * 2012-03-19 2012-11-21 乾行讯科（北京）科技有限公司 一种用户交互系统和方法
CN104007844A (zh) * 2014-06-18 2014-08-27 原硕朋 电子设备和用于电子设备的可穿戴式输入装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114727676A (zh) * 2020-04-16 2022-07-08 鹏鼎控股(深圳)股份有限公司 虚拟现实手套及其制作方法

Also Published As

Publication number Publication date
CN106502407A (zh) 2017-03-15

Similar Documents

Publication Publication Date Title
WO2018076454A1 (fr) Procédé de traitement de données et dispositif associé correspondant
WO2018128526A1 (fr) Système et procédé de commande de réalité augmentée
WO2017140079A1 (fr) Procédé et appareil de commande d'interactions pour réalité virtuelle
WO2015122566A1 (fr) Dispositif d'affichage monté sur tête pour afficher un guide de capture d'image en réalité augmentée, et son procédé de commande
WO2017126741A1 (fr) Visiocasque et procédé de commande de celui-ci
WO2016028097A1 (fr) Dispositif pouvant être porté
WO2018076912A1 (fr) Procédé d'ajustement de scène virtuelle et dispositif intelligent monté sur la tête
WO2016107231A1 (fr) Système et procédé pour entrer des gestes dans une scène tridimensionnelle (3d)
WO2017107445A1 (fr) Procédé et système d'acquisition de sensation immergée dans un système de réalité virtuelle, et gant intelligent
WO2017052150A1 (fr) Dispositif de terminal d'utilisateur, dispositif électronique, et procédé de commande d'un dispositif terminal utilisateur et d'un dispositif électronique
WO2022158953A1 (fr) Interaction de réalité étendue dans des espaces virtuels synchrones à l'aide de dispositifs hétérogènes
WO2022158820A1 (fr) Systèmes et procédés pour manipuler des vues et des objets partagés dans un espace xr
WO2020130692A1 (fr) Procédé, système et support d'enregistrement lisible par ordinateur non transitoire permettant de générer une séquence d'animation
WO2015163529A1 (fr) Dispositif de visiocasque pour l'affichage d'image miniature et son procédé de commande
WO2016088922A1 (fr) Procédé de fourniture d'interface faisant appel à un dispositif mobile et dispositif portable
WO2021086018A1 (fr) Procédé d'affichage de réalité augmentée tridimensionnelle
WO2012034469A1 (fr) Système et procédé d'interaction homme-machine à base de gestes et support de stockage informatique
WO2017164545A1 (fr) Dispositif d'affichage et procédé permettant de commander un dispositif d'affichage
WO2022145888A1 (fr) Procédé permettant de commander un dispositif de réalité augmentée et dispositif de réalité augmentée le mettant en œuvre
WO2018093075A1 (fr) Dispositif électronique et procédé de commande associé
WO2019074228A2 (fr) Visiocasque pour réduire le mal des transports en réalité virtuelle et son procédé de fonctionnement
WO2021261619A1 (fr) Dispositif électronique de détection d'un plan dans une image et procédé de fonctionnement correspondant
EP3455716A1 (fr) Appareil électronique et son procédé de commande
WO2023063570A1 (fr) Dispositif électronique permettant d'obtenir des données d'image concernant un mouvement de la main et son procédé de fonctionnement
WO2023158171A1 (fr) Dispositif électronique et procédé de commande de dispositif électronique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16919658

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16919658

Country of ref document: EP

Kind code of ref document: A1