WO2018076454A1 - Data processing method and related device thereof - Google Patents

Data processing method and related device thereof Download PDF

Info

Publication number
WO2018076454A1
WO2018076454A1 PCT/CN2016/108026 CN2016108026W WO2018076454A1 WO 2018076454 A1 WO2018076454 A1 WO 2018076454A1 CN 2016108026 W CN2016108026 W CN 2016108026W WO 2018076454 A1 WO2018076454 A1 WO 2018076454A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
virtual reality
reality glasses
data glove
human hand
Prior art date
Application number
PCT/CN2016/108026
Other languages
French (fr)
Chinese (zh)
Inventor
梅各各
涂欣
张娜
唐冬兰
Original Assignee
宇龙计算机通信科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宇龙计算机通信科技(深圳)有限公司 filed Critical 宇龙计算机通信科技(深圳)有限公司
Publication of WO2018076454A1 publication Critical patent/WO2018076454A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user

Definitions

  • the present invention relates to the field of virtual reality technologies, and in particular, to a data processing method and related devices.
  • Virtual Reality is a virtual world that uses program simulation to generate a three-dimensional space.
  • the simulation simulates the senses such as sight, hearing, and touch.
  • the user can observe the three-dimensional space in a timely and unrestricted manner as if they were there.
  • the real thing When the user moves back and forth or rotates up, down, left, and right, the sensor communicates this information to the computer, and the computer passes the fast and complicated calculations and then returns the accurate three-dimensional graphics to produce a sense of presence.
  • the conventional single display screen is improved into two display screens with certain angles as an image display system, and the conventional convex lens is improved to
  • the eyepiece system consists of four plano-convex lenses, which increases the angle of view and realizes the viewing of real three-dimensional images without panoramic black edges. Compared with the traditional virtual reality glasses, the visual experience is improved.
  • the home experience adds visual 3D scene picture presentation through virtual reality technology, but lacks the user's tactile experience, and has not really increased the user's immersive feeling, resulting in low user experience.
  • the embodiment of the invention provides a data processing method and related device, which can increase tactile feedback in a visual virtual reality scene, and interact with the virtual scene through the activity of the finger, thereby providing a universal and direct operation for the operator.
  • the human-computer interaction method improves the user experience.
  • a first aspect of the embodiments of the present invention provides a data processing method, the method is applied to a data glove, the data glove is connected with the virtual reality glasses, the data glove includes multiple sensors, and the virtual reality glasses are connected with the terminal, and the virtual reality The glasses obtain virtual environment information from the terminal, including:
  • the data glove acquires the posture information of the human hand through a plurality of sensors
  • the data glove sends the human hand gesture information to the virtual reality glasses;
  • the data glove receives the attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information;
  • the data glove generates contact information based on the attitude feedback information.
  • a second aspect of the embodiments of the present invention provides a data processing method, where the method is applied to a virtual reality glasses, and the virtual reality glasses are respectively connected to the terminal and the data glove, and the virtual reality glasses obtain the virtual environment information from the terminal, which specifically includes:
  • the virtual reality glasses receive the gesture information of the human hand sent by the data glove, and the posture information of the human hand is obtained by the data glove through the sensor, and the sensor is included in the data glove;
  • the virtual reality glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information;
  • the virtual reality glasses send attitude feedback information to the data glove such that the data glove generates contact information based on the attitude feedback information.
  • a third aspect of the present invention provides a data glove.
  • the data glove is connected to the virtual reality glasses.
  • the data glove includes multiple sensors.
  • the virtual reality glasses are connected to the terminal, and the virtual reality glasses obtain virtual environment information from the terminal. Specifically include:
  • the acquiring unit is configured to acquire the posture information of the human hand through the plurality of sensors;
  • a first sending unit configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses
  • the first receiving unit is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
  • the first generating unit is configured to generate contact information according to the attitude feedback information received by the receiving unit.
  • a fourth aspect of the embodiments of the present invention provides a virtual reality glasses, where the virtual reality glasses are connected to the terminal and the data gloves, and the virtual reality glasses obtain the virtual environment information from the terminal, which specifically includes:
  • the second receiving unit is configured to receive the posture information of the human hand sent by the data glove, the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
  • a second generating unit configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit
  • the second sending unit is configured to send the posture feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • the data glove is communicatively connected with the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected with the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the data glove acquires the human hand gesture through multiple sensors.
  • the information is sent to the virtual reality glasses, and the data glove receives the attitude feedback information.
  • the attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information, and finally the contact information is generated according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 1 is a schematic diagram of a scenario structure of a data processing method according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of an embodiment of a data processing method according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of another embodiment of a data processing method according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of another embodiment of a data processing method according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of an embodiment of a data glove according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of another embodiment of a data glove according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of an embodiment of virtual reality glasses according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of another embodiment of virtual reality glasses according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of another embodiment of a data glove according to an embodiment of the present invention.
  • the embodiment of the invention provides a data processing method and related device, which can increase tactile feedback in a visual virtual reality scene, and interact with the virtual scene through the activity of the finger, thereby providing a universal and direct operation for the operator.
  • the human-computer interaction method improves the user experience.
  • Virtual Reality is a virtual world that uses program simulation to generate a three-dimensional space.
  • the simulation simulates the senses such as sight, hearing, and touch.
  • the user can observe the three-dimensional space in a timely and unrestricted manner as if they were there. Things.
  • the sensor communicates this information to the computer, and the computer passes the fast and complicated calculations and then returns the accurate three-dimensional image to produce a sense of presence.
  • the embodiment of the present invention can be applied to the scenario architecture shown in FIG. 1 , in which the user can interact with information through data gloves, virtual reality glasses, terminals (such as personal computers, laptops, tablets, mobile phones, etc.). Interact with the virtual world to experience the visual and tactile sensations in the virtual world.
  • data gloves such as personal computers, laptops, tablets, mobile phones, etc.
  • terminals such as personal computers, laptops, tablets, mobile phones, etc.
  • an embodiment of data processing in an embodiment of the present invention includes:
  • the virtual reality glasses are connected to the terminal in communication.
  • the virtual reality glasses can be connected to the terminal through the wifi, and the terminal can be connected to the terminal in other manners, such as a Bluetooth connection, which is not limited herein.
  • the terminal to which the virtual reality glasses are connected may be a mobile phone, or may be another terminal, such as a tablet computer, which is not limited herein.
  • the terminal sends the virtual environment information to the virtual reality glasses.
  • the terminal after the terminal completes the communication connection with the virtual reality glasses, the terminal sends the virtual environment information to the virtual reality glasses.
  • the user can select the virtual environment information that he wants to experience in the terminal virtual virtual environment software, and then the terminal sends the corresponding virtual environment information to the virtual reality glasses according to the user's selection.
  • the data glove is connected to the virtual reality glasses.
  • the data glove and the virtual reality glasses are first connected in communication.
  • step 203 may be performed before step 201 or may be performed simultaneously with step 201, which is not limited herein.
  • the data glove acquires the posture information of the human hand through multiple sensors.
  • the operator wears the data glove, and the data glove acquires the hand posture information through the plurality of sensors.
  • the plurality of sensors include a positioning sensor and a bending sensor.
  • the positioning sensor is used to collect position information of each part of the human hand, and the data glove acquires the posture information of the human hand through multiple sensors, and the data glove is based on the position information of each part of the human hand. Determine the posture information of the human hand.
  • the posture information of the human hand includes the grab information, the movement information, the rotation information, and the like.
  • the gripping, moving and rotating operations of the object in the virtual environment can be displayed in real time in the virtual reality glasses, so that the user can feel the change of the virtual environment and increase the interaction with the virtual environment. .
  • the human hand posture information is real-time human hand posture information.
  • the data glove sends the gesture information of the hand to the virtual reality glasses.
  • the gesture information of the human hand is sent to the virtual reality glasses.
  • the virtual reality glasses generate attitude feedback information according to the posture information of the human hand and the virtual environment information.
  • the virtual reality glasses communication connection terminal after acquiring the virtual environment information from the terminal, the lens group of the virtual reality glasses generates attitude feedback information in combination with the human hand posture information received from the data glove.
  • the virtual reality glasses generate position weight information according to the analysis of the human hand posture information and the virtual environment information, and the virtual reality glasses generate the posture feedback information according to the position weight information.
  • the virtual reality glasses send attitude feedback information to the data glove.
  • the attitude feedback information is sent to the data glove, so that the data glove generates the contact information according to the attitude feedback information, so that the operator can feel the tactile feeling with the virtual home in real time.
  • the data glove generates contact information according to the attitude feedback information.
  • the data glove after the data glove receives the attitude feedback information, the data glove will generate the contact information by analyzing the posture feedback information by the bending sensor, so that the operator can feel the tactile sensation with the virtual environment in real time.
  • the virtual reality glasses include: a virtual reality display, a lens group connected to the virtual reality display, the virtual reality display is configured to display the display source signal, and the two display screens are connected at an angle, respectively The first display screen and the second display screen, wherein an angle between the display surfaces of the first display screen and the second display screen is greater than 90 degrees.
  • the lens group comprises a combination of at least two lenses, a positive lens and a negative lens for processing the acquired image information and transmitting to the virtual reality display for display.
  • a dust seal is installed between the lenses in the lens group, which can play a dustproof function, ensure the cleaning of the lens, and prolong the service life of the device.
  • the lenses in the lens group may be high molecular polymer lenses or other lenses, such as magnetic crystal lenses, which are not limited herein.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, the data glove acquires the posture information of the human hand through the sensor, and then sends the posture information of the human hand to the virtual reality glasses, and virtual The realistic glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information, the virtual reality glasses send the attitude feedback information to the data glove, and the data glove generates the contact information according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • an embodiment of the data processing in the embodiment of the present invention includes:
  • the data glove acquires the posture information of the human hand through multiple sensors.
  • the operator wears the data glove, and the data glove acquires the hand posture information through the plurality of sensors.
  • the plurality of sensors include a positioning sensor and a bending sensor.
  • the positioning sensor is used to collect position information of each part of the human hand, and the data glove acquires the posture information of the human hand through multiple sensors, and the data glove is based on the position information of each part of the human hand. Determine the posture information of the human hand.
  • the posture information of the human hand includes the grab information, the movement information, the rotation information, and the like.
  • the gripping, moving and rotating operations of the object in the virtual environment can be displayed in real time in the virtual reality glasses, so that the user can feel the change of the virtual environment and increase the interaction with the virtual environment. .
  • the human hand posture information is real-time human hand posture information.
  • the data glove sends the gesture information of the hand to the virtual reality glasses.
  • the gesture information of the human hand is sent to the virtual reality glasses.
  • the data glove receives the attitude feedback information.
  • the posture feedback information is generated according to the posture information of the human hand and the virtual environment information acquired from the terminal, and the attitude feedback information is sent to the data. gloves.
  • the data glove generates contact information according to the attitude feedback information.
  • the data glove after the data glove receives the attitude feedback information, the data glove will generate the contact information by analyzing the posture feedback information by the bending sensor, so that the operator can feel the tactile sensation with the virtual environment in real time.
  • the data glove is communicatively connected with the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected with the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the data glove acquires the human hand gesture through multiple sensors.
  • the information is sent to the virtual reality glasses, and the data glove receives the attitude feedback information.
  • the attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information, and finally the contact information is generated according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 4 another embodiment of data processing in an embodiment of the present invention includes:
  • the virtual reality glasses receive the posture information of the human hand sent by the data glove.
  • the virtual reality glasses after the virtual reality glasses are connected to the data glove, and the data glove acquires the human hand posture information through the sensor, the virtual reality glasses receive the human hand posture information sent by the data glove.
  • the virtual reality glasses generate attitude feedback information according to the posture information of the human hand and the virtual environment information.
  • the virtual reality glasses communication connection terminal after acquiring the virtual environment information from the terminal, the lens group of the virtual reality glasses generates attitude feedback information in combination with the human hand posture information received from the data glove.
  • the virtual reality glasses generate position weight information according to the analysis of the human hand posture information and the virtual environment information, and the virtual reality glasses generate the posture feedback information according to the position weight information.
  • the virtual reality glasses can be connected to the terminal through the wifi, and the terminal can be connected to the terminal in other manners, such as a Bluetooth connection, which is not limited herein.
  • the terminal to which the virtual reality glasses are connected may be a mobile phone, or may be another terminal, such as a tablet computer, which is not limited herein.
  • the virtual reality glasses send attitude feedback information to the data glove.
  • the attitude feedback information is sent to the data glove, so that the data glove generates the contact information according to the attitude feedback information, so that the operator can feel the tactile feeling with the virtual home in real time.
  • the virtual reality glasses include: a virtual reality display, a lens group connected to the virtual reality display, the virtual reality display is configured to display the display source signal, and the two display screens are connected at an angle, respectively The first display screen and the second display screen, wherein an angle between the display surfaces of the first display screen and the second display screen is greater than 90 degrees.
  • the lens group comprises a combination of at least two lenses, a positive lens and a negative lens for processing the acquired image information and transmitting to the virtual reality display for display.
  • a dust seal is installed between the lenses in the lens group, which can play a dustproof function, ensure the cleaning of the lens, and prolong the service life of the device.
  • the lenses in the lens group may be high molecular polymer lenses or other lenses, such as magnetic crystal lenses, which are not limited herein.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, and the virtual reality glasses receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor.
  • the sensor is included in the data glove, and the virtual reality glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information, and the virtual reality glasses send the attitude feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • User A wants to renovate the layout of his home. In order to better understand the effect of the decoration layout, User A has experienced the home decoration experience system.
  • the specific scene is shown in Figure 1.
  • User A connects the virtual reality glasses to the mobile phone via wifi.
  • Select the appropriate home scene information on the software corresponding to the mobile phone wirelessly connect the virtual reality glasses with the data gloves, and put on virtual reality glasses and data gloves.
  • the lens group of the virtual reality glasses obtains the home scene information from the mobile phone, and triggers the display to display the home scene information, processes the home scene information according to the current angle information of the glasses, and sends the processed image information to the glasses. , projection display by glasses.
  • the positioning sensor in the data glove worn by the user A acquires the posture information of the user A, for example, the posture motion information such as rotation, movement, and grabbing, and the data glove sends the information to the virtual reality glasses in real time, and the virtual reality glasses
  • the attitude motion information is combined with the home scene information to obtain the attitude feedback information, and then the virtual reality glasses send the gesture motion information to the data glove, so that the bending sensor in the data glove makes a corresponding deformation according to the posture motion information, so that the user A Produces a touch like touch furniture.
  • the user A can also use the smart glove to move and grab the home furnishings and the like in the virtual home scene, and the grabbing and moving operations can be displayed in the virtual reality glasses, so that the user A can experience better.
  • the appropriate placement effect to the home scene can be used.
  • User A can not only see the 3D scene picture presentation of the home through the virtual reality glasses, but also feel the feeling of touching the furniture through the data glove, and can interact with the virtual world in a more direct, more natural and more effective way, greatly enhancing the Interactivity and immersion provide operators with a universal and direct way of human-computer interaction.
  • the data processing method in the embodiment of the present invention is described above.
  • the data glove in the embodiment of the present invention is described below.
  • the data glove is connected with the virtual reality glasses, and the data glove includes multiple sensors, virtual reality.
  • the glasses are connected to the terminal, and the virtual reality glasses obtain the virtual environment information from the terminal, and the data gloves include:
  • the obtaining unit 501 is configured to acquire the posture information of the human hand through the plurality of sensors;
  • the first sending unit 502 is configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
  • the first receiving unit 503 is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
  • the first generating unit 504 is configured to generate contact information according to the attitude feedback information received by the receiving unit.
  • the data glove is connected to the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected to the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the acquiring unit 501 acquires the human hand through the multiple sensors.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 6 another embodiment of the data glove in the embodiment of the present invention includes:
  • the obtaining unit 601 is configured to acquire the posture information of the human hand through the plurality of sensors;
  • the obtaining unit 601 includes:
  • the determining subunit 6011 is configured to determine the human hand posture information based on the position information of each part of the human hand.
  • the first sending unit 602 is configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
  • the first receiving unit 603 is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
  • the first generating unit 604 is configured to generate contact information according to the attitude feedback information received by the receiving unit.
  • the first generating unit 604 includes:
  • the analysis subunit 6041 is configured to generate contact information by analyzing the attitude feedback information by the bending sensor.
  • the data glove is connected to the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected to the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the obtaining unit 601 acquires the human hand through the plurality of sensors.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • the data glove in the embodiment of the present invention is described above.
  • the virtual reality glasses in the embodiment of the present invention are described below. Referring to FIG. 7, the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses obtain virtual from the terminal.
  • Environmental information including:
  • the second receiving unit 701 is configured to receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
  • the second generating unit 702 is configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit;
  • the second sending unit 703 is configured to send the attitude feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, and the second receiving unit 701 receives the posture information of the human hand sent by the data glove, and the posture information of the human hand passes the sensor through the data glove.
  • the sensor is included in the data glove
  • the second generating unit 702 generates the attitude feedback information according to the human hand posture information and the virtual environment information
  • the second sending unit 703 sends the posture feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 8 another embodiment of the virtual reality glasses in the embodiment of the present invention includes:
  • the second receiving unit 801 is configured to receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
  • the second generating unit 802 is configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit;
  • the second generating unit 802 includes:
  • the first generating sub-unit 8021 is configured to generate location weight information according to the analysis of the human hand posture information and the virtual environment information;
  • the second generation subunit 8022 is configured to generate attitude feedback information according to the location weight information generated by the first generation subunit.
  • the second sending unit 803 is configured to send the attitude feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
  • the virtual reality glasses are respectively connected with the terminal and the data glove, the virtual reality glasses acquire the virtual environment information from the terminal, the second receiving unit 801 receives the posture information of the human hand sent by the data glove, and the posture information of the human hand passes the sensor through the data glove. Acquiring, the sensor is included in the data glove, the second generating unit 802 generates the attitude feedback information according to the human hand posture information and the virtual environment information, and the second sending unit 803 sends the posture feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information. .
  • This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
  • FIG. 9 is a schematic structural diagram of a data glove according to an embodiment of the present invention.
  • the data glove 900 may have a large difference due to different configurations or performances, and may include one or more central processing units (CPUs) 922. (eg, one or more processors) and memory 932, one or more storage media 930 that store application 942 or data 944 (eg, one or one storage device in Shanghai).
  • the memory 932 and the storage medium 930 may be short-term storage or persistent storage.
  • the program stored on storage medium 930 may include one or more modules (not shown), each of which may include a series of instruction operations in the data glove.
  • central processor 922 can be configured to communicate with storage medium 930 to perform a series of instruction operations in storage medium 930 on data glove 900.
  • the storage medium 930 stores a plurality of instructions that are executed by the central processor 922 to implement a data processing method.
  • the execution of the plurality of instructions by the central processing unit 922 includes: acquiring human hand posture information by using a plurality of sensors; transmitting the human hand posture information to the virtual reality glasses; and receiving attitude feedback information, the posture The feedback information is generated by the virtual reality glasses according to the human hand posture information and the virtual environment information; and the contact information is generated according to the posture feedback information.
  • the central processing unit 922 can also determine the human hand posture information according to the position information of each part of the human hand.
  • the central processing unit 922 can also generate the contact information by analyzing the attitude feedback information by the bending sensor.
  • Data glove 900 may also include one or more power supplies 926, one or more wired or wireless network interfaces 950, one or more input and output interfaces 958, and/or one or more operating systems 941, such as Windows ServerTM, Mac. OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
  • operating systems 941 such as Windows ServerTM, Mac. OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
  • the steps performed by the server in the above embodiment may be based on the server structure shown in FIG.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Abstract

Disclosed in embodiments of the present invention are a data processing method and a related device thereof, for use in improving user experience. The method in an embodiment of the present invention comprises: data gloves establish a communication connection with virtual reality glasses, the data gloves comprising multiple sensors; the virtual reality glasses establish a communication connection with a terminal, and the virtual reality glasses obtain virtual reality environment information from the terminal; the data gloves obtain human hand gesture information by means of the multiple sensors send the human hand gesture information to the virtual reality glasses, and receive gesture feedback information, the gesture feedback information being generated by the virtual reality glasses according to the human hand gesture information and the virtual environment information; and finally the data gloves generate touch information according to the gesture feedback information. By means of the embodiments of the present invention, user experience can be improved.

Description

一种数据处理方法及其相关设备Data processing method and related equipment
本申请要求于2016年10月25日提交中国专利局,申请号为201610949073.4、发明名称为“一种数据处理方法及其相关设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to Chinese Patent Application No. 201610949073.4, entitled "A Data Processing Method and Related Equipment", filed on October 25, 2016, the entire contents of which is incorporated herein by reference. In the application.
技术领域Technical field
本发明涉及虚拟现实技术领域,具体涉及一种数据处理方法及其相关设备。The present invention relates to the field of virtual reality technologies, and in particular, to a data processing method and related devices.
背景技术Background technique
虚拟现实(Virtual Reality)是利用程序模拟产生一个三维空间的虚拟世界,模拟产生视觉、听觉、触觉等感官,这样的情况下使用者可以如同身临其境一般及时、没有限制地观察三维空间内的实物。当使用者进行前后位置移动或者上下左右旋转时,传感器将这些信息传达给计算机,计算机经过快速而复杂的运算后再将精确的三维图形传回产生临场感。Virtual Reality is a virtual world that uses program simulation to generate a three-dimensional space. The simulation simulates the senses such as sight, hearing, and touch. In this case, the user can observe the three-dimensional space in a timely and unrestricted manner as if they were there. The real thing. When the user moves back and forth or rotates up, down, left, and right, the sensor communicates this information to the computer, and the computer passes the fast and complicated calculations and then returns the accurate three-dimensional graphics to produce a sense of presence.
现有技术通过将两个具有一定夹角的显示屏与四个平凸透镜相结合,将传统的单显示屏改良为两个具有一定夹角的显示屏作为图像显示系统,将传统的凸透镜改良为四个平凸透镜构成的目镜系统,从而增加了视场角,实现全景无黑边的真实三维图像的观赏,相较传统的虚拟现实眼镜主体,提高了视觉感受。In the prior art, by combining two display screens with a certain angle with four plano-convex lenses, the conventional single display screen is improved into two display screens with certain angles as an image display system, and the conventional convex lens is improved to The eyepiece system consists of four plano-convex lenses, which increases the angle of view and realizes the viewing of real three-dimensional images without panoramic black edges. Compared with the traditional virtual reality glasses, the visual experience is improved.
目前,家居体验通过虚拟现实技术增加视觉上的3D场景画面演示,但缺少用户触觉体验,还未真正做到增加用户的身临其境感,使得用户体验度低。At present, the home experience adds visual 3D scene picture presentation through virtual reality technology, but lacks the user's tactile experience, and has not really increased the user's immersive feeling, resulting in low user experience.
发明内容Summary of the invention
本发明实施例提供了一种数据处理方法及其相关设备,能够在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。The embodiment of the invention provides a data processing method and related device, which can increase tactile feedback in a visual virtual reality scene, and interact with the virtual scene through the activity of the finger, thereby providing a universal and direct operation for the operator. The human-computer interaction method improves the user experience.
本发明实施例的第一方面提供了一种数据处理方法,该方法应用于数据手套,数据手套与虚拟现实眼镜通信连接,数据手套中包含多个传感器,虚拟现实眼镜与终端通信连接,虚拟现实眼镜从终端获取虚拟环境信息,具体包括:A first aspect of the embodiments of the present invention provides a data processing method, the method is applied to a data glove, the data glove is connected with the virtual reality glasses, the data glove includes multiple sensors, and the virtual reality glasses are connected with the terminal, and the virtual reality The glasses obtain virtual environment information from the terminal, including:
数据手套通过多个传感器获取人手姿态信息;The data glove acquires the posture information of the human hand through a plurality of sensors;
数据手套发送人手姿态信息至虚拟现实眼镜;The data glove sends the human hand gesture information to the virtual reality glasses;
数据手套接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成;The data glove receives the attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information;
数据手套根据姿态反馈信息生成接触信息。The data glove generates contact information based on the attitude feedback information.
本发明实施例的第二方面提供了一种数据处理方法,该方法应用于虚拟现实眼镜,虚拟现实眼镜与终端和数据手套分别通信连接,虚拟现实眼镜从终端获取虚拟环境信息,具体包括:A second aspect of the embodiments of the present invention provides a data processing method, where the method is applied to a virtual reality glasses, and the virtual reality glasses are respectively connected to the terminal and the data glove, and the virtual reality glasses obtain the virtual environment information from the terminal, which specifically includes:
虚拟现实眼镜接收数据手套发送的人手姿态信息,人手姿态信息由数据手套通过传感器获取,传感器含于数据手套;The virtual reality glasses receive the gesture information of the human hand sent by the data glove, and the posture information of the human hand is obtained by the data glove through the sensor, and the sensor is included in the data glove;
虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成姿态反馈信息;The virtual reality glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information;
虚拟现实眼镜发送姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息。The virtual reality glasses send attitude feedback information to the data glove such that the data glove generates contact information based on the attitude feedback information.
本发明实施例的第三方面提供了一种数据手套,数据手套与虚拟现实眼镜通信连接,数据手套中包含多个传感器,虚拟现实眼镜与终端通信连接,虚拟现实眼镜从终端获取虚拟环境信息,具体包括:A third aspect of the present invention provides a data glove. The data glove is connected to the virtual reality glasses. The data glove includes multiple sensors. The virtual reality glasses are connected to the terminal, and the virtual reality glasses obtain virtual environment information from the terminal. Specifically include:
获取单元,设置为通过多个传感器获取人手姿态信息;The acquiring unit is configured to acquire the posture information of the human hand through the plurality of sensors;
第一发送单元,设置为发送通过获取单元获取到的人手姿态信息至虚拟现实眼镜;a first sending unit, configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
第一接收单元,设置为接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成;The first receiving unit is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
第一生成单元,设置为根据接收单元接收到的姿态反馈信息生成接触信息。The first generating unit is configured to generate contact information according to the attitude feedback information received by the receiving unit.
本发明实施例的第四方面提供了一种虚拟现实眼镜,虚拟现实眼镜与终端和数据手套分别通信连接,虚拟现实眼镜从终端获取虚拟环境信息,具体包括:A fourth aspect of the embodiments of the present invention provides a virtual reality glasses, where the virtual reality glasses are connected to the terminal and the data gloves, and the virtual reality glasses obtain the virtual environment information from the terminal, which specifically includes:
第二接收单元,设置为接收数据手套发送的人手姿态信息,人手姿态信息由数据手套通过传感器获取,传感器含于数据手套;The second receiving unit is configured to receive the posture information of the human hand sent by the data glove, the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
第二生成单元,设置为根据第二接收单元接收到的人手姿态信息与虚拟环境信息生成姿态反馈信息;a second generating unit, configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit;
第二发送单元,设置为发送生成单元生成的姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息。The second sending unit is configured to send the posture feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
从以上技术方案可以看出,本发明实施例具有以下优点:It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:
本发明实施例中,数据手套与虚拟现实眼镜通信连接,数据手套中包含多个传感器,虚拟现实眼镜与终端通信连接,虚拟现实眼镜从终端获取虚拟环境信息,数据手套通过多个传感器获取人手姿态信息,再发送人手姿态信息至虚拟现实眼镜,数据手套接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成,最后根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the data glove is communicatively connected with the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected with the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the data glove acquires the human hand gesture through multiple sensors. The information is sent to the virtual reality glasses, and the data glove receives the attitude feedback information. The attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information, and finally the contact information is generated according to the attitude feedback information. This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
附图说明DRAWINGS
图1为本发明实施例中数据处理方法一个场景架构示意图;1 is a schematic diagram of a scenario structure of a data processing method according to an embodiment of the present invention;
图2为本发明实施例中数据处理方法一个实施例示意图;2 is a schematic diagram of an embodiment of a data processing method according to an embodiment of the present invention;
图3为本发明实施例中数据处理方法另一个实施例示意图;3 is a schematic diagram of another embodiment of a data processing method according to an embodiment of the present invention;
图4为本发明实施例中数据处理方法另一个实施例示意图;4 is a schematic diagram of another embodiment of a data processing method according to an embodiment of the present invention;
图5为本发明实施例中数据手套一个实施例示意图;FIG. 5 is a schematic diagram of an embodiment of a data glove according to an embodiment of the present invention; FIG.
图6为本发明实施例中数据手套另一个实施例示意图;6 is a schematic diagram of another embodiment of a data glove according to an embodiment of the present invention;
图7为本发明实施例中虚拟现实眼镜一个实施例示意图;FIG. 7 is a schematic diagram of an embodiment of virtual reality glasses according to an embodiment of the present invention; FIG.
图8为本发明实施例中虚拟现实眼镜另一个实施例示意图;FIG. 8 is a schematic diagram of another embodiment of virtual reality glasses according to an embodiment of the present invention; FIG.
图9为本发明实施例中数据手套另一个实施例示意图。FIG. 9 is a schematic diagram of another embodiment of a data glove according to an embodiment of the present invention.
具体实施方式detailed description
本发明实施例提供了一种数据处理方法及其相关设备,能够在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。The embodiment of the invention provides a data processing method and related device, which can increase tactile feedback in a visual virtual reality scene, and interact with the virtual scene through the activity of the finger, thereby providing a universal and direct operation for the operator. The human-computer interaction method improves the user experience.
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is an embodiment of the invention, but not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of the present invention.
本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外,术语“包括”或“具有”及其任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second", "third", "fourth", etc. (if present) in the specification and claims of the present invention and the above figures are used to distinguish similar objects without having to use To describe a specific order or order. It is to be understood that the data so used may be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than what is illustrated or described herein. In addition, the term "comprises" or "comprises" or any variations thereof, is intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to those that are clearly listed Steps or units, but may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.
虚拟现实(Virtual Reality)是利用程序模拟产生一个三维空间的虚拟世界,模拟产生视觉、听觉、触觉等感官,这样的情况下使用者可以如同身临其境一般及时、没有限制地观察三维空间内的事物。当使用者进行前后位置移动或者上下左右旋转时,传感器将这些信息传达给计算机,计算机经过快速而复杂的运算后再将精确的三维图像传回产生临场感。Virtual Reality is a virtual world that uses program simulation to generate a three-dimensional space. The simulation simulates the senses such as sight, hearing, and touch. In this case, the user can observe the three-dimensional space in a timely and unrestricted manner as if they were there. Things. When the user moves back and forth or rotates up, down, left, and right, the sensor communicates this information to the computer, and the computer passes the fast and complicated calculations and then returns the accurate three-dimensional image to produce a sense of presence.
本发明实施例可应用于如图1所示的场景架构,该场景架构中,用户可以通过数据手套、虚拟现实眼镜、终端(例如个人计算机、笔记本电脑、平板电脑、手机等)的信息交互,与虚拟世界的互动,体验虚拟世界中的视觉以及触觉感受。The embodiment of the present invention can be applied to the scenario architecture shown in FIG. 1 , in which the user can interact with information through data gloves, virtual reality glasses, terminals (such as personal computers, laptops, tablets, mobile phones, etc.). Interact with the virtual world to experience the visual and tactile sensations in the virtual world.
请参阅图2,本发明实施例中数据处理一个实施例包括:Referring to FIG. 2, an embodiment of data processing in an embodiment of the present invention includes:
201、虚拟现实眼镜与终端进行通信连接。201. The virtual reality glasses are connected to the terminal in communication.
本实施例中,虚拟现实眼镜与终端进行数据传输之前,需要与终端建立通信连接。In this embodiment, before the virtual reality glasses and the terminal perform data transmission, a communication connection needs to be established with the terminal.
需要说明的是,虚拟现实眼镜可以通过wifi连接终端,实际应用中也可以通过其他方式连接终端,例如蓝牙连接,具体此处不做限定。虚拟现实眼镜连接的终端可以为移动手机,也可以为其他终端,例如平板电脑,具体此处不做限定。It should be noted that the virtual reality glasses can be connected to the terminal through the wifi, and the terminal can be connected to the terminal in other manners, such as a Bluetooth connection, which is not limited herein. The terminal to which the virtual reality glasses are connected may be a mobile phone, or may be another terminal, such as a tablet computer, which is not limited herein.
202、终端发送虚拟环境信息至虚拟现实眼镜。202. The terminal sends the virtual environment information to the virtual reality glasses.
本实施例中,当终端与虚拟现实眼镜通信连接完成之后,终端发送虚拟环境信息至虚拟现实眼镜。In this embodiment, after the terminal completes the communication connection with the virtual reality glasses, the terminal sends the virtual environment information to the virtual reality glasses.
需要说明的是,用户可以在终端虚拟虚拟环境软件里面选择自己想体验的虚拟环境信息,然后终端根据用户的选择发送对应的虚拟环境信息至虚拟现实眼镜。It should be noted that the user can select the virtual environment information that he wants to experience in the terminal virtual virtual environment software, and then the terminal sends the corresponding virtual environment information to the virtual reality glasses according to the user's selection.
203、数据手套与虚拟现实眼镜进行通信连接。203. The data glove is connected to the virtual reality glasses.
本实施例中,据手套与虚拟现实眼镜之间要进行通信之前,数据手套与虚拟现实眼镜要先进行通信连接。In this embodiment, before the communication between the glove and the virtual reality glasses is performed, the data glove and the virtual reality glasses are first connected in communication.
需要说明的是,步骤203还可以在步骤201之前执行,也可以与步骤201同时执行,具体此处不做限定。It should be noted that step 203 may be performed before step 201 or may be performed simultaneously with step 201, which is not limited herein.
204、数据手套通过多个传感器获取人手姿态信息。204. The data glove acquires the posture information of the human hand through multiple sensors.
本实施例中,当数据手套与虚拟现实眼镜进行通信连接之后,操作者戴上该数据手套,数据手套将通过多个传感器获取人手姿态信息。In this embodiment, after the data glove is communicably connected with the virtual reality glasses, the operator wears the data glove, and the data glove acquires the hand posture information through the plurality of sensors.
需要说明的是,多个传感器中包括定位传感器和弯曲传感器,定位传感器用于采集人手的各个部位的位置信息,数据手套通过多个传感器获取人手姿态信息,数据手套根据人手的各个部位的位置信息确定出人手姿态信息。It should be noted that the plurality of sensors include a positioning sensor and a bending sensor. The positioning sensor is used to collect position information of each part of the human hand, and the data glove acquires the posture information of the human hand through multiple sensors, and the data glove is based on the position information of each part of the human hand. Determine the posture information of the human hand.
需要说明的是,人手姿态信息包括抓取信息、移动信息和旋转信息等。It should be noted that the posture information of the human hand includes the grab information, the movement information, the rotation information, and the like.
需要说明的是,人手姿态信息对虚拟环境中物体的抓取,移动和旋转操作,在虚拟现实眼镜中可以实时显示,让用户可以跟好地感受到虚拟环境的变化,增加与虚拟环境的互动。It should be noted that the gripping, moving and rotating operations of the object in the virtual environment can be displayed in real time in the virtual reality glasses, so that the user can feel the change of the virtual environment and increase the interaction with the virtual environment. .
需要说明的是,该人手姿态信息为实时人手姿态信息。It should be noted that the human hand posture information is real-time human hand posture information.
205、数据手套发送人手姿态信息至虚拟现实眼镜。205. The data glove sends the gesture information of the hand to the virtual reality glasses.
本实施例中,当数据手套获取到人手姿态信息之后,发送该人手姿态信息至虚拟现实眼镜。In this embodiment, after the data glove acquires the posture information of the human hand, the gesture information of the human hand is sent to the virtual reality glasses.
206、虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成姿态反馈信息。206. The virtual reality glasses generate attitude feedback information according to the posture information of the human hand and the virtual environment information.
本实施例中,虚拟现实眼镜通信连接终端,虚拟现实眼镜的镜片组从该终端获取到虚拟环境信息之后,将结合从数据手套接收到的人手姿态信息生成姿态反馈信息。In this embodiment, the virtual reality glasses communication connection terminal, after acquiring the virtual environment information from the terminal, the lens group of the virtual reality glasses generates attitude feedback information in combination with the human hand posture information received from the data glove.
需要说明的是,虚拟现实眼镜根据人手姿态信息与虚拟环境信息结合分析生成位置权重信息,虚拟现实眼镜根据位置权重信息生成姿态反馈信息。It should be noted that the virtual reality glasses generate position weight information according to the analysis of the human hand posture information and the virtual environment information, and the virtual reality glasses generate the posture feedback information according to the position weight information.
207、虚拟现实眼镜发送姿态反馈信息至数据手套。207. The virtual reality glasses send attitude feedback information to the data glove.
本实施例中,当虚拟现实眼镜生成姿态反馈信息之后,将发送该姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息,使得操作者能够实时感受到与虚拟家居的触觉感受。In this embodiment, after the virtual reality glasses generate the attitude feedback information, the attitude feedback information is sent to the data glove, so that the data glove generates the contact information according to the attitude feedback information, so that the operator can feel the tactile feeling with the virtual home in real time. .
208、数据手套根据姿态反馈信息生成接触信息。208. The data glove generates contact information according to the attitude feedback information.
本实施例中,当数据手套接收到姿态反馈信息之后,数据手套将通过弯曲传感器分析姿态反馈信息生成接触信息,使得操作者能够实时感受到与虚拟环境的触觉感受。In this embodiment, after the data glove receives the attitude feedback information, the data glove will generate the contact information by analyzing the posture feedback information by the bending sensor, so that the operator can feel the tactile sensation with the virtual environment in real time.
需要说明的是,虚拟现实眼镜包括: 虚拟现实显示器、与虚拟现实显示器相连接的镜片组,该虚拟现实显示器用于对显示源信号进行显示,包括两个相连呈一夹角的显示屏,分别为第一显示屏、第二显示屏,其中,第一显示屏与第二显示屏两者显示面的夹角大于90度。It should be noted that the virtual reality glasses include: a virtual reality display, a lens group connected to the virtual reality display, the virtual reality display is configured to display the display source signal, and the two display screens are connected at an angle, respectively The first display screen and the second display screen, wherein an angle between the display surfaces of the first display screen and the second display screen is greater than 90 degrees.
其中,该镜片组包括至少两片透镜的组合,一正透镜与一负透镜,用于对获取的图像信息进行处理,并发送至虚拟现实显示器进行显示。Wherein, the lens group comprises a combination of at least two lenses, a positive lens and a negative lens for processing the acquired image information and transmitting to the virtual reality display for display.
镜片组中的镜片之间均安装有防尘圈,这样能够起到防尘的作用,保证了镜片的清洁,延长了设备的使用寿命。镜片组中的镜片可以为高分子聚合物镜片也可以为其他镜片,例如磁性晶体镜片,具体此处不做限定。A dust seal is installed between the lenses in the lens group, which can play a dustproof function, ensure the cleaning of the lens, and prolong the service life of the device. The lenses in the lens group may be high molecular polymer lenses or other lenses, such as magnetic crystal lenses, which are not limited herein.
本发明实施例中,虚拟现实眼镜与终端和数据手套分别通信连接,虚拟现实眼镜从终端获取虚拟环境信息,数据手套通过传感器获取人手姿态信息,然后将该人手姿态信息发送至虚拟现实眼镜,虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成姿态反馈信息,虚拟现实眼镜发送姿态反馈信息至数据手套,数据手套根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, the data glove acquires the posture information of the human hand through the sensor, and then sends the posture information of the human hand to the virtual reality glasses, and virtual The realistic glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information, the virtual reality glasses send the attitude feedback information to the data glove, and the data glove generates the contact information according to the attitude feedback information. This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
请参阅图3,本发明实施例中数据处理令一个实施例包括:Referring to FIG. 3, an embodiment of the data processing in the embodiment of the present invention includes:
301、数据手套通过多个传感器获取人手姿态信息。301. The data glove acquires the posture information of the human hand through multiple sensors.
本实施例中,当数据手套与虚拟现实眼镜进行通信连接之后,操作者戴上该数据手套,数据手套将通过多个传感器获取人手姿态信息。In this embodiment, after the data glove is communicably connected with the virtual reality glasses, the operator wears the data glove, and the data glove acquires the hand posture information through the plurality of sensors.
需要说明的是,多个传感器中包括定位传感器和弯曲传感器,定位传感器用于采集人手的各个部位的位置信息,数据手套通过多个传感器获取人手姿态信息,数据手套根据人手的各个部位的位置信息确定出人手姿态信息。It should be noted that the plurality of sensors include a positioning sensor and a bending sensor. The positioning sensor is used to collect position information of each part of the human hand, and the data glove acquires the posture information of the human hand through multiple sensors, and the data glove is based on the position information of each part of the human hand. Determine the posture information of the human hand.
需要说明的是,人手姿态信息包括抓取信息、移动信息和旋转信息等。It should be noted that the posture information of the human hand includes the grab information, the movement information, the rotation information, and the like.
需要说明的是,人手姿态信息对虚拟环境中物体的抓取,移动和旋转操作,在虚拟现实眼镜中可以实时显示,让用户可以跟好地感受到虚拟环境的变化,增加与虚拟环境的互动。It should be noted that the gripping, moving and rotating operations of the object in the virtual environment can be displayed in real time in the virtual reality glasses, so that the user can feel the change of the virtual environment and increase the interaction with the virtual environment. .
需要说明的是,该人手姿态信息为实时人手姿态信息。It should be noted that the human hand posture information is real-time human hand posture information.
302、数据手套发送人手姿态信息至虚拟现实眼镜。302. The data glove sends the gesture information of the hand to the virtual reality glasses.
本实施例中,当数据手套获取到人手姿态信息之后,发送该人手姿态信息至虚拟现实眼镜。In this embodiment, after the data glove acquires the posture information of the human hand, the gesture information of the human hand is sent to the virtual reality glasses.
303、数据手套接收姿态反馈信息。303. The data glove receives the attitude feedback information.
本实施例中,当虚拟现实眼镜接收到数据手套发送的人手姿态信息之后,将会根据该人手姿态信息和从终端获取到的虚拟环境信息生成姿态反馈信息,再将该姿态反馈信息发送至数据手套。In this embodiment, after the virtual reality glasses receive the posture information of the human hand sent by the data glove, the posture feedback information is generated according to the posture information of the human hand and the virtual environment information acquired from the terminal, and the attitude feedback information is sent to the data. gloves.
304、数据手套根据姿态反馈信息生成接触信息。304. The data glove generates contact information according to the attitude feedback information.
本实施例中,当数据手套接收到姿态反馈信息之后,数据手套将通过弯曲传感器分析姿态反馈信息生成接触信息,使得操作者能够实时感受到与虚拟环境的触觉感受。In this embodiment, after the data glove receives the attitude feedback information, the data glove will generate the contact information by analyzing the posture feedback information by the bending sensor, so that the operator can feel the tactile sensation with the virtual environment in real time.
本发明实施例中,数据手套与虚拟现实眼镜通信连接,数据手套中包含多个传感器,虚拟现实眼镜与终端通信连接,虚拟现实眼镜从终端获取虚拟环境信息,数据手套通过多个传感器获取人手姿态信息,再发送人手姿态信息至虚拟现实眼镜,数据手套接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成,最后根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the data glove is communicatively connected with the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected with the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the data glove acquires the human hand gesture through multiple sensors. The information is sent to the virtual reality glasses, and the data glove receives the attitude feedback information. The attitude feedback information is generated by the virtual reality glasses according to the posture information of the human hand and the virtual environment information, and finally the contact information is generated according to the attitude feedback information. This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
请参阅图4,本发明实施例中数据处理另一个实施例包括:Referring to FIG. 4, another embodiment of data processing in an embodiment of the present invention includes:
401、虚拟现实眼镜接收数据手套发送的人手姿态信息。401. The virtual reality glasses receive the posture information of the human hand sent by the data glove.
本实施例中,当虚拟现实眼镜与数据手套通信连接,且该数据手套通过传感器获取到人手姿态信息之后,虚拟现实眼镜接收该数据手套发送的人手姿态信息。In this embodiment, after the virtual reality glasses are connected to the data glove, and the data glove acquires the human hand posture information through the sensor, the virtual reality glasses receive the human hand posture information sent by the data glove.
402、虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成姿态反馈信息。402. The virtual reality glasses generate attitude feedback information according to the posture information of the human hand and the virtual environment information.
本实施例中,虚拟现实眼镜通信连接终端,虚拟现实眼镜的镜片组从该终端获取到虚拟环境信息之后,将结合从数据手套接收到的人手姿态信息生成姿态反馈信息。In this embodiment, the virtual reality glasses communication connection terminal, after acquiring the virtual environment information from the terminal, the lens group of the virtual reality glasses generates attitude feedback information in combination with the human hand posture information received from the data glove.
需要说明的是,虚拟现实眼镜根据人手姿态信息与虚拟环境信息结合分析生成位置权重信息,虚拟现实眼镜根据位置权重信息生成姿态反馈信息。It should be noted that the virtual reality glasses generate position weight information according to the analysis of the human hand posture information and the virtual environment information, and the virtual reality glasses generate the posture feedback information according to the position weight information.
需要说明的是,虚拟现实眼镜可以通过wifi连接终端,实际应用中也可以通过其他方式连接终端,例如蓝牙连接,具体此处不做限定。虚拟现实眼镜连接的终端可以为移动手机,也可以为其他终端,例如平板电脑,具体此处不做限定。It should be noted that the virtual reality glasses can be connected to the terminal through the wifi, and the terminal can be connected to the terminal in other manners, such as a Bluetooth connection, which is not limited herein. The terminal to which the virtual reality glasses are connected may be a mobile phone, or may be another terminal, such as a tablet computer, which is not limited herein.
403、虚拟现实眼镜发送姿态反馈信息至数据手套。403. The virtual reality glasses send attitude feedback information to the data glove.
本实施例中,当虚拟现实眼镜生成姿态反馈信息之后,将发送该姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息,使得操作者能够实时感受到与虚拟家居的触觉感受。In this embodiment, after the virtual reality glasses generate the attitude feedback information, the attitude feedback information is sent to the data glove, so that the data glove generates the contact information according to the attitude feedback information, so that the operator can feel the tactile feeling with the virtual home in real time. .
需要说明的是,虚拟现实眼镜包括: 虚拟现实显示器、与虚拟现实显示器相连接的镜片组,该虚拟现实显示器用于对显示源信号进行显示,包括两个相连呈一夹角的显示屏,分别为第一显示屏、第二显示屏,其中,第一显示屏与第二显示屏两者显示面的夹角大于90度。It should be noted that the virtual reality glasses include: a virtual reality display, a lens group connected to the virtual reality display, the virtual reality display is configured to display the display source signal, and the two display screens are connected at an angle, respectively The first display screen and the second display screen, wherein an angle between the display surfaces of the first display screen and the second display screen is greater than 90 degrees.
其中,该镜片组包括至少两片透镜的组合,一正透镜与一负透镜,用于对获取的图像信息进行处理,并发送至虚拟现实显示器进行显示。Wherein, the lens group comprises a combination of at least two lenses, a positive lens and a negative lens for processing the acquired image information and transmitting to the virtual reality display for display.
镜片组中的镜片之间均安装有防尘圈,这样能够起到防尘的作用,保证了镜片的清洁,延长了设备的使用寿命。镜片组中的镜片可以为高分子聚合物镜片也可以为其他镜片,例如磁性晶体镜片,具体此处不做限定。A dust seal is installed between the lenses in the lens group, which can play a dustproof function, ensure the cleaning of the lens, and prolong the service life of the device. The lenses in the lens group may be high molecular polymer lenses or other lenses, such as magnetic crystal lenses, which are not limited herein.
本发明实施例中,虚拟现实眼镜与终端和数据手套分别通信连接,虚拟现实眼镜从终端获取虚拟环境信息,虚拟现实眼镜接收数据手套发送的人手姿态信息,人手姿态信息由数据手套通过传感器获取,传感器含于数据手套,虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成姿态反馈信息,虚拟现实眼镜发送姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, and the virtual reality glasses receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor. The sensor is included in the data glove, and the virtual reality glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information, and the virtual reality glasses send the attitude feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information. This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
为便于理解,下面结合具体的应用场景对本实施例进行描述:For ease of understanding, the following describes the embodiment in combination with a specific application scenario:
用户A想对自己的家进行重新装修布局,为了能更好了解装修布局的效果,用户A体验了家居装潢体验系统,具体场景如图1所示,首先用户A将虚拟现实眼镜通过wifi连接手机,在手机对应的软件上选择合适的家居场景信息,将虚拟现实眼镜与数据手套进行无线连接,戴上虚拟现实眼镜与数据手套。虚拟现实眼镜的镜片组会从手机中获取到家居场景信息,且触发显示器对该家居场景信息显示,根据眼镜当前的角度信息对家居场景信息进行处理,并将经过处理好的图像信息发送至眼镜,由眼镜进行投影显示。同时,用户A所戴的数据手套中的定位传感器获取用户A的人手姿态信息,例如,旋转、移动、抓取等姿态动作信息,数据手套将这些信息实时发送至虚拟现实眼镜,虚拟现实眼镜把该姿态动作信息与家居场景信息结合分析得到姿态反馈信息,然后虚拟现实眼镜把该姿态动作信息发送至数据手套,使得数据手套里的弯曲传感器根据该姿态动作信息做出对应的变形,使得用户A产生类似触摸家具等的触感。同时,用户A还可以使用该智能手套对虚拟家居场景里的家居摆设等进行移动和抓取等操作,而且该抓取和移动操作可在虚拟现实眼镜中显示,让用户A可以更好地体验到家居场景的合适摆设效果。User A wants to renovate the layout of his home. In order to better understand the effect of the decoration layout, User A has experienced the home decoration experience system. The specific scene is shown in Figure 1. First, User A connects the virtual reality glasses to the mobile phone via wifi. Select the appropriate home scene information on the software corresponding to the mobile phone, wirelessly connect the virtual reality glasses with the data gloves, and put on virtual reality glasses and data gloves. The lens group of the virtual reality glasses obtains the home scene information from the mobile phone, and triggers the display to display the home scene information, processes the home scene information according to the current angle information of the glasses, and sends the processed image information to the glasses. , projection display by glasses. At the same time, the positioning sensor in the data glove worn by the user A acquires the posture information of the user A, for example, the posture motion information such as rotation, movement, and grabbing, and the data glove sends the information to the virtual reality glasses in real time, and the virtual reality glasses The attitude motion information is combined with the home scene information to obtain the attitude feedback information, and then the virtual reality glasses send the gesture motion information to the data glove, so that the bending sensor in the data glove makes a corresponding deformation according to the posture motion information, so that the user A Produces a touch like touch furniture. At the same time, the user A can also use the smart glove to move and grab the home furnishings and the like in the virtual home scene, and the grabbing and moving operations can be displayed in the virtual reality glasses, so that the user A can experience better. The appropriate placement effect to the home scene.
用户A不仅能通过虚拟现实眼镜看到家居的3D场景画面演示,还能通过数据手套感觉到触摸家具的感觉,能以更加直接,更加自然,更加有效的方式与虚拟世界进行交互,大大增强了互动性和沉浸感,为操作者提供了一种通用、直接的人机交互方式。User A can not only see the 3D scene picture presentation of the home through the virtual reality glasses, but also feel the feeling of touching the furniture through the data glove, and can interact with the virtual world in a more direct, more natural and more effective way, greatly enhancing the Interactivity and immersion provide operators with a universal and direct way of human-computer interaction.
上面对本发明实施例中的数据处理方法进行了描述,下面对本发明实施例中的数据手套进行描述,请参阅图5,数据手套与虚拟现实眼镜通信连接,数据手套中包含多个传感器,虚拟现实眼镜与终端通信连接,虚拟现实眼镜从终端获取虚拟环境信息,数据手套包括:The data processing method in the embodiment of the present invention is described above. The data glove in the embodiment of the present invention is described below. Referring to FIG. 5, the data glove is connected with the virtual reality glasses, and the data glove includes multiple sensors, virtual reality. The glasses are connected to the terminal, and the virtual reality glasses obtain the virtual environment information from the terminal, and the data gloves include:
获取单元501,设置为通过多个传感器获取人手姿态信息;The obtaining unit 501 is configured to acquire the posture information of the human hand through the plurality of sensors;
第一发送单元502,设置为发送通过获取单元获取到的人手姿态信息至虚拟现实眼镜;The first sending unit 502 is configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
第一接收单元503,设置为接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成;The first receiving unit 503 is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
第一生成单元504,设置为根据接收单元接收到的姿态反馈信息生成接触信息。The first generating unit 504 is configured to generate contact information according to the attitude feedback information received by the receiving unit.
本发明实施例中,数据手套与虚拟现实眼镜通信连接,数据手套中包含多个传感器,虚拟现实眼镜与终端通信连接,虚拟现实眼镜从终端获取虚拟环境信息,获取单元501通过多个传感器获取人手姿态信息,第一发送单元502发送人手姿态信息至虚拟现实眼镜,第一接收单元503接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成,第一生成单元504根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the data glove is connected to the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected to the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the acquiring unit 501 acquires the human hand through the multiple sensors. The posture information, the first sending unit 502 sends the human hand posture information to the virtual reality glasses, the first receiving unit 503 receives the attitude feedback information, and the posture feedback information is generated by the virtual reality glasses according to the human hand posture information and the virtual environment information, and the first generating unit 504 is configured according to the The attitude feedback information generates contact information. This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
请参阅图6,本发明实施例中数据手套另一个实施例包括:Referring to FIG. 6, another embodiment of the data glove in the embodiment of the present invention includes:
获取单元601,设置为通过多个传感器获取人手姿态信息;The obtaining unit 601 is configured to acquire the posture information of the human hand through the plurality of sensors;
其中,获取单元601包括:The obtaining unit 601 includes:
确定子单元6011,设置为根据人手的各个部位的位置信息确定出人手姿态信息。The determining subunit 6011 is configured to determine the human hand posture information based on the position information of each part of the human hand.
第一发送单元602,设置为发送通过获取单元获取到的人手姿态信息至虚拟现实眼镜;The first sending unit 602 is configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
第一接收单元603,设置为接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成;The first receiving unit 603 is configured to receive attitude feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the gesture information of the human hand and the virtual environment information;
第一生成单元604,设置为根据接收单元接收到的姿态反馈信息生成接触信息。The first generating unit 604 is configured to generate contact information according to the attitude feedback information received by the receiving unit.
其中,第一生成单元604包括:The first generating unit 604 includes:
分析子单元6041,设置为通过弯曲传感器分析姿态反馈信息生成接触信息。The analysis subunit 6041 is configured to generate contact information by analyzing the attitude feedback information by the bending sensor.
本发明实施例中,数据手套与虚拟现实眼镜通信连接,数据手套中包含多个传感器,虚拟现实眼镜与终端通信连接,虚拟现实眼镜从终端获取虚拟环境信息,获取单元601通过多个传感器获取人手姿态信息,第一发送单元602发送人手姿态信息至虚拟现实眼镜,第一接收单元603接收姿态反馈信息,姿态反馈信息由虚拟现实眼镜根据人手姿态信息与虚拟环境信息生成,第一生成单元604根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the data glove is connected to the virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are connected to the terminal, the virtual reality glasses obtain the virtual environment information from the terminal, and the obtaining unit 601 acquires the human hand through the plurality of sensors. The posture information, the first sending unit 602 sends the human hand posture information to the virtual reality glasses, the first receiving unit 603 receives the posture feedback information, and the posture feedback information is generated by the virtual reality glasses according to the human hand posture information and the virtual environment information, and the first generating unit 604 is configured according to the The attitude feedback information generates contact information. This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
上面对本发明实施例中的数据手套进行了描述,下面对本发明实施例中的虚拟现实眼镜进行描述,请参阅图7,虚拟现实眼镜与终端和数据手套分别通信连接,虚拟现实眼镜从终端获取虚拟环境信息,具体包括:The data glove in the embodiment of the present invention is described above. The virtual reality glasses in the embodiment of the present invention are described below. Referring to FIG. 7, the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses obtain virtual from the terminal. Environmental information, including:
第二接收单元701,设置为接收数据手套发送的人手姿态信息,人手姿态信息由数据手套通过传感器获取,传感器含于数据手套;The second receiving unit 701 is configured to receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
第二生成单元702,设置为根据第二接收单元接收到的人手姿态信息与虚拟环境信息生成姿态反馈信息;The second generating unit 702 is configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit;
第二发送单元703,设置为发送生成单元生成的姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息。The second sending unit 703 is configured to send the attitude feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
本发明实施例中,虚拟现实眼镜与终端和数据手套分别通信连接,虚拟现实眼镜从终端获取虚拟环境信息,第二接收单元701接收数据手套发送的人手姿态信息,人手姿态信息由数据手套通过传感器获取,传感器含于数据手套,第二生成单元702根据人手姿态信息与虚拟环境信息生成姿态反馈信息,第二发送单元703发送姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the virtual reality glasses are respectively connected with the terminal and the data glove, and the virtual reality glasses acquire the virtual environment information from the terminal, and the second receiving unit 701 receives the posture information of the human hand sent by the data glove, and the posture information of the human hand passes the sensor through the data glove. Acquiring, the sensor is included in the data glove, the second generating unit 702 generates the attitude feedback information according to the human hand posture information and the virtual environment information, and the second sending unit 703 sends the posture feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information. . This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
请参阅图8,本发明实施例中虚拟现实眼镜另一个实施例包括:Referring to FIG. 8, another embodiment of the virtual reality glasses in the embodiment of the present invention includes:
第二接收单元801,设置为接收数据手套发送的人手姿态信息,人手姿态信息由数据手套通过传感器获取,传感器含于数据手套;The second receiving unit 801 is configured to receive the posture information of the human hand sent by the data glove, and the posture information of the human hand is acquired by the data glove through the sensor, and the sensor is included in the data glove;
第二生成单元802,设置为根据第二接收单元接收到的人手姿态信息与虚拟环境信息生成姿态反馈信息;The second generating unit 802 is configured to generate attitude feedback information according to the human hand posture information and the virtual environment information received by the second receiving unit;
其中,第二生成单元802包括:The second generating unit 802 includes:
第一生成子单元8021,设置为根据人手姿态信息与虚拟环境信息结合分析生成位置权重信息;The first generating sub-unit 8021 is configured to generate location weight information according to the analysis of the human hand posture information and the virtual environment information;
第二生成子单元8022,设置为根据由第一生成子单元生成的位置权重信息生成姿态反馈信息。The second generation subunit 8022 is configured to generate attitude feedback information according to the location weight information generated by the first generation subunit.
第二发送单元803,设置为发送生成单元生成的姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息。The second sending unit 803 is configured to send the attitude feedback information generated by the generating unit to the data glove, so that the data glove generates the contact information according to the attitude feedback information.
本发明实施例中,虚拟现实眼镜与终端和数据手套分别通信连接,虚拟现实眼镜从终端获取虚拟环境信息,第二接收单元801接收数据手套发送的人手姿态信息,人手姿态信息由数据手套通过传感器获取,传感器含于数据手套,第二生成单元802根据人手姿态信息与虚拟环境信息生成姿态反馈信息,第二发送单元803发送姿态反馈信息至数据手套,以使得数据手套根据姿态反馈信息生成接触信息。本实施例在视觉的虚拟现实场景中增加触觉的反馈,通过手指的活动实现与虚拟场景相互作用,为操作者提供了一种通用、直接的人机交互方式,提高了用户的体验。In the embodiment of the present invention, the virtual reality glasses are respectively connected with the terminal and the data glove, the virtual reality glasses acquire the virtual environment information from the terminal, the second receiving unit 801 receives the posture information of the human hand sent by the data glove, and the posture information of the human hand passes the sensor through the data glove. Acquiring, the sensor is included in the data glove, the second generating unit 802 generates the attitude feedback information according to the human hand posture information and the virtual environment information, and the second sending unit 803 sends the posture feedback information to the data glove, so that the data glove generates the contact information according to the attitude feedback information. . This embodiment adds tactile feedback in the visual virtual reality scene, and interacts with the virtual scene through the activity of the finger, thereby providing a universal and direct human-computer interaction mode for the operator, thereby improving the user experience.
图9是本发明实施例提供的一种数据手套结构示意图,该数据手套900可因配置或性能不同而产生比较大的差异,可以包括一个或一个以上中央处理器(central processing units,CPU)922(例如,一个或一个以上处理器)和存储器932,一个或一个以上存储应用程序942或数据944的存储介质930(例如一个或一个以上海量存储设备)。其中,存储器932和存储介质930可以是短暂存储或持久存储。存储在存储介质930的程序可以包括一个或一个以上模块(图示没标出),每个模块可以包括对数据手套中的一系列指令操作。更进一步地,中央处理器922可以设置为与存储介质930通信,在数据手套900上执行存储介质930中的一系列指令操作。FIG. 9 is a schematic structural diagram of a data glove according to an embodiment of the present invention. The data glove 900 may have a large difference due to different configurations or performances, and may include one or more central processing units (CPUs) 922. (eg, one or more processors) and memory 932, one or more storage media 930 that store application 942 or data 944 (eg, one or one storage device in Shanghai). Among them, the memory 932 and the storage medium 930 may be short-term storage or persistent storage. The program stored on storage medium 930 may include one or more modules (not shown), each of which may include a series of instruction operations in the data glove. Still further, central processor 922 can be configured to communicate with storage medium 930 to perform a series of instruction operations in storage medium 930 on data glove 900.
例如,在本发明的一个实施例中,所述存储介质930存储多个指令,所述多个指令被所述中央处理器922所执行以实现数据处理方法。具体而言,所述中央处理器922对所述多个指令的执行包括:通过多个传感器获取人手姿态信息;发送所述人手姿态信息至所述虚拟现实眼镜;接收姿态反馈信息,所述姿态反馈信息由所述虚拟现实眼镜根据所述人手姿态信息与所述虚拟环境信息生成;根据所述姿态反馈信息生成接触信息。For example, in one embodiment of the invention, the storage medium 930 stores a plurality of instructions that are executed by the central processor 922 to implement a data processing method. Specifically, the execution of the plurality of instructions by the central processing unit 922 includes: acquiring human hand posture information by using a plurality of sensors; transmitting the human hand posture information to the virtual reality glasses; and receiving attitude feedback information, the posture The feedback information is generated by the virtual reality glasses according to the human hand posture information and the virtual environment information; and the contact information is generated according to the posture feedback information.
在进一步的实施例中,所述中央处理器922还可根据所述人手的各个部位的位置信息确定出人手姿态信息。In a further embodiment, the central processing unit 922 can also determine the human hand posture information according to the position information of each part of the human hand.
在进一步的实施例中,所述中央处理器922还可通过所述弯曲传感器分析所述姿态反馈信息生成接触信息。In a further embodiment, the central processing unit 922 can also generate the contact information by analyzing the attitude feedback information by the bending sensor.
具体地,所述中央处理器922对上述指令的具体实现方法可参考图1-4对应实施例中相关步骤的描述,在此不赘述。For details, refer to the description of the related steps in the corresponding embodiment in FIG. 1-4, and the details are not described here.
数据手套900还可以包括一个或一个以上电源926,一个或一个以上有线或无线网络接口950,一个或一个以上输入输出接口958,和/或,一个或一个以上操作系统941,例如Windows ServerTM,Mac OS XTM,UnixTM, LinuxTM,FreeBSDTM等等。 Data glove 900 may also include one or more power supplies 926, one or more wired or wireless network interfaces 950, one or more input and output interfaces 958, and/or one or more operating systems 941, such as Windows ServerTM, Mac. OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
上述实施例中由服务器所执行的步骤可以基于该图9所示的服务器结构。The steps performed by the server in the above embodiment may be based on the server structure shown in FIG.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
以上所述,以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the embodiments are modified, or the equivalents of the technical features are replaced by the equivalents of the technical solutions of the embodiments of the present invention.

Claims (10)

  1. 一种数据处理方法,其特征在于,所述方法应用于数据手套,所述数据手套与虚拟现实眼镜通信连接,所述数据手套中包含多个传感器,所述虚拟现实眼镜与终端通信连接,所述虚拟现实眼镜从所述终端获取虚拟环境信息,所述方法包括:A data processing method, wherein the method is applied to a data glove, the data glove is communicatively connected with a virtual reality glasses, the data glove includes a plurality of sensors, and the virtual reality glasses are communicatively connected with the terminal. The virtual reality glasses obtain virtual environment information from the terminal, and the method includes:
    所述数据手套通过所述多个传感器获取人手姿态信息;The data glove acquires human gesture information through the plurality of sensors;
    所述数据手套发送所述人手姿态信息至所述虚拟现实眼镜;Transmitting, by the data glove, the gesture information of the human hand to the virtual reality glasses;
    所述数据手套接收姿态反馈信息,所述姿态反馈信息由所述虚拟现实眼镜根据所述人手姿态信息与所述虚拟环境信息生成;The data glove receives posture feedback information, and the attitude feedback information is generated by the virtual reality glasses according to the human hand posture information and the virtual environment information;
    所述数据手套根据所述姿态反馈信息生成接触信息。The data glove generates contact information according to the attitude feedback information.
  2. 根据权利要求1所述的数据处理方法,其特征在于,所述多个传感器中包括定位传感器和弯曲传感器,所述定位传感器用于采集人手的各个部位的位置信息;The data processing method according to claim 1, wherein the plurality of sensors comprise a positioning sensor and a bending sensor, and the positioning sensor is configured to collect position information of each part of the human hand;
    所述数据手套通过所述多个传感器获取人手姿态信息,包括:The data glove acquires the posture information of the human hand through the plurality of sensors, including:
    所述数据手套根据所述人手的各个部位的位置信息确定出人手姿态信息。The data glove determines the posture information of the human hand based on the position information of each part of the human hand.
  3. 根据权利要求1或2中任一项所述的数据处理方法,其特征在于,所述数据手套根据所述姿态反馈信息生成接触信息包括:The data processing method according to any one of claims 1 to 2, wherein the generating, by the data glove, the contact information according to the attitude feedback information comprises:
    所述数据手套通过所述弯曲传感器分析所述姿态反馈信息生成接触信息。The data glove analyzes the attitude feedback information by the bending sensor to generate contact information.
  4. 一种数据处理方法,其特征在于,所述方法应用于虚拟现实眼镜,所述虚拟现实眼镜与终端和数据手套分别通信连接,所述虚拟现实眼镜从所述终端获取虚拟环境信息,所述方法包括:A data processing method, the method is applied to virtual reality glasses, the virtual reality glasses are respectively connected with a terminal and a data glove, and the virtual reality glasses acquire virtual environment information from the terminal, the method include:
    所述虚拟现实眼镜接收所述数据手套发送的人手姿态信息,所述人手姿态信息由所述数据手套通过传感器获取,所述传感器含于所述数据手套;The virtual reality glasses receive the human hand posture information sent by the data glove, and the human hand posture information is acquired by the data glove through a sensor, and the sensor is included in the data glove;
    所述虚拟现实眼镜根据所述人手姿态信息与所述虚拟环境信息生成姿态反馈信息;The virtual reality glasses generate attitude feedback information according to the gesture information of the human hand and the virtual environment information;
    所述虚拟现实眼镜发送所述姿态反馈信息至所述数据手套,以使得所述数据手套根据所述姿态反馈信息生成接触信息。The virtual reality glasses send the attitude feedback information to the data glove, so that the data glove generates contact information according to the attitude feedback information.
  5. 根据权利要求4所述的数据处理方法,其特征在于,所述虚拟现实眼镜根据所述人手姿态信息与所述虚拟环境信息生成姿态反馈信息包括:The data processing method according to claim 4, wherein the generating, by the virtual reality glasses, the attitude feedback information according to the human hand posture information and the virtual environment information comprises:
    所述虚拟现实眼镜根据所述人手姿态信息与所述虚拟环境信息结合分析生成位置权重信息;The virtual reality glasses generate location weight information according to the analysis of the human hand posture information and the virtual environment information;
    所述虚拟现实眼镜根据所述位置权重信息生成所述姿态反馈信息。The virtual reality glasses generate the attitude feedback information according to the position weight information.
  6. 一种数据手套,其特征在于,所述数据手套与虚拟现实眼镜通信连接,所述数据手套中包含多个传感器,所述虚拟现实眼镜与终端通信连接,所述虚拟现实眼镜从所述终端获取虚拟环境信息,所述数据手套包括:A data glove, wherein the data glove is communicatively coupled to a virtual reality glasses, the data glove includes a plurality of sensors, the virtual reality glasses are communicatively coupled to the terminal, and the virtual reality glasses are acquired from the terminal Virtual environment information, the data glove includes:
    获取单元,设置为通过所述多个传感器获取人手姿态信息;An acquiring unit, configured to acquire human hand posture information by using the plurality of sensors;
    第一发送单元,设置为发送通过所述获取单元获取到的所述人手姿态信息至所述虚拟现实眼镜;a first sending unit, configured to send the gesture information of the human hand acquired by the acquiring unit to the virtual reality glasses;
    第一接收单元,设置为接收姿态反馈信息,所述姿态反馈信息由所述虚拟现实眼镜根据所述人手姿态信息与所述虚拟环境信息生成;a first receiving unit, configured to receive attitude feedback information, where the attitude feedback information is generated by the virtual reality glasses according to the human hand posture information and the virtual environment information;
    第一生成单元,设置为根据所述接收单元接收到的姿态反馈信息生成接触信息。The first generating unit is configured to generate contact information according to the attitude feedback information received by the receiving unit.
  7. 根据权利要求6所述的数据手套,其特征在于,所述多个传感器中包括定位传感器和弯曲传感器,所述定位传感器用于采集人手的各个部位的位置信息;The data glove according to claim 6, wherein the plurality of sensors comprise a positioning sensor and a bending sensor, wherein the positioning sensor is configured to collect position information of various parts of the human hand;
    获取单元包括:The acquisition unit includes:
    确定子单元,设置为根据所述人手的各个部位的位置信息确定出人手姿态信息。The determining subunit is configured to determine the human hand posture information according to the position information of each part of the human hand.
  8. 根据权利要求6或7中任一项所述的数据手套,其特征在于,所述第一生成单元包括:The data glove according to any one of claims 6 or 7, wherein the first generating unit comprises:
    分析子单元,设置为通过所述弯曲传感器分析所述姿态反馈信息生成接触信息。An analysis subunit is configured to generate contact information by analyzing the attitude feedback information by the bending sensor.
  9. 一种虚拟现实眼镜,其特征在于,所述虚拟现实眼镜与终端和数据手套分别通信连接,所述虚拟现实眼镜从所述终端获取虚拟环境信息,所述虚拟现实眼镜包括:A virtual reality glasses, wherein the virtual reality glasses are respectively connected to a terminal and a data glove, and the virtual reality glasses acquire virtual environment information from the terminal, and the virtual reality glasses include:
    第二接收单元,设置为接收所述数据手套发送的人手姿态信息,所述人手姿态信息由所述数据手套通过传感器获取,所述传感器含于所述数据手套;a second receiving unit, configured to receive the human hand posture information sent by the data glove, where the human hand posture information is acquired by the data glove through a sensor, and the sensor is included in the data glove;
    第二生成单元,设置为根据所述第二接收单元接收到的所述人手姿态信息与所述虚拟环境信息生成姿态反馈信息;a second generating unit, configured to generate attitude feedback information according to the human hand posture information received by the second receiving unit and the virtual environment information;
    第二发送单元,设置为发送所述生成单元生成的所述姿态反馈信息至所述数据手套,以使得所述数据手套根据所述姿态反馈信息生成接触信息。The second sending unit is configured to send the posture feedback information generated by the generating unit to the data glove, so that the data glove generates contact information according to the posture feedback information.
  10. 根据权利要求9所述的虚拟现实眼镜,其特征在于,所述第二生成单元包括:The virtual reality glasses according to claim 9, wherein the second generating unit comprises:
    第一生成子单元,设置为根据所述人手姿态信息与所述虚拟环境信息结合分析生成位置权重信息;a first generation subunit, configured to generate location weight information according to the analysis of the human gesture information and the virtual environment information;
    第二生成子单元,设置为根据由所述第一生成子单元生成的所述位置权重信息生成所述姿态反馈信息。The second generation subunit is configured to generate the attitude feedback information according to the position weight information generated by the first generation subunit.
PCT/CN2016/108026 2016-10-25 2016-11-30 Data processing method and related device thereof WO2018076454A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610949073.4A CN106502407A (en) 2016-10-25 2016-10-25 A kind of data processing method and its relevant device
CN201610949073.4 2016-10-25

Publications (1)

Publication Number Publication Date
WO2018076454A1 true WO2018076454A1 (en) 2018-05-03

Family

ID=58323014

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/108026 WO2018076454A1 (en) 2016-10-25 2016-11-30 Data processing method and related device thereof

Country Status (2)

Country Link
CN (1) CN106502407A (en)
WO (1) WO2018076454A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114727676A (en) * 2020-04-16 2022-07-08 鹏鼎控股(深圳)股份有限公司 Virtual reality glove and manufacturing method thereof

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107422845A (en) * 2017-04-18 2017-12-01 小派科技(上海)有限责任公司 A kind of virtual reality wears display device and picture display process
CN108681401A (en) * 2018-05-14 2018-10-19 南京联迈信息科技有限公司 A kind of VR experience types house ornamentation network platform system
CN109032343B (en) * 2018-07-04 2022-02-11 青岛理工大学 Industrial man-machine interaction system and method based on vision and haptic augmented reality

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102176888A (en) * 2008-08-25 2011-09-07 苏黎世大学数学和自然科学部 Adjustable virtual reality system
CN102789313A (en) * 2012-03-19 2012-11-21 乾行讯科(北京)科技有限公司 User interaction system and method
CN102906623A (en) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 Local advertising content on an interactive head-mounted eyepiece
CN104007844A (en) * 2014-06-18 2014-08-27 原硕朋 Electronic instrument and wearable type input device for same

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1696872A (en) * 2004-05-13 2005-11-16 中国科学院自动化研究所 Glove capable of feeding back data of touch sensation
CN103823911A (en) * 2012-11-19 2014-05-28 大连鑫奇辉科技有限公司 Digital assembly system on basis of virtual reality

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102176888A (en) * 2008-08-25 2011-09-07 苏黎世大学数学和自然科学部 Adjustable virtual reality system
CN102906623A (en) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 Local advertising content on an interactive head-mounted eyepiece
CN102789313A (en) * 2012-03-19 2012-11-21 乾行讯科(北京)科技有限公司 User interaction system and method
CN104007844A (en) * 2014-06-18 2014-08-27 原硕朋 Electronic instrument and wearable type input device for same

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114727676A (en) * 2020-04-16 2022-07-08 鹏鼎控股(深圳)股份有限公司 Virtual reality glove and manufacturing method thereof

Also Published As

Publication number Publication date
CN106502407A (en) 2017-03-15

Similar Documents

Publication Publication Date Title
WO2018076454A1 (en) Data processing method and related device thereof
WO2017140079A1 (en) Interaction control method and apparatus for virtual reality
WO2016114610A1 (en) Virtual input device and method for receiving user input using the same
WO2015122566A1 (en) Head mounted display device for displaying augmented reality image capture guide and control method for the same
WO2017126741A1 (en) Hmd device and method for controlling same
WO2016028097A1 (en) Wearable device
Tachi Telexistence: Enabling humans to be virtually ubiquitous
WO2018076912A1 (en) Virtual scene adjusting method and head-mounted intelligent device
EP3161546A1 (en) Glasses-type mobile terminal
WO2012173373A2 (en) 3d device and 3d game device using a virtual touch
WO2016107231A1 (en) System and method for inputting gestures in 3d scene
WO2017107445A1 (en) Method and system for acquiring immersed feeling in virtual reality system, and intelligent glove
JP7081052B2 (en) Displaying device sharing and interactivity in simulated reality (SR)
WO2022158820A1 (en) Systems and methods for manipulating views and shared objects in xr space
WO2017052150A1 (en) User terminal device, electronic device, and method of controlling user terminal device and electronic device
WO2022158953A1 (en) Extended reality interaction in synchronous virtual spaces using heterogeneous devices
WO2020130692A1 (en) Method, system, and non-transitory computer-readable recording medium for generating animation sequence
WO2019135634A1 (en) Method and apparatus to navigate a virtual content displayed by a virtual reality (vr) device
WO2015163529A1 (en) Head mounted display device displaying thumbnail image and method of controlling therefor
WO2019135550A1 (en) Electronic device for controlling image display based on scroll input and method thereof
WO2016088922A1 (en) Method for providing interface using mobile device and wearable device
WO2021086018A1 (en) Method for displaying three-dimensional augmented reality
WO2012034469A1 (en) Gesture-based human-computer interaction method and system, and computer storage media
WO2017164545A1 (en) Display device and method for controlling display device
WO2022145888A1 (en) Method for controlling augmented reality device, and augmented reality device performing same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16919658

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16919658

Country of ref document: EP

Kind code of ref document: A1