CN110413121A - A kind of control method of virtual reality device, virtual reality device and storage medium - Google Patents

A kind of control method of virtual reality device, virtual reality device and storage medium Download PDF

Info

Publication number
CN110413121A
CN110413121A CN201910689955.5A CN201910689955A CN110413121A CN 110413121 A CN110413121 A CN 110413121A CN 201910689955 A CN201910689955 A CN 201910689955A CN 110413121 A CN110413121 A CN 110413121A
Authority
CN
China
Prior art keywords
virtual reality
user
reality device
iris
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910689955.5A
Other languages
Chinese (zh)
Other versions
CN110413121B (en
Inventor
贾玉虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910689955.5A priority Critical patent/CN110413121B/en
Publication of CN110413121A publication Critical patent/CN110413121A/en
Application granted granted Critical
Publication of CN110413121B publication Critical patent/CN110413121B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H5/00Exercisers for the eyes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Epidemiology (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Rehabilitation Therapy (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pain & Pain Management (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A kind of control method of virtual reality device, virtual reality device and storage medium, the sensor of the iris information for obtaining user is provided on the virtual reality device, first relative position of the client iris compared to sensor when facing the center of lens of virtual reality device by obtaining user, and obtain the information of the iris of the user of sensor acquisition, second relative position of the iris compared to sensor is determined based on the information of acquisition, it can be based on first, the position of two relative positions and sensor and eyeglass in virtual reality device, determine the offset direction of client iris;And then it controls virtual scene and is moved based on offset direction, realize the purpose that the movement of virtual scene is controlled according to the offset direction of iris, compared to control mode single in the related technology, the application provides richer Virtual space control mode for user, be conducive to that user is stimulated to participate in the visual exercise effect for promoting user in the display control of virtual scene more initiatively.

Description

A kind of control method of virtual reality device, virtual reality device and storage medium
Technical field
This application involves technical field of virtual reality more particularly to a kind of control methods of virtual reality device, virtual existing Real equipment and storage medium.
Background technique
Currently, with the development of virtual reality (Virtual Reality, VR) technology and popularizing for virtual reality device, More and more users can be immersed in different simulated environments by virtual reality device.The development of technology is so that virtual existing Real equipment can also provide other services other than providing game services for user for user, and for example, user provides view Feel the training service of function.
In the related technology, visual exercise be usually in the virtual reality scenario of display, the user visual field front successively Origin And Destination is set, so that observation of the user based on the route to beginning and end, controls itself sight along starting point extremely Terminal is mobile, with this training user's vision.But during this visual exercise, the sight of user is only by virtual reality device In the guidance of preset virtual reality scenario, passively tandem is mobile.So in the related technology, virtual reality scenario Display control mode is relatively simple, and user's participation is relatively low, poor to the visual exercise effect of user.
Summary of the invention
The embodiment of the present application provides control method, virtual reality device and the storage medium of a kind of virtual reality device, very The display control mode that virtual reality scenario is enriched in big degree, is conducive to promote the visual exercise effect to user.
The embodiment of the present application first aspect provides a kind of control method of virtual reality device, which is head Formula equipment is worn, is provided with the rainbow of left eye and/or right eye for obtaining user on virtual reality device close to user's face side The sensor of film information, the control method include:
When the user that the virtual reality device is worn in acquisition faces the center of lens of the virtual reality device, the use First relative position of the iris at family compared to the sensor;
The information for obtaining the iris of the user of the sensor acquisition, determines the rainbow based on the information of acquisition Second relative position of the film compared to the sensor;
It is set based on first relative position, the second relative position and the sensor and eyeglass in the virtual reality Position in standby, determines the offset direction of the iris of the user;
The virtual scene that the virtual reality device is shown is controlled to be moved based on the offset direction.
The embodiment of the present application second aspect provides a kind of virtual reality device, which is headset equipment, The biography of the iris information of left eye and/or right eye for obtaining user is provided on virtual reality device close to user's face side Sensor, virtual reality device further include:
Module is obtained, the user of the virtual reality device is worn for obtaining and faces the eyeglass of the virtual reality device When center, the first relative position of the iris of the user compared to the sensor;
Processing module, the information of the iris of the user for obtaining the sensor acquisition, based on described in acquisition Information determines second relative position of the iris compared to the sensor;
Determining module, for being existed based on first relative position, the second relative position and the sensor and eyeglass Position in the virtual reality device determines the offset direction of the iris of the user;
Control module is moved for controlling the virtual scene that the virtual reality device is shown based on the offset direction It is dynamic.
The embodiment of the present application third aspect provides a kind of virtual reality device, and virtual reality device is headset equipment, empty The sensing of the iris information of left eye and/or right eye for obtaining user is provided in quasi- real world devices close to user's face side Device, virtual reality device further include: memory, processor and storage are on a memory and the computer that can run on a processor Program when processor executes computer program, realizes the step in the method provided such as the embodiment of the present application first aspect.
The embodiment of the present application fourth aspect provides a kind of storage medium, is applied to virtual reality device, and virtual reality is set Standby is headset equipment, and close user's face side is provided with left eye and/or the right side for obtaining user on virtual reality device The sensor of eye iris information is stored with computer program on storage medium, when computer program is executed by processor, realizes The step of method that the embodiment of the present application first aspect provides.
The embodiment of the present application provides control method, virtual reality device and the storage medium of a kind of virtual reality device, The virtual reality device is headset equipment, thereon close to user's face side be provided with left eye for obtaining user and/or The sensor of the iris information of right eye, the available user for wearing virtual reality device face in the eyeglass of virtual reality device When the heart, the first relative position of the iris of user compared to sensor;By the letter for obtaining the iris of the user of sensor acquisition Breath, determines second relative position of the iris compared to sensor based on the information of acquisition, is based further on the first relative position, the The position of two relative positions and sensor and eyeglass in virtual reality device, so that it is determined that the offset side of the iris of user To;The virtual scene that control virtual reality device is shown is based on offset direction and is moved, and thus the embodiment of the present application can root It is single compared in the related technology according to the moving direction for the virtual scene that the offset direction control virtual reality device of iris is shown Virtual space control mode, the application provides richer Virtual space control mode for user, is conducive to stimulate user In the display control for participating in virtual scene more initiatively, to effectively promote the visual exercise effect of user.
Detailed description of the invention
Fig. 1 is the flow diagram of the control method for the virtual reality device that the application first embodiment provides;
Fig. 2 is the flow diagram of the control method of the virtual reality device refined in the application second embodiment;
Fig. 3 is to determine whether user faces the mirror of virtual reality device by three-dimensional system of coordinate in the application second embodiment The schematic diagram at piece center;
Fig. 4 is a kind of structural schematic diagram for virtual reality device that the application 3rd embodiment provides;
Fig. 5 is the structural schematic diagram for another virtual reality device that the application 3rd embodiment provides.
Specific embodiment
To enable present invention purpose, feature, advantage more obvious and understandable, below in conjunction with the application Attached drawing in embodiment, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described reality Applying example is only some embodiments of the present application, and not all embodiments.Based on the embodiment in the application, those skilled in the art Member's every other embodiment obtained without making creative work, shall fall in the protection scope of this application.
First embodiment:
The present embodiment provides the control mode of richer, flexible virtual scene, user in the control mode for user It can control moving left and right for active virtual scene, be conducive to that user is stimulated to participate in visual exercise more positively, mention Rise user's visual exercise effect.
The embodiment of the invention provides a kind of control methods of virtual reality device, wherein the virtual reality device is head Wear formula equipment, on the virtual reality device close to user's face side be provided with left eye for obtaining the user and/or The sensor of the iris information of right eye, referring to Fig. 1, the control method of the virtual reality device includes:
When step 101, the user for obtaining wearing virtual reality device face the center of lens of virtual reality device, user's First relative position of the iris compared to sensor;
In the present embodiment, user can face detection with regard to carrying out user after the beginning such as virtual game or visual exercise, It determines the first relative position mentioned in step 101, during the display of virtual scene later, directly uses first phase To position.
Optionally, in the present embodiment, when obtaining the first relative position, the rainbow based on sensor to user is needed The iris of acquisition confirmation user and the center of lens of sensor of film information are overlapped, and just determine the user for wearing virtual reality device Face the center of lens of virtual reality device.
Further, the sensor in the present embodiment is direction sensor, and type includes but is not limited to optical sensor, Such as camera.The rainbow that two sensors acquire left eye and right eye respectively can be set in the present embodiment on virtual reality device The iris information of a sensor acquisition left eye or right eye can also be arranged only with save the cost in film information, and the present embodiment is to this There is no limit.
Optionally, in the present embodiment, sensor be can be set on the shell around two eyeglasses of virtual reality device, And the probe of sensor exposes to the shell;Alternatively, sensor can also be mounted on the center of eyeglass, in eyeglass Heart location settings sensor is conducive to more quickly determine iris and whether the center of lens of sensor is overlapped, and is conducive to The offset direction of iris is more quickly determined in subsequent step.Optionally, in the present embodiment camera focusing range and visual field Angle can determine at a distance from eyes of user according to the eyeglass of virtual reality device under normal circumstances, for example, camera is poly- Burnt range is 10 millimeters to 100 millimeters, and the range of field angle is 50 degree to 120 degree.
Step 102, obtain sensor acquisition user iris information, based on acquisition information determine iris compared to Second relative position of sensor;
Optionally, the information of the iris of the user acquired in the present embodiment includes but is not limited to that sensor cover shoots human eye Image.In step 102, it is available acquire the iris information when sensor acquisition parameters (such as focal length, field angle with And axis direction of camera lens of sensor etc.), and obtain the position of iris in the image that sensor acquires;Joined based on shooting The several and position of iris in the picture, determines second relative position of the iris compared to sensor.In the present embodiment, step 101 It include but is not limited to direction of the iris compared to sensor and distance with the information of relative position in 102.
It is understood that can establish coordinate system, such as establish three-dimensional system of coordinate in the present embodiment, joined according to shooting The several and position of iris in the picture determines the coordinates of sensor and iris in three-dimensional system of coordinate, and the is indicated in a manner of coordinate Two relative positions.
Optionally, when determining the position of iris in the picture, iris can be determined by preset Iris-orientation Algorithm Position, wherein preset Iris-orientation Algorithm includes but is not limited to geometrical characteristic positioning mode and Active contour models positioning mode Etc., after detecting the iris in image, it may further determine that the position of iris center in the picture is being schemed as iris Position as in.
Step 103 is based on the first relative position, the second relative position and sensor and eyeglass in virtual reality device Position, determine the offset direction of the iris of user;
Optionally, in one embodiment, based on the first relative position, the second relative position and sensor and eyeglass in void Position in quasi- real world devices, determines that the offset direction of the iris of user includes: to set based on sensor and eyeglass in virtual reality Position in standby, determines relative position of the sensor relative to the center of eyeglass, using the relative position as third relative position; Based on the first relative position, the second relative position and third relative position, the offset direction of the iris of user is determined.
In an example A, the offset direction of the iris of user includes: the iris of active user compared to user's orthoptoscope The offset direction of iris when piece center.In this example, can be based only on the first relative position, current time it is second opposite The position of position and sensor and eyeglass in virtual reality device, determines the offset direction of the iris of user;Base is not needed The variation of the second relative position is in one section of duration before current time to determine lasting movement side of the iris in the duration To.The control mode of virtual scene in step 104 corresponding to the example is also fairly simple, and for a user, it is only necessary to So that sight, which is slightly moved to left or moved to right, can control moving left and right for virtual scene.
In another example B, the offset direction of the iris of user include: current time before one section of duration in user The lasting moving direction of iris, the second relative position in one section of duration before needing in this example based on current time with And the position of sensor and eyeglass in virtual reality device, determine the iris of user in one section of duration before current time Continue moving direction.
The virtual scene that step 104, control virtual reality device are shown is based on offset direction and is moved.
Optionally, in above-mentioned steps 104 it is iris when facing center of lens compared to user according to the iris of user The lasting moving direction of the iris of user in offset direction or one section of duration before current time, control virtual scene move It is dynamic.
For example, in above-mentioned example A, if iris when the iris of active user faces center of lens compared to user Offset direction is to deviate to the left, then in step 104, the virtual scene that control virtual reality device is shown is moved to right;Show in above-mentioned In example B, if the lasting moving direction of the iris of user is persistently to move right in one section of duration before current time, control The virtual scene of display is moved to the left.
A kind of control method of virtual reality device is present embodiments provided, the virtual reality device in the present embodiment is head Formula equipment is worn, is provided with the biography of the iris information of the left eye and/or right eye for obtaining user close to user's face side thereon Sensor, control method through this embodiment, the available user for wearing virtual reality device face virtual reality device When center of lens, the first relative position of the iris of user compared to sensor;By the rainbow for obtaining the user of sensor acquisition The information of film determines second relative position of the iris compared to sensor based on the information of acquisition, and it is opposite to be based further on first The position of position, the second relative position and sensor and eyeglass in virtual reality device, so that it is determined that the iris of user Offset direction;The virtual scene that show of control virtual reality device is moved based on offset direction, and thus the present embodiment can be with The moving direction that the virtual scene that virtual reality device is shown is controlled according to the offset direction of iris, it is single compared in the related technology One Virtual space control mode, the present embodiment provides the Virtual space control mode of more visual directions for user, significantly rich Rich Virtual space control mode, is conducive to the initiative for stimulating user to participate in, to effectively promote the visual exercise effect of user Fruit.
Second embodiment:
Referring to fig. 2, a kind of control method of the virtual reality device of refinement is present embodiments provided, the control method packet It includes:
Step 201, after virtual reality device detects and faces detection triggering command, control sensor acquisition is worn virtual The iris information of the user of real world devices;
Step 202 determines relative position of the iris compared to sensor based on the iris information of acquisition, based on sensor and Position and relative position of the eyeglass of virtual reality device on virtual reality device, determine iris in the plane where eyeglass Projection whether be overlapped with the center of eyeglass;
If step 203, iris are overlapped in the projection of the plane where eyeglass with the center of eyeglass, by iris compared to biography The relative position of sensor is as the first relative position;
Above-mentioned steps 201-203 is the refinement step of step 101 in first embodiment.
In step 201, the triggering for facing detection triggering command can be there are many mode, can be by setting to virtual reality The operation triggering for the hardware button being arranged on standby shell, which generates, faces detection triggering command, can also trigger by other means just Inspection surveys triggering command.Optionally, before step 201, further includes: obtain audio user by the sound that microphone acquires user File analyzes the audio file and determines whether user inputs the keyword that detection triggering command is faced in triggering, if so, generating just Inspection surveys triggering command.Alternatively, before step 201, further includes: whether the vision-training system on detection virtual reality device opens Dynamic, if detecting, the vision-training system starting on virtual reality device generates when vision-training system start completion Face detection triggering command.Optionally, after detection triggering command is faced in generation, this is faced detection triggering by virtual reality device Instruction is sent to control and executes the module of visual exercise with the operation of starting step 201-206.
In above-mentioned steps 202, iris can be determined in the throwing of the plane where eyeglass by setting three-dimensional system of coordinate Whether shadow is overlapped with the center of eyeglass.
The three-dimensional system of coordinate can be arranged according to the position of eyeglass and sensor in virtual reality device, for example, with The center of the corresponding eyeglass of right eye is origin, horizontal in the face xy with the plane where two eyeglasses for the face xy (or the face xz or the face yz) Direction is x-axis, and vertical direction is y-axis, and with the direction perpendicular to plane where eyeglass, the straight line by origin is z-axis.Other show It, can also be using the corresponding sensor of left eye or the corresponding sensor of right eye or other preset reference points as origin, this reality in example Example is applied to be not limited in this respect.
Optionally, step 202 specifically includes: according to the eyeglass of sensor and virtual reality device on virtual reality device Position be arranged three-dimensional system of coordinate, and determine three-dimensional system of coordinate in virtual unit eyeglass center the first coordinate and biography Second coordinate of sensor;Relative position of the iris compared to sensor is determined based on the iris information of acquisition;Based on this with respect to position It sets and the second coordinate determines third coordinate of the iris in three-dimensional system of coordinate, iris is determined based on the first coordinate and third coordinate Whether it is overlapped in the projection of the plane where eyeglass with the center of eyeglass.
For example, participating in Fig. 3, two circular patterns A1 and A2 in Fig. 3 respectively indicate the left and right two of virtual reality device Eyeglass, using the corresponding center of lens of right eye as origin (0,0,0) in Fig. 3, the coordinate of the center of lens of left eye is (x1,0,0), In, the absolute value of x1 is the distance at the center of left and right spectacle lens, in example shown in Fig. 3, two sensings on virtual reality device Device B1 and B2 are located at the surface at the center of two eyeglasses A1 and A2.For the example of Fig. 3, three are established in step 202 After tieing up coordinate system, the seat of two sensors B1 and B2 can be determined according to the distance in vertical direction of sensor to center of lens Mark is respectively (0,0, z1) and (x1,0, z1) later, can be true according to the iris of left eye information and iris of right eye information of acquisition Fixed relative position of the left eye iris compared to the sensor on the left side, opposite position of the right eye iris compared to the sensor of right eye It sets, on this basis further combined with the coordinate of two sensors, seat of the available images of left and right eyes iris in three-dimensional system of coordinate Mark.For example, showing the coordinate (0, y1,0) of right eye C1 in three-dimensional system of coordinate in Fig. 3, the coordinate of coordinate and A 1 based on C1 can Whether the projection with the right eye iris of determination in the plane (face xz in Fig. 3) where eyeglass is overlapped with the center of lens of right eye, It is similar to the judgement of iris of left eye, herein without repeating.
In above-mentioned example, if iris is overlapped in the projection of the plane where eyeglass with corresponding center of lens, then it is assumed that use Face the center of lens of virtual reality device in family.
Step 204, obtain sensor acquisition user iris information, based on acquisition information determine iris compared to Second relative position of sensor;
Step 205 is based on the first relative position, the second relative position and sensor and eyeglass in virtual reality device Position, determine the offset direction of the iris of user;
The virtual scene that step 206, control virtual reality device are shown is based on offset direction and is moved.
Above-mentioned steps 204-206 corresponds to the step 102-104 of first embodiment, and description is joined as described in step 204-206 See the corresponding part in first embodiment, details are not described herein for the present embodiment.
In an example of the present embodiment, sensor is set to center of lens, in above-mentioned three-dimensional system of coordinate, in eyeglass The position of the heart is the position of sensor, and the meter that can further decrease each position and relative position in the present embodiment is arranged in this Calculation amount, and then the data processing amount in the control program of reduction virtual scene are conducive to promote virtual reality device response user The speed of iris offset direction promotes user's use feeling.
Further, in the present embodiment, the first relative position, the second relative position and sensor are based in step 205 With position of the eyeglass in virtual reality device, determine that the offset direction of the iris of user includes the following steps a-e:
Step a, three-dimensional system of coordinate is established, the position based on sensor and eyeglass in virtual reality device is sat in three-dimensional The coordinate of sensor and the coordinate of center of lens are determined in mark system;
For step a, if having been set up three-dimensional system of coordinate in above-mentioned steps 202, and three-dimensional seat is had determined that The coordinate position of sensor and center of lens in mark system, then need not execute step a, directly acquire the coordinate system in step 202 Related content in above-mentioned steps 202 is then used if in above-mentioned steps 202 and not setting up three-dimensional system of coordinate with corresponding coordinate The scheme of description realizes above-mentioned steps a.
Step b, the coordinate based on the first relative position and sensor determines that user faces eyeglass in three-dimensional system of coordinate The coordinate of iris when center, connects the coordinate points of iris in three-dimensional system of coordinate and the coordinate points of corresponding center of lens obtain the One line;
It is understood that being separately connected left eye in three-dimensional system of coordinate if sensor is arranged corresponding to right and left eyes Iris and the corresponding center of lens of left eye and right eye iris and the corresponding center of lens of right eye, obtain two the first lines.
Step c, the coordinate based on the second relative position and sensor determines the actual bit of the iris in three-dimensional system of coordinate The coordinate set, the coordinate points that the physical location of iris is connected in three-dimensional system of coordinate are obtained with the coordinate points of corresponding center of lens Second line;
Correspondingly, being separately connected left eye rainbow in three-dimensional system of coordinate in step c if sensor is arranged corresponding to right and left eyes The corresponding center of lens of physical location and left eye of film, the corresponding center of lens of physical location and right eye of iris of right eye, obtains Two the second lines.
Step d, the space angle of the first line and corresponding second line in three-dimensional system of coordinate is determined;
Step e, the offset direction of the iris of user is determined based on space angle.
Optionally, in the present embodiment, offset direction is based in the virtual scene that control virtual reality device is shown and is moved Before dynamic, further includes: the iris of the user acquired in the period based on one section of preset length of the sensor before current time Information determines migration velocity of the iris along offset direction of user;The void that virtual reality device is shown is determined based on migration velocity The target movement speed of quasi- scene.
Optionally, the target movement speed for determining virtual scene that virtual reality device is shown based on migration velocity includes: The target movement speed of the virtual scene shown using migration velocity as virtual reality device, alternatively, obtaining preset offset speed The table of comparisons of degree and virtual scene movement speed determines that the corresponding virtual scene of the migration velocity of iris is mobile in the table of comparisons Speed is as target movement speed.
Accordingly, the virtual scene that control virtual reality device is shown is based on offset direction and carries out movement to include: that control is empty The virtual scene that quasi- real world devices are shown is based on offset direction and is moved with target movement speed.
In one embodiment, can by detection user's eye motion to the locomotive function of virtual scene carry out locking and Unlock, optionally, after the virtual scene that control virtual reality device is shown carries out movement based on offset direction, further includes: logical Sensor to be crossed to continue to acquire the iris information of user, the iris information based on acquisition determines the first eye motion of user, if the One eye motion belongs to the default eye motion of corresponding lock operation, then locks the locomotive function of virtual scene;Pass through sensor Continue the iris information of acquisition user, the position of iris information and sensor and eyeglass in virtual reality device based on acquisition It sets, determines whether user faces the center of lens of virtual reality device, if so, releasing the lock to the locomotive function of virtual scene It is fixed.
In a specific embodiment, continue the iris information of acquisition user, the iris based on acquisition by sensor Information determines the first eye motion of user, if the first eye motion belongs to the default eye motion of corresponding lock operation, locks Determine virtual scene locomotive function include: by sensor continue acquire user iris information, the iris information based on acquisition, Determine whether user continuously blinks and the number continuously blinked and the adjacent time interval blinked twice are all satisfied preset requirement;If It is then to lock the locomotive function of virtual scene.
In the scheme of above-mentioned locking and unlocking locomotive function, continuous number of winks in preset requirement and adjacent blink twice Time interval any setting for example can be required to the visual exercise of user according to demand, such as continuous number of winks is two Secondary, the time interval blinked twice is no more than 2s.For based on acquisition iris information and sensor and eyeglass virtually existing Position in real equipment, determines whether user faces the center of lens of virtual reality device, may refer to basis in foregoing teachings Three-dimensional system of coordinate judges whether user faces the scheme of the center of lens of virtual reality device, and details are not described herein.
In another example, if user misoperation has carried out the locking of locomotive function, then user can issue releasing The movement of error lock is released with the error lock of the locomotive function to virtual scene.Optionally, error lock is released Movement, which can be, issues preset voice messaging, or implements operation identical with locking locomotive function.Further, if In preset time period (such as 5s) after locking locomotive function, detect that user continuously blinks and the number continuously blinked and adjacent The time interval blinked twice is all satisfied preset requirement, it is determined that lock operation before is maloperation, is released to virtual scene Locomotive function locking.
Further, offset direction is based in the virtual scene that control virtual reality device is shown in the present embodiment to be moved After dynamic, further includes: continue to acquire the iris information of user by sensor, iris information and sensor based on acquisition and Position of the eyeglass in virtual reality device, determines whether user faces center of lens;If so, being based on iris information, determine User faces the continuous duration of center of lens;If the continuous duration that user faces center of lens is not less than the first preset threshold, Control virtual scene is moved backward compared to user.Optionally, determining that user faces the continuous duration of center of lens and be not less than After first preset threshold, if determining that user also persistently faces center of lens based on the iris information detected, virtual field is promoted The movement speed of scape.
Further, offset direction is based in the virtual scene that control virtual reality device is shown in the present embodiment to be moved After dynamic, further includes: continue to acquire the iris information of user by sensor, whether the iris information based on acquisition determines user It closes one's eyes;If so, being based on iris information, the continuous duration that user closes one's eyes is determined;If the continuous duration that user closes one's eyes is not less than the Two preset thresholds then control virtual scene and move forward compared to user.Optionally, the continuous duration of user's eye closing is being determined not After the second preset threshold, if determining that user is also continuously in closed-eye state based on the iris information detected, void is promoted The movement speed of quasi- scene.
Further, the pause button of entity can also be set on the virtual reality device in the present embodiment, if detecting The pause button is pressed, then controls virtual scene pause.
In another embodiment, the pause of the detection control virtual scene to iris, such as virtual reality can also be passed through The corresponding preset condition of pausing operation, the scheme of the present embodiment are prestored in equipment further include: acquisition is continued by sensor and is used The iris information at family determines the second human eye movement of user based on the iris information of acquisition, if second human eye movement meets in advance If condition, then virtual scene pause is controlled.The preset condition includes but is not limited to, continuously blink etc. three times.
, can also be by whether knowing in adjacent a few frame images in the image sequence of analyte sensors acquisition in the present embodiment Not Chu iris determine whether user blinks, or pass through the distance of upper lower eyelid in the image sequence that analyte sensors acquire and become Change and determines whether user blinks.
The control method of the virtual reality device of the present embodiment can control virtual reality according to the offset direction of iris and set The moving direction of the virtual scene of standby display, compared to Virtual space control mode single in the related technology, the present embodiment is User provides the Virtual space controls mode such as Virtual space control mode, and pause, F.F., rewind of more visual directions, Be conducive to the initiative for stimulating user to participate in, to effectively promote the visual exercise effect of user.
3rd embodiment:
Referring to fig. 4, a kind of virtual reality device, the virtual reality device are headset equipment, are leaned on virtual reality device Nearly user's face side is provided with the sensor of the iris information of left eye and/or right eye for obtaining user, and virtual reality is set It is standby further include:
Module 401 is obtained, the user for obtaining wearing virtual reality device faces the center of lens of virtual reality device When, the first relative position of the iris of user compared to sensor;
Processing module 402, the information of the iris of the user for obtaining sensor acquisition, determines rainbow based on the information of acquisition Second relative position of the film compared to sensor;
Determining module 403, for being based on the first relative position, the second relative position and sensor and eyeglass virtually existing Position in real equipment determines the offset direction of the iris of user;
Control module 404 is moved for controlling the virtual scene that virtual reality device is shown based on offset direction.
Further, module 401 is obtained, for controlling after virtual reality device detects and faces detection triggering command The iris information of the user of virtual reality device is worn in sensor acquisition;Determine iris compared to biography based on the iris information of acquisition The relative position of sensor, position and opposite position of the eyeglass based on sensor and virtual reality device on virtual reality device It sets, determines whether iris is overlapped in the projection of the plane where eyeglass with the center of eyeglass;If iris is in the plane where eyeglass Projection be overlapped with the center of eyeglass, then the relative position using iris compared to sensor is as the first relative position.
Further, determining module 403 are set based on sensor and eyeglass in virtual reality for establishing three-dimensional system of coordinate Position in standby determines the coordinate of sensor and the coordinate of center of lens in three-dimensional system of coordinate;Based on the first relative position with And the coordinate of sensor, the coordinate of iris when user faces center of lens in three-dimensional system of coordinate is determined, in three-dimensional system of coordinate The coordinate points of connection iris obtain the first line with the coordinate points of corresponding center of lens;Based on the second relative position and sensing The coordinate of device determines the coordinate of the physical location of iris in three-dimensional system of coordinate, and the reality of iris is connected in three-dimensional system of coordinate The coordinate points of position obtain the second line with the coordinate points of corresponding center of lens;Determine the first line in three-dimensional system of coordinate With the space angle of corresponding second line;The offset direction of the iris of user is determined based on space angle.
In one embodiment, virtual reality device further includes speed determination module, for controlling void in control module 404 Before the virtual scene that quasi- real world devices are shown carries out movement based on offset direction, based on one section of sensor before current time The iris information of the user acquired in the period of preset length, determines migration velocity of the iris along offset direction of user;Base The target movement speed for the virtual scene that virtual reality device is shown is determined in migration velocity.Corresponding, control module 404 is specific It is moved for controlling the virtual scene that virtual reality device is shown based on offset direction with target movement speed.
In another embodiment, virtual reality device further includes locking and unlocking module, for controlling in control module 404 After the virtual scene that virtual reality device processed is shown carries out movement based on offset direction, continue the rainbow for acquiring user by sensor Film information, the iris information based on acquisition determine whether user continuously blinks and the number continuously blinked and adjacent blink twice Time interval be all satisfied preset requirement;If so, the locomotive function of locking virtual scene;Continue to acquire user by sensor Iris information, the position of iris information and sensor and eyeglass in virtual reality device based on acquisition determines user Whether center of lens is faced, if so, releasing the locking to the locomotive function of virtual scene.
In another embodiment, virtual reality device further includes F.F. module, for controlling virtually in control module 404 After the virtual scene that real world devices are shown carries out movement based on offset direction, believed by the iris that sensor continues to acquire user Breath, the position of iris information and sensor and eyeglass in virtual reality device based on acquisition determines whether user faces Center of lens;If so, being based on iris information, determine that user faces the continuous duration of center of lens;If user faces in eyeglass The continuous duration of the heart is not less than the first preset threshold, then controls virtual scene and move backward compared to user.
In another embodiment, virtual reality device further includes rewind module, for controlling virtually in control module 404 After the virtual scene that real world devices are shown carries out movement based on offset direction, believed by the iris that sensor continues to acquire user Breath, determines whether user closes one's eyes based on the iris information of acquisition;If so, being based on iris information, determine that user closes one's eyes continuous Duration;If the continuous duration that user closes one's eyes is not less than the second preset threshold, controls virtual scene and moved forward compared to user.
Further, referring to Fig. 5, the present embodiment also provides a kind of virtual reality device, and the virtual reality device is head Wear formula equipment, on the virtual reality device close to user's face side be provided with left eye for obtaining the user and/or The sensor 501 of the iris information of right eye, virtual reality device further include: memory 502, processor 503, bus 504 and deposit Store up the computer program that can be run on memory 502 and on processor 503, sensor 501, memory 502 and processing Device 503 is connected by bus 504.When processor executes the computer program, realize virtual in Fig. 1 and embodiment illustrated in fig. 2 The control method of real world devices.Wherein, the quantity of processor can be one or more.
Memory 502 can be high random access memory body (RAM, Random Access Memory) memory, It can be non-labile memory (non-volatile memory), such as magnetic disk storage.Memory 502 can for storing Program code is executed, processor 503 is coupled with memory 502.
Further, the embodiment of the present application also provides a kind of storage medium, which, which can be, is set to this reality It applies in the virtual reality device in example, which can be the memory in aforementioned embodiment illustrated in fig. 5.
It is stored with computer program on the storage medium, which realizes Fig. 1 and Fig. 2 embodiment institute when being executed by processor The control method of the virtual reality device shown.Further, which can also be USB flash disk, mobile hard disk, read-only memory The various media that can store program code such as (ROM, Read-Only Memory), RAM, magnetic or disk.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it Its mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of module, only A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple module or components can combine or Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of device or module It connects, can be electrical property, mechanical or other forms.
Module may or may not be physically separated as illustrated by the separation member, show as module Component may or may not be physical module, it can and it is in one place, or may be distributed over multiple networks In module.Some or all of the modules therein can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
It, can also be in addition, can integrate in a processing module in each functional module in each embodiment of the application It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould Block both can take the form of hardware realization, can also be realized in the form of software function module.
If integrated module is realized and when sold or used as an independent product in the form of software function module, can To be stored in a computer readable storage medium.Based on this understanding, the technical solution of the application substantially or Say that all or part of the part that contributes to existing technology or the technical solution can embody in the form of software products Out, which is stored in a readable storage medium storing program for executing, including some instructions are used so that a computer Equipment (can be personal computer, server or the network equipment etc.) execute each embodiment method of the application whole or Part steps.And readable storage medium storing program for executing above-mentioned includes: that USB flash disk, mobile hard disk, ROM, RAM, magnetic or disk etc. are various can be with Store the medium of program code.
It should be noted that for the various method embodiments described above, describing for simplicity, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because According to the application, certain steps can use other sequences or carry out simultaneously.Secondly, those skilled in the art should also know It knows, the embodiments described in the specification are all preferred embodiments, and related actions and modules might not all be this Shen It please be necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, it may refer to the associated description of other embodiments.
The above are the control methods to virtual reality device provided herein, virtual reality device and storage medium Description, for those skilled in the art, according to the thought of the embodiment of the present application, in specific embodiments and applications It will change, to sum up, the contents of this specification should not be construed as limiting the present application.

Claims (10)

1. a kind of control method of virtual reality device, which is characterized in that the virtual reality device is headset equipment, described The iris information of left eye and/or right eye for obtaining the user is provided on virtual reality device close to user's face side Sensor, the control method includes:
When the user that the virtual reality device is worn in acquisition faces the center of lens of the virtual reality device, the user's First relative position of the iris compared to the sensor;
The information for obtaining the iris of the user of the sensor acquisition, determines the iris phase based on the information of acquisition Compared with the second relative position of the sensor;
Based on first relative position, the second relative position and the sensor and eyeglass in the virtual reality device Position, determine the offset direction of the iris of the user;
The virtual scene that the virtual reality device is shown is controlled to be moved based on the offset direction.
2. the control method of virtual reality device according to claim 1, which is characterized in that the void is worn in the acquisition When the user of quasi- real world devices faces the center of lens of the virtual reality device, the iris of the user is compared to the sensing First relative position of device includes:
After the virtual reality device detects and faces detection triggering command, it is described virtual to control the sensor acquisition wearing The iris information of the user of real world devices;
Determine relative position of the iris compared to the sensor based on the iris information of acquisition, based on the sensor and Position and the relative position of the eyeglass of the virtual reality device on the virtual reality device, determine the iris Whether it is overlapped in the projection of the plane where the eyeglass with the center of the eyeglass;
If the iris is overlapped in the projection of the plane where the eyeglass with the center of the eyeglass, the iris is compared In the relative position of the sensor as first relative position.
3. the control method of virtual reality device according to claim 1, which is characterized in that described to be based on first phase To the position of position, the second relative position and the sensor and eyeglass in the virtual reality device, the use is determined The offset direction of the iris at family includes:
Three-dimensional system of coordinate is established, the position based on the sensor and eyeglass in the virtual reality device, in the three-dimensional The coordinate of the sensor and the coordinate of the center of lens are determined in coordinate system;
Coordinate based on first relative position and the sensor is determining the user described in the three-dimensional system of coordinate just Depending on the coordinate of iris described when the center of lens, connected in the three-dimensional system of coordinate coordinate points of the iris with it is corresponding The coordinate points of center of lens obtain the first line;
Coordinate based on second relative position and the sensor determines the iris described in the three-dimensional system of coordinate The coordinate of physical location, connected in the three-dimensional system of coordinate coordinate points of the physical location of the iris in corresponding eyeglass The coordinate points of the heart obtain the second line;
Determine the space angle of first line and corresponding second line in the three-dimensional system of coordinate;
The offset direction of the iris of the user is determined based on the space angle.
4. the control method of virtual reality device according to claim 1, which is characterized in that described virtual in the control Before the virtual scene that real world devices are shown carries out movement based on the offset direction, further includes:
The iris of the user acquired in the period of one section of preset length based on the sensor before current time Information determines migration velocity of the iris along the offset direction of the user;
The target movement speed for the virtual scene that the virtual reality device is shown is determined based on the migration velocity;
The virtual scene that the control virtual reality device is shown carries out movement based on the offset direction and includes:
The virtual scene that the virtual reality device is shown is controlled to carry out based on the offset direction with the target movement speed It is mobile.
5. the control method of virtual reality device according to claim 1-4, which is characterized in that in the control After the virtual scene that the virtual reality device is shown carries out movement based on the offset direction, further includes:
Continue to acquire the iris information of the user by the sensor, the iris information based on acquisition, determine described in Whether user continuously blinks and the number continuously blinked and the adjacent time interval blinked twice are all satisfied preset requirement;
If so, locking the locomotive function of the virtual scene;
Continue to acquire the iris information of the user, the iris information and the biography based on acquisition by the sensor The position of sensor and the eyeglass in the virtual reality device, determines whether the user faces the center of lens, if It is then to release the locking to the locomotive function of the virtual scene.
6. the control method of virtual reality device according to claim 1-4, which is characterized in that in the control After the virtual scene that the virtual reality device is shown carries out movement based on the offset direction, further includes:
The iris information for continuing to acquire the user by the sensor, the iris information based on acquisition and described The position of sensor and the eyeglass in the virtual reality device, determines whether the user faces the center of lens;
If so, being based on the iris information, determine that the user faces the continuous duration of the center of lens;
If the user faces the continuous duration of the center of lens not less than the first preset threshold, the virtual scene is controlled It is moved backward compared to the user.
7. the control method of virtual reality device according to claim 1-4, which is characterized in that in the control After the virtual scene that the virtual reality device is shown carries out movement based on the offset direction, further includes:
The iris information for continuing to acquire the user by the sensor, determines the use based on the iris information of acquisition Whether close one's eyes at family;
If so, being based on the iris information, the continuous duration that the user closes one's eyes is determined;
If the continuous duration that the user closes one's eyes is not less than the second preset threshold, the virtual scene is controlled compared to the use Family moves forward.
8. a kind of virtual reality device, which is characterized in that the virtual reality device is headset equipment, and the virtual reality is set Standby close user's face side is provided with the sensor of the iris information of left eye and/or right eye for obtaining the user, The virtual reality device further include:
Module is obtained, the user of the virtual reality device is worn for obtaining and faces the center of lens of the virtual reality device When, the first relative position of the iris of the user compared to the sensor;
Processing module, the information of the iris of the user for obtaining the sensor acquisition, the information based on acquisition Determine second relative position of the iris compared to the sensor;
Determining module, for being based on first relative position, the second relative position and the sensor and eyeglass described Position in virtual reality device determines the offset direction of the iris of the user;
Control module is moved for controlling the virtual scene that the virtual reality device is shown based on the offset direction.
9. a kind of virtual reality device, which is characterized in that the virtual reality device is headset equipment, and the virtual reality is set Standby close user's face side is provided with the sensor of the iris information of left eye and/or right eye for obtaining the user, The virtual reality device further include: memory, processor and be stored on the memory and can transport on the processor Capable computer program when the processor executes the computer program, realizes side described in any one of claim 1-7 Step in method.
10. a kind of storage medium, which is characterized in that the storage medium application is set in virtual reality device, the virtual reality Standby is headset equipment, and close user's face side is provided with the left eye for obtaining the user on the virtual reality device And/or the sensor of the iris information of right eye, computer program is stored on the storage medium, and the computer program is located When managing device execution, the step in any one the method in claim 1-7 is realized.
CN201910689955.5A 2019-07-29 2019-07-29 Control method of virtual reality equipment, virtual reality equipment and storage medium Active CN110413121B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910689955.5A CN110413121B (en) 2019-07-29 2019-07-29 Control method of virtual reality equipment, virtual reality equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910689955.5A CN110413121B (en) 2019-07-29 2019-07-29 Control method of virtual reality equipment, virtual reality equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110413121A true CN110413121A (en) 2019-11-05
CN110413121B CN110413121B (en) 2022-06-14

Family

ID=68363764

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910689955.5A Active CN110413121B (en) 2019-07-29 2019-07-29 Control method of virtual reality equipment, virtual reality equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110413121B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930236A (en) * 2020-08-17 2020-11-13 Oppo广东移动通信有限公司 Device control method, device, storage medium and electronic device
CN116983194A (en) * 2023-08-02 2023-11-03 广州视景医疗软件有限公司 VR-based vision adjustment training method, device, equipment and medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090237492A1 (en) * 2008-03-18 2009-09-24 Invism, Inc. Enhanced stereoscopic immersive video recording and viewing
CN104007909A (en) * 2013-02-25 2014-08-27 腾讯科技(深圳)有限公司 Page automatic adjusting method and device
CN106527696A (en) * 2016-10-31 2017-03-22 宇龙计算机通信科技(深圳)有限公司 Method for implementing virtual operation and wearable device
CN106708270A (en) * 2016-12-29 2017-05-24 宇龙计算机通信科技(深圳)有限公司 Display method and apparatus for virtual reality device, and virtual reality device
CN107765851A (en) * 2017-09-28 2018-03-06 努比亚技术有限公司 Applied program processing method, terminal and storage medium based on iris recognition
US20180098908A1 (en) * 2016-10-10 2018-04-12 Shun-Yuan Chien Visual acuity training device and visual acuity training methods
CN107908285A (en) * 2017-11-13 2018-04-13 联想(北京)有限公司 A kind of data processing method, apparatus and system
CN108027644A (en) * 2015-09-30 2018-05-11 华为技术有限公司 A kind of method for starting eyeball tracking function and mobile equipment
WO2018222018A1 (en) * 2017-06-01 2018-12-06 Samsung Electronics Co., Ltd. Systems and methods for window control in virtual reality environment
CN109453015A (en) * 2018-10-24 2019-03-12 广州视景医疗软件有限公司 A kind of visual stimulus device based on virtual reality
CN109521871A (en) * 2018-10-22 2019-03-26 广州视景医疗软件有限公司 A kind of training method of fusion function, device, equipment and storage medium
CN109645953A (en) * 2019-01-25 2019-04-19 北京十维度科技有限公司 Vision-based detection and training method, device and VR equipment
CN109662873A (en) * 2018-12-12 2019-04-23 广州视景医疗软件有限公司 The method and its system of eye movement training based on VR

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090237492A1 (en) * 2008-03-18 2009-09-24 Invism, Inc. Enhanced stereoscopic immersive video recording and viewing
CN104007909A (en) * 2013-02-25 2014-08-27 腾讯科技(深圳)有限公司 Page automatic adjusting method and device
CN108027644A (en) * 2015-09-30 2018-05-11 华为技术有限公司 A kind of method for starting eyeball tracking function and mobile equipment
US20180098908A1 (en) * 2016-10-10 2018-04-12 Shun-Yuan Chien Visual acuity training device and visual acuity training methods
CN106527696A (en) * 2016-10-31 2017-03-22 宇龙计算机通信科技(深圳)有限公司 Method for implementing virtual operation and wearable device
CN106708270A (en) * 2016-12-29 2017-05-24 宇龙计算机通信科技(深圳)有限公司 Display method and apparatus for virtual reality device, and virtual reality device
WO2018222018A1 (en) * 2017-06-01 2018-12-06 Samsung Electronics Co., Ltd. Systems and methods for window control in virtual reality environment
CN107765851A (en) * 2017-09-28 2018-03-06 努比亚技术有限公司 Applied program processing method, terminal and storage medium based on iris recognition
CN107908285A (en) * 2017-11-13 2018-04-13 联想(北京)有限公司 A kind of data processing method, apparatus and system
CN109521871A (en) * 2018-10-22 2019-03-26 广州视景医疗软件有限公司 A kind of training method of fusion function, device, equipment and storage medium
CN109453015A (en) * 2018-10-24 2019-03-12 广州视景医疗软件有限公司 A kind of visual stimulus device based on virtual reality
CN109662873A (en) * 2018-12-12 2019-04-23 广州视景医疗软件有限公司 The method and its system of eye movement training based on VR
CN109645953A (en) * 2019-01-25 2019-04-19 北京十维度科技有限公司 Vision-based detection and training method, device and VR equipment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JONAS SCHILD等: "Applying Multi-User Virtual Reality to Collaborative Medical Training", 《2018 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR)》 *
郭荣华: "基于虚拟现实技术的篮球运动三维仿真研究", 《自动化与仪器仪表》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930236A (en) * 2020-08-17 2020-11-13 Oppo广东移动通信有限公司 Device control method, device, storage medium and electronic device
CN111930236B (en) * 2020-08-17 2023-06-20 Oppo广东移动通信有限公司 Equipment control method and device, storage medium and electronic equipment
CN116983194A (en) * 2023-08-02 2023-11-03 广州视景医疗软件有限公司 VR-based vision adjustment training method, device, equipment and medium
CN116983194B (en) * 2023-08-02 2024-04-26 广州视景医疗软件有限公司 VR-based vision adjustment training method, device, equipment and medium

Also Published As

Publication number Publication date
CN110413121B (en) 2022-06-14

Similar Documents

Publication Publication Date Title
KR102491438B1 (en) Face model capture by wearable device
Wang et al. Human computer interaction with head pose, eye gaze and body gestures
CN104536579B (en) Interactive three-dimensional outdoor scene and digital picture high speed fusion processing system and processing method
KR20190084260A (en) Full-face image around eye and audio synthesis
CN106125903B (en) Multi-person interaction system and method
KR20170089260A (en) Apparatus and Method for Generating 3D Face Model using Mobile Device
WO2016021034A1 (en) Algorithm for identifying three-dimensional point of gaze
JP2018124666A (en) Information processing method, information processing device and program causing computer to execute information processing method
CN109696954A (en) Eye-controlling focus method, apparatus, equipment and storage medium
KR20160094190A (en) Apparatus and method for tracking an eye-gaze
JP6563580B1 (en) Communication system and program
CN110413121A (en) A kind of control method of virtual reality device, virtual reality device and storage medium
US20180147110A1 (en) Sexual interaction device and method for providing an enhanced computer mediated sexual experience to a user
JP7160669B2 (en) Program, Information Processing Apparatus, and Method
CN109358754A (en) A kind of mixed reality wears display system
CN109224432A (en) Control method, device, storage medium and the wearable device of entertainment applications
JP2018120520A (en) Communication method through virtual space, program causing computer to execute method, and information processing device to execute program
JP2019159501A (en) Program for reflecting movement of user on avatar, information processing device for executing program, and method for distributing video including avatar
Hwang et al. Monoeye: Monocular fisheye camera-based 3d human pose estimation
JP2019032844A (en) Information processing method, device, and program for causing computer to execute the method
JP2023095862A (en) Program and information processing method
KR101610496B1 (en) Method and apparatus for gaze tracking
US11988901B2 (en) Two-eye tracking based on measurements from a pair of electronic contact lenses
JP6855561B1 (en) Dialysis patient exercise support system and dialysis patient exercise support device and their methods and programs
JP6999538B2 (en) Information processing methods, information processing programs, information processing systems, and information processing equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant