CN105975158A - Virtual reality interaction method and device - Google Patents
Virtual reality interaction method and device Download PDFInfo
- Publication number
- CN105975158A CN105975158A CN201610309443.8A CN201610309443A CN105975158A CN 105975158 A CN105975158 A CN 105975158A CN 201610309443 A CN201610309443 A CN 201610309443A CN 105975158 A CN105975158 A CN 105975158A
- Authority
- CN
- China
- Prior art keywords
- image
- hand
- virtual
- tool
- virtual reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention embodiment provides a virtual reality interaction method and device; the method mainly comprises the following steps: using a camera to obtain entity images in a preset scope in front of a virtual reality VR device; identifying a hand shape contained in the entity image; rendering a virtual tool image matched with the hand shape in the present virtual reality image, wherein the virtual tool image comprises a hand identification. Compared with the prior art, the novel method and device can provide more convenient virtual reality interactions.
Description
Technical field
The present embodiments relate to Computer Applied Technology field, particularly relate to a kind of virtual reality mutual
Method and device.
Background technology
Along with socioeconomic development, computer has become as the important composition portion that people live indispensable
Point, and the man-machine interaction of close friend the most already becomes the problem that people are concerned about very much.From command interface in early days
Multimedia interface, up-to-date virtual reality is arrived again to graphic user interface.Man-machine interaction has developed
To a new field.
Virtual reality (Virtual Reality is called for short VR) is to utilize computer graphics system and various reality
The interface equipments such as control, provide in three-dimensional environment that generate on computers, can be mutual and immerse sensation
Technology.Be embodied in: by wear corresponding head mounted display (Head-mounted Display,
Be called for short HMD) etc. VR equipment, make the audition of user and visual performance be completely disposed in virtual environment also
And cut off all of external information, so that user can roam in virtual reality, experience the most true to nature
The illusory world that be enough to " fascination " human vision.
But just because of after wearing HDM, cut off all of external information, so user is except void
Anything in true environment is can't see, including the operation handle corresponding with VR equipment outside the image intended
Deng all can only blind grasping.In order to solve the problem of blind behaviour, the solution provided in prior art is:
Carry out when rendering of virtual image, be individually for arm and the hands modeling of user, and be rendered into virtual image
In, make user can see oneself virtual arm and hands in virtual image.But virtual arm and
Hands is high unity with the position of actual arm and hands, is typically only capable to realize some actions etc. captured,
A lot of inconvenience is implemented for some more complicated actions, it is clear that VR of the prior art is mutual
Scheme is not reasonable.
Summary of the invention
The embodiment of the present invention provides the method and device that a kind of virtual reality is mutual, in order to solve existing VR
The irrational problem of interaction schemes.
The embodiment of the present invention provides a kind of method that virtual reality is mutual, and described method includes:
The entity image in the range of Virtual Reality equipment front preset is obtained by photographic head；
Identify the hand comprised in described entity image；
The image of the virtual tool corresponding with described hand is rendered in current virtual real world images, described
The image of virtual tool comprises staff mark.
The embodiment of the present invention provides the device that a kind of virtual reality is mutual, and described device includes:
Acquiring unit, for obtaining the reality in the range of Virtual Reality equipment front preset by photographic head
Body image；
First recognition unit, for identifying the hand comprised in described entity image；
First rendering unit, for rendering the void corresponding with described hand in current virtual real world images
The image of plan instrument, comprises staff mark in the image of described virtual tool.
The mutual method and device of virtual reality that the embodiment of the present invention provides, it is possible to first obtained by photographic head
Take the entity image in the range of VR equipment front preset, then identify the hand comprised in entity image,
Finally render corresponding with hand in the current virtual reality image that user is seen by this VR equipment
The image of virtual tool, and the image of virtual tool comprises staff mark.Compared with prior art,
The embodiment of the present invention can obtain the entity image in VR equipment front by photographic head, and according to entity shadow
The hand comprised in Xiang renders the figure of the virtual tool with staff mark of correspondence in virtual image
Picture, it is achieved that the different hand that will identify that be converted to render in virtual reality image different with
The image of the virtual tool of staff mark, then can realize the operation to virtual tool further, make void
The mode intending reality mutual is the most convenient.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that under,
Accompanying drawing during face describes is some embodiments of the present invention, for those of ordinary skill in the art,
On the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
The flow chart of the method that a kind of virtual reality that Fig. 1 provides for the embodiment of the present invention is mutual；
The composition frame chart of the device that a kind of virtual reality that Fig. 2 provides for the embodiment of the present invention is mutual；
The composition frame chart of the device that another kind of virtual reality that Fig. 3 provides for the embodiment of the present invention is mutual.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with this
Accompanying drawing in bright embodiment, is clearly and completely described the technical scheme in the embodiment of the present invention,
Obviously, described embodiment is a part of embodiment of the present invention rather than whole embodiments.Based on
Embodiment in the present invention, those of ordinary skill in the art are obtained under not making creative work premise
The every other embodiment obtained, broadly falls into the scope of protection of the invention.
Embodiments provide a kind of method that virtual reality is mutual, as it is shown in figure 1, the method bag
Include:
101, the entity image in the range of Virtual Reality equipment front preset is obtained by photographic head.
Photographic head in the present embodiment is positioned at the front of VR equipment, and the most where is placed in front
It is not construed as limiting, but the scope of photographic head capture must include the range of activity of user's arm.Additionally image
Head with the relation of VR equipment can be: photographic head is directly embedded on VR equipment one as VR equipment
Ingredient；Or photographic head is as a self-contained unit, by specific external interface or connection member
Combine with VR equipment.Additionally in view of in order to increase the more preferable feeling of immersion of user, some situation may need
Will experience in dark environment, therefore photographic head should also have the function of night vision, therefore can root
According to being actually needed, the photographic head such as infrared photography selecting to have night vision function is first-class.
The entity image obtained is primarily referred to as wearing user oneself arm of VR equipment and the current activity of hands
State, obtaining entity image is for the form of the arm and hands analyzing user in real time, then according to arm
And the form of hands carries out rendering of corresponding virtual tool.
102, the hand comprised in entity image is identified.
Transfer Built-in Image processing system, make the image processing system entity shadow to being got by step 101
As carrying out graphical analysis.Specifically include: from entity image, first isolate the image of staff；The most right
The hand that the image of staff presents is identified.Hand is primarily referred to as being gone out by finger and/or palm stroke
Different gestures, such as " shears " type gesture, " fist " type gesture etc..It addition, different situations
Under can only identify specific gesture, specific gesture is to predefine in advance, as long as having carried out predefined
Gesture just can be identified.For user when experiencing different virtual reality image, can identify
Specific gesture is typically the content setting according to the concrete virtual reality image experienced.
103, in current virtual real world images, render the image of the virtual tool corresponding with hand.
After being identified the hand in entity image by step 102, can be according to hand at virtual reality image
In render the image of virtual tool of correspondence, wherein virtual reality image is that user is currently by VR equipment
The virtual image seen.The most corresponding different virtual tool of difform hand, hand and virtual work
Corresponding relation between tool is predefined.Such as " shears " type gesture correspondence virtual tool " shears "；
" tup " type gesture correspondence virtual tool " hammer " etc..In the image of the virtual tool additionally rendered
Identifying with staff, i.e. present the pattern of human hand held instrument, staff mark can be the mark of any form
Know, such as mechanical arm image, strange beast hands image or arbitrary image etc..Staff mark and concrete hand
There is no the relation of correspondence, do not retrained by hand.
The mutual method of virtual reality that the embodiment of the present invention provides, it is possible to first obtained VR by photographic head
Entity image in the range of equipment front preset, then identifies the hand comprised in entity image, finally
The void corresponding with hand is rendered in the current virtual reality image that user is seen by this VR equipment
The image of plan instrument, and the image of virtual tool comprises staff mark.Compared with prior art, originally
Inventive embodiments can obtain the entity image in VR equipment front by photographic head, and according to entity image
In the hand that comprises in virtual image, render the image of the virtual tool with staff mark of correspondence,
Achieve the different hand that will identify that and be converted to render in virtual reality image different with staff
The image of the virtual tool of mark, then can realize the operation to virtual tool further, make virtual existing
Real mutual mode is the most convenient.
Further, in order to the refinement of embodiment illustrated in fig. 1 and extension, the embodiment of the present invention is to Fig. 1
In step carry out refining and supplementing, as follows:
In order to further the virtual tool rendered be operated, after Fig. 1 step 103, continue
Identifying the positional information of staff in entity image, the positional information that then will identify that is converted to correspondent entity
The operational order of the virtual tool that the hand that comprises in image is corresponding.The positional information of concrete staff includes:
Wrist towards (upwards, to inferior), different towards represent virtual tool towards, the most virtual
When instrument is rifle, different towards just representing the direction that muzzle aims at；Concrete certain or certain several finger positions
The change put, such as when the virtual tool that the hand identified is corresponding is rifle, the change (ratio of finger position
Such as forefinger bending etc.) represent the order performing shooting, the virtual tool that the hand that identifies for another example is corresponding
During for camera, the change (such as forefinger is moved vertically downward) of finger position represents the order performing to take pictures；
Or the change in location of the elastic formula of staff, elastic can represent piercing through of virtual tool " sword "
The positional information of the similar more staff of order etc..Different staff positional informationes can represent different
Operational order, therefore when identifying the positional information of staff of correspondence, can be converted to this positional information
The operational order of corresponding virtual tool.
Additionally for Fig. 1 step 102 identifying, the process of the hand comprised in entity image specifically includes:
First, the hand comprised in entity image is obtained.
Concrete can be to carry out analysis entities shadow by computer vision algorithms make or other image analysis methods
Picture, finally extracts or isolates the image information of the hand comprised in image.
Secondly, the hand got is compared with the default hand shape image in hand data base.
The image information of the hand extracted is compared with the default hand shape image in hand data base
Time, to preset in hand shape image be the hand of standard, due to the hands of user different in practical situation itself
All property of there are differences such as size, form, the therefore hands in the hand that will extract with standard hand shape image
To consider to arrange certain error allowed band during shape comparison, the size of concrete error allowed band is permissible
Corresponding different virtual reality image carries out different settings, for rendering in the image of virtual reality
When the virtual tool gone out is less and virtual tool can be defined by there being the hand being clearly distinguished from, for
It is relatively big that error allowed band can be arranged；And for the void that can render in the image of virtual reality
When plan instrument is more and virtual tool can not pass through have the hand being clearly distinguished to be defined, for error
Allowed band needs the less of setting.
Further, if the corresponding multiple virtual tool of a kind of hand, may relate to the most in gaming
Multiple rifle, including spear, short arm, firelock, hydraulic giant etc..And by different hand by all gun shaped all
Carry out distinguishing and there is certain difficulty.The present embodiment relates to representing all of rifle by a kind of hand, and every
The rifle of type all can corresponding different tool identification, when being identified after virtual tool is rifle by hand,
Receive the tool identification that user selects further, then render corresponding types according to different tool identification
Rifle.Concrete user selects the implementation of tool identification to include: a kind of mode, when according to user's hands
Shape is judged, when virtual tool is rifle, to be rendered in the image of virtual reality by all types of rifles, and every
One virtual gun rendered all with tool identification, tool identification can be digital alphabet numbering or
Position indicating mark (arrow the most up and down) etc..Provide concrete example to illustrate, it is assumed that
The type of the rifle that can render in the image of one virtual reality has 4 kinds, and 4 kinds of virtual gun are respectively
With the tool identification of upper and lower, left and right arrow, at this moment user just can by making upwards with hands,
Downwards, to the left action or other gestures that can distinguish different directions that, any direction slides to the right are come
Select the arrow of correspondence direction, and then determine that user wants the type of the rifle selected.Another way, can
During with the virtual tool corresponding in the hand identifying user for rifle, first do not render all types of rifle, and
It is the list of the character property rendering correspondence in the image of virtual reality, list is given inhomogeneity
The tool identification that type rifle is corresponding, then selects for user.The mode that above-mentioned tool identification selects is only
Being exemplary, any mode being similar to therewith or being equal to is all within protection scope of the present invention.
Further, except the identification of the hand in entity image can be passed through in the image of virtual reality
Render outside different virtual tools, it is also possible to by the identification of material object hand-held in entity image, Jin Er
The image of virtual reality renders the virtual tool of corresponding dissimilar material object.Identification in kind refers mainly to
The identification of morphological characteristic in kind, such as three dimensional identification etc., when the form identifying material object is special
After levying, determine the type of material object according to default morphological characteristic, then according to type in kind virtual existing
Real image renders the virtual tool of correspondence.Same need pre-defined different types of material object with not
The same corresponding relation between virtual tool.Provide example and carry out the explanation of recognition effect in kind, such as know
Do not go out hand-held YIZHIHUA or a bunch of flowers, it is possible to corresponding rendering is given fresh in the image of virtual reality
The instrument etc. of flower.
Identification in kind is one as hand identification supplement, makes user carry out virtual reality friendship
Experience the variation of interactive mode time mutually, add mutual interest the most to a certain extent.
For existing technology, just may be used by the different change of the position of simple hand and hands
The operation with virtual tool is rendered, than the existing friendship setting up arm models with realize multiple virtual tool
Easier and the many kinetic energy of mode mutually.
Further, as to the realization of method shown in above-mentioned Fig. 1, another of the embodiment of the present invention is real
Execute example and additionally provide the device that a kind of virtual reality is mutual, as in figure 2 it is shown, this device includes: obtain single
Unit's the 21, first recognition unit 22 and the first rendering unit 23.
Acquiring unit 21, in the range of obtaining Virtual Reality equipment front preset by photographic head
Entity image.
Photographic head in the present embodiment is positioned at the front of VR equipment, and the most where is placed in front
It is not construed as limiting, but the scope of photographic head capture must include the range of activity of user's arm.Additionally image
Head with the relation of VR equipment can be: photographic head is directly embedded on VR equipment one as VR equipment
Ingredient；Or photographic head is as a self-contained unit, by specific external interface or connection member
Combine with VR equipment.Additionally in view of in order to increase the more preferable feeling of immersion of user, some situation may need
Will experience in dark environment, therefore photographic head should also have the function of night vision, therefore can root
According to being actually needed, the photographic head such as infrared photography selecting to have night vision function is first-class.
The entity image obtained is primarily referred to as wearing user oneself arm of VR equipment and the current activity of hands
State, obtaining entity image is for the form of the arm and hands analyzing user in real time, then according to arm
And the form of hands carries out rendering of corresponding virtual tool.
First recognition unit 22, for identifying the hand comprised in entity image.
Transfer Built-in Image processing system, make image processing system that the entity image got is carried out image
Analyze.Specifically include: from entity image, first isolate the image of staff；Then the image to staff
The hand presented is identified.Hand is primarily referred to as the different hands gone out by finger and/or palm stroke
Gesture, such as " shears " type gesture, " fist " type gesture etc..It addition, can only know in the case of difference
Not going out specific gesture, specific gesture is to predefine in advance, just may be used as long as having carried out predefined gesture
With identified.For user when experiencing different virtual reality image, the specific hands that can identify
Gesture is typically the content setting according to the concrete virtual reality image experienced.
First rendering unit 23, corresponding with hand virtual for rendering in current virtual real world images
The image of instrument, comprises staff mark in the image of virtual tool.
When, after the hand identified in entity image, correspondence being rendered in virtual reality image according to hand
The image of virtual tool, wherein virtual reality image be user currently by VR equipment see virtual
Image.Difform hand respectively corresponding different virtual tool, right between hand and virtual tool
Should be related to it is predefined.Such as " shears " type gesture correspondence virtual tool " shears "；" tup "
Type gesture correspondence virtual tool " hammer " etc..With staff in the image of the virtual tool additionally rendered
Mark, i.e. presents the pattern of human hand held instrument, and staff mark can be the mark of any form, such as
Mechanical arm image, strange beast hands image or arbitrary image etc..Staff mark does not has corresponding with concrete hand
Relation, do not retrained by hand.
Further, as it is shown on figure 3, device farther includes:
Second recognition unit 24, for after rendering the image of virtual tool, identifies people in entity image
The positional information of hands；
Converting unit 25, for converting location information into the operational order of virtual tool.
In order to further the virtual tool rendered be operated, continue to identify after rendering virtual tool
The positional information of staff in entity image, the positional information that then will identify that is converted to correspondent entity image
In the operational order of virtual tool corresponding to the hand that comprises.The positional information of concrete staff includes: hands
Wrist towards (upwards, to inferior), different towards represent virtual tool towards, the most virtual work
When tool is for rifle, different towards just representing the direction that muzzle aims at；Concrete certain or certain several finger positions
Change, such as when the virtual tool that the hand identified is corresponding is rifle, the change of finger position (ratio
Such as forefinger bending etc.) represent the order performing shooting, the virtual tool that the hand that identifies for another example is corresponding
During for camera, the change (such as forefinger is moved vertically downward) of finger position represents the order performing to take pictures；
Or the change in location of the elastic formula of staff, elastic can represent piercing through of virtual tool " sword "
The positional information of the similar more staff of order etc..Different staff positional informationes can represent different
Operational order, therefore when identifying the positional information of staff of correspondence, can be converted to this positional information
The operational order of corresponding virtual tool.
Further, as it is shown on figure 3, device farther includes:
Receive unit 26, if for the corresponding multiple virtual tools of hand, then receiving the instrument mark that user selects
Knowing, tool identification is used for distinguishing multiple virtual tool；
Second rendering unit 27, renders in virtual reality image for the tool identification selected according to user
Go out the image of the virtual tool of correspondence.
If the corresponding multiple virtual tool of a kind of hand, multiple rifle may be related to the most in gaming, bag
Include spear, short arm, firelock, hydraulic giant etc..And by different hand, all gun shaped are all carried out difference and deposit
In certain difficulty.The present embodiment relates to representing all of rifle by a kind of hand, and each type of rifle
Will corresponding different tool identification, when being identified after virtual tool is rifle by hand, receive further
The tool identification that user selects, then renders the rifle of corresponding types according to different tool identification.Specifically
User select the implementation of tool identification to include: a kind of mode, when judging void according to user's hand
When plan instrument is rifle, all types of rifles is rendered in the image of virtual reality, and each renders
Virtual gun all with tool identification, tool identification can be digital alphabet numbering or position indicating mark
Know (arrow the most up and down) etc..Provide concrete example to illustrate, it is assumed that virtual existing at one
The type of the rifle that can render in real image has 4 kinds, and 4 kinds of virtual gun be respectively provided with upper and lower,
The tool identification of left and right arrow, at this moment user just can by making upwards with hands, downwards, to the left,
The action that slides in arbitrary direction to the right or other can distinguish the gesture of different directions to select counterparty
To arrow, and then determine that user wants the type of rifle selected.Another way, can identify
When virtual tool corresponding to the hand of user is rifle, first do not render all types of rifle, but virtual existing
Real image renders the list of a character property of correspondence, list provides dissimilar rifle corresponding
Tool identification, then selects for user.The mode that above-mentioned tool identification selects is exemplary,
Any mode being similar to therewith or being equal to is all within protection scope of the present invention.
Further, as it is shown on figure 3, the first recognition unit 22, including:
Acquisition module 221, for obtaining the hand comprised in entity image；
Comparing module 222, for entering the hand got with the default hand shape image in hand data base
Row comparison.
Identify that the process of the hand comprised in entity image specifically includes:
First, the hand comprised in entity image is obtained.
Concrete can be to carry out analysis entities shadow by computer vision algorithms make or other image analysis methods
Picture, finally extracts or isolates the image information of the hand comprised in image.
Secondly, the hand got is compared with the default hand shape image in hand data base.
The image information of the hand extracted is compared with the default hand shape image in hand data base
Time, to preset in hand shape image be the hand of standard, due to the hands of user different in practical situation itself
All property of there are differences such as size, form, the therefore hands in the hand that will extract with standard hand shape image
To consider to arrange certain error allowed band during shape comparison, the size of concrete error allowed band is permissible
Corresponding different virtual reality image carries out different settings, for rendering in the image of virtual reality
When the virtual tool gone out is less and virtual tool can be defined by there being the hand being clearly distinguished from, for
It is relatively big that error allowed band can be arranged；And for the void that can render in the image of virtual reality
When plan instrument is more and virtual tool can not pass through have the hand being clearly distinguished to be defined, for error
Allowed band needs the less of setting.
Further, as it is shown on figure 3, device farther includes:
3rd recognition unit 28, is used for identifying hand-held material object in entity image；
3rd rendering unit 29 is right for rendering in virtual reality image according to morphological characteristic in kind
The image of the virtual tool answered.
Except difference can be rendered in the image of virtual reality by the identification of the hand in entity image
Virtual tool outside, it is also possible to by the identification of material object hand-held in entity image, and then in virtual reality
Image renders the virtual tool of corresponding dissimilar material object.Identification in kind refers mainly to the form of material object
The identification of feature, such as three dimensional identification etc., after identifying morphological characteristic in kind, according to
The morphological characteristic preset determines the type of material object, then according to type wash with watercolours in virtual reality image in kind
Dye the virtual tool of correspondence.Same needs pre-defined different types of material object and different virtual works
Corresponding relation between tool.
The mutual device of virtual reality that the embodiment of the present invention provides, it is possible to first obtained VR by photographic head
Entity image in the range of equipment front preset, then identifies the hand comprised in entity image, finally
The void corresponding with hand is rendered in the current virtual reality image that user is seen by this VR equipment
The image of plan instrument, and the image of virtual tool comprises staff mark.Compared with prior art, originally
Inventive embodiments can obtain the entity image in VR equipment front by photographic head, and according to entity image
In the hand that comprises in virtual image, render the image of the virtual tool with staff mark of correspondence,
Achieve the different hand that will identify that and be converted to render in virtual reality image different with staff
The image of the virtual tool of mark, then can realize the operation to virtual tool further, make virtual existing
Real mutual mode is the most convenient.
It should be noted that for the mutual device of above-mentioned virtual reality, every embodiment of the present invention makes
The function of the unit module used can pass through hardware processor (hardware processor)
Realize.
Additionally, the part that the most in other words prior art contributed of technical scheme or
The part of this technical scheme can embody with the form of software product, and this computer software product stores
In a storage medium, including some instructions with so that a computer equipment (can be individual's meter
Calculation machine, server, or the network equipment etc.) perform the whole of method described in each embodiment of the present invention or
Part steps.And aforesaid storage medium includes: USB flash disk, portable hard drive, read only memory (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory),
The various medium that can store program code such as magnetic disc or CD.
Device embodiment described above is only schematically, wherein said illustrates as separating component
Unit can be or may not be physically separate, the parts shown as unit can be or
Person may not be physical location, i.e. may be located at a place, or can also be distributed to multiple network
On unit.Some or all of module therein can be selected according to the actual needs to realize the present embodiment
The purpose of scheme.Those of ordinary skill in the art are not in the case of paying performing creative labour, the most permissible
Understand and implement.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive each reality
The mode of executing can add the mode of required general hardware platform by software and realize, naturally it is also possible to by firmly
Part.Based on such understanding, the portion that prior art is contributed by technique scheme the most in other words
Dividing and can embody with the form of software product, this computer software product can be stored in computer can
Read in storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that one
Computer equipment (can be personal computer, server, or the network equipment etc.) performs each to be implemented
The method described in some part of example or embodiment.
Last it is noted that above example is only in order to illustrate technical scheme, rather than to it
Limit；Although the present invention being described in detail with reference to previous embodiment, the ordinary skill of this area
Personnel it is understood that the technical scheme described in foregoing embodiments still can be modified by it, or
Person carries out equivalent to wherein portion of techniques feature；And these amendments or replacement, do not make corresponding skill
The essence of art scheme departs from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (10)
1. the method that a virtual reality is mutual, it is characterised in that described method includes:
The entity image in the range of Virtual Reality equipment front preset is obtained by photographic head；
Identify the hand comprised in described entity image；
The image of the virtual tool corresponding with described hand is rendered in current virtual real world images, described
The image of virtual tool comprises staff mark.
Method the most according to claim 1, it is characterised in that described method farther includes:
After the image rendering described virtual tool, identify the positional information of staff in described entity image；
Described positional information is converted to the operational order of described virtual tool.
Method the most according to claim 1, it is characterised in that described method farther includes:
If the corresponding multiple virtual tools of described hand, then receive the tool identification that user selects, described instrument
Mark is used for distinguishing the plurality of virtual tool；
The tool identification selected according to user renders the virtual tool of correspondence in described virtual reality image
Image.
Method the most according to claim 1, it is characterised in that in described identification described entity image
The hand comprised, including:
Obtain the hand comprised in described entity image；
The hand got is compared with the default hand shape image in hand data base.
Method the most according to claim 1, it is characterised in that described method farther includes:
Identify hand-held material object in described entity image；
Morphological characteristic according to described material object renders the virtual tool of correspondence in described virtual reality image
Image.
6. the device that a virtual reality is mutual, it is characterised in that described device includes:
Acquiring unit, for obtaining the reality in the range of Virtual Reality equipment front preset by photographic head
Body image；
First recognition unit, for identifying the hand comprised in described entity image；
First rendering unit, for rendering the void corresponding with described hand in current virtual real world images
The image of plan instrument, comprises staff mark in the image of described virtual tool.
Device the most according to claim 6, it is characterised in that described device farther includes:
Second recognition unit, for after the image rendering described virtual tool, identifies described entity shadow
The positional information of staff in Xiang；
Converting unit, for being converted to the operational order of described virtual tool by described positional information.
Device the most according to claim 6, it is characterised in that described device farther includes:
Receive unit, if for the corresponding multiple virtual tools of described hand, then receiving the instrument that user selects
Mark, described tool identification is used for distinguishing the plurality of virtual tool；
Second rendering unit, for the tool identification wash with watercolours in described virtual reality image selected according to user
Dye the image of the virtual tool of correspondence.
Device the most according to claim 6, it is characterised in that described first recognition unit, including:
Acquisition module, for obtaining the hand comprised in described entity image；
Comparing module, for comparing the hand got with the default hand shape image in hand data base
Right.
Device the most according to claim 6, it is characterised in that described device farther includes:
3rd recognition unit, is used for identifying hand-held material object in described entity image；
3rd rendering unit, for the morphological characteristic wash with watercolours in described virtual reality image according to described material object
Dye the image of the virtual tool of correspondence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610309443.8A CN105975158A (en) | 2016-05-11 | 2016-05-11 | Virtual reality interaction method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610309443.8A CN105975158A (en) | 2016-05-11 | 2016-05-11 | Virtual reality interaction method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105975158A true CN105975158A (en) | 2016-09-28 |
Family
ID=56991609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610309443.8A Pending CN105975158A (en) | 2016-05-11 | 2016-05-11 | Virtual reality interaction method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105975158A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106598237A (en) * | 2016-11-30 | 2017-04-26 | 宇龙计算机通信科技(深圳)有限公司 | Game interaction method and device based on virtual reality |
| CN106775258A (en) * | 2017-01-04 | 2017-05-31 | 虹软(杭州)多媒体信息技术有限公司 | The method and apparatus that virtual reality is interacted are realized using gesture control |
| CN106909222A (en) * | 2017-02-27 | 2017-06-30 | 广州林邦信息科技有限公司 | VR display methods and device |
| CN107885316A (en) * | 2016-09-29 | 2018-04-06 | 阿里巴巴集团控股有限公司 | A kind of exchange method and device based on gesture |
| CN115830112A (en) * | 2022-11-25 | 2023-03-21 | 之江实验室 | Mixed reality interaction method and system based on handheld real object |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045398A (en) * | 2015-09-07 | 2015-11-11 | 哈尔滨市一舍科技有限公司 | Virtual reality interaction device based on gesture recognition |
| CN105068649A (en) * | 2015-08-12 | 2015-11-18 | 深圳市埃微信息技术有限公司 | Binocular gesture recognition device and method based on virtual reality helmet |
| CN105446481A (en) * | 2015-11-11 | 2016-03-30 | 周谆 | Gesture based virtual reality human-machine interaction method and system |
| CN105487673A (en) * | 2016-01-04 | 2016-04-13 | 京东方科技集团股份有限公司 | Man-machine interactive system, method and device |
-
2016
- 2016-05-11 CN CN201610309443.8A patent/CN105975158A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105068649A (en) * | 2015-08-12 | 2015-11-18 | 深圳市埃微信息技术有限公司 | Binocular gesture recognition device and method based on virtual reality helmet |
| CN105045398A (en) * | 2015-09-07 | 2015-11-11 | 哈尔滨市一舍科技有限公司 | Virtual reality interaction device based on gesture recognition |
| CN105446481A (en) * | 2015-11-11 | 2016-03-30 | 周谆 | Gesture based virtual reality human-machine interaction method and system |
| CN105487673A (en) * | 2016-01-04 | 2016-04-13 | 京东方科技集团股份有限公司 | Man-machine interactive system, method and device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107885316A (en) * | 2016-09-29 | 2018-04-06 | 阿里巴巴集团控股有限公司 | A kind of exchange method and device based on gesture |
| JP2019537763A (en) * | 2016-09-29 | 2019-12-26 | アリババ・グループ・ホールディング・リミテッドＡｌｉｂａｂａ Ｇｒｏｕｐ Ｈｏｌｄｉｎｇ Ｌｉｍｉｔｅｄ | Method and system for gesture-based interaction |
| JP7137804B2 (en) | 2016-09-29 | 2022-09-15 | アリババ・グループ・ホールディング・リミテッド | Method and system for gesture-based interaction |
| CN106598237A (en) * | 2016-11-30 | 2017-04-26 | 宇龙计算机通信科技(深圳)有限公司 | Game interaction method and device based on virtual reality |
| CN106775258A (en) * | 2017-01-04 | 2017-05-31 | 虹软(杭州)多媒体信息技术有限公司 | The method and apparatus that virtual reality is interacted are realized using gesture control |
| CN106909222A (en) * | 2017-02-27 | 2017-06-30 | 广州林邦信息科技有限公司 | VR display methods and device |
| CN115830112A (en) * | 2022-11-25 | 2023-03-21 | 之江实验室 | Mixed reality interaction method and system based on handheld real object |
| CN115830112B (en) * | 2022-11-25 | 2023-09-22 | 之江实验室 | Mixed reality interaction method and system based on handheld real object |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wang et al. | Real-time hand-tracking with a color glove | |
| Yao et al. | Contour model-based hand-gesture recognition using the Kinect sensor | |
| CN103049761B (en) | Sign Language Recognition Method based on sign language glove and system | |
| CN105975158A (en) | Virtual reality interaction method and device | |
| JP7071054B2 (en) | Information processing equipment, information processing methods and programs | |
| CN103903213B (en) | A kind of image pickup method and electronic equipment | |
| KR20200100848A (en) | How to determine hand-off for virtual controllers | |
| CN109641153A (en) | Object modeling and replacement in video flowing | |
| CN108027655A (en) | Information processing system, information processing equipment, control method and program | |
| CN111680594A (en) | Augmented reality interaction method based on gesture recognition | |
| US20150241984A1 (en) | Methods and Devices for Natural Human Interfaces and for Man Machine and Machine to Machine Activities | |
| US10001901B2 (en) | System and method for texturing in virtual reality and mixed reality environments | |
| CN110083202A (en) | With the multi-module interactive of near-eye display | |
| CN104793731A (en) | Information input method for wearable device and wearable device | |
| CN105867599A (en) | Gesture control method and device | |
| CN103777748A (en) | Motion sensing input method and device | |
| CN108629272A (en) | A kind of embedded gestural control method and system based on monocular cam | |
| CN103793683A (en) | gesture recognition method and electronic device | |
| CN202159302U (en) | Augment reality system with user interaction and input functions | |
| CN112330580A (en) | Method, device, computing equipment and medium for generating human body clothes fusion image | |
| CN105975072A (en) | Method, device and system for identifying gesture movement | |
| Bai et al. | Free-hand interaction for handheld augmented reality using an RGB-depth camera | |
| JP7419003B2 (en) | Information display device, information display method, and information display system | |
| CN116954367A (en) | Virtual reality interaction method, system and equipment | |
| CN108073267A (en) | Three dimensions control method and device based on movement locus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160928 |
|
| WD01 | Invention patent application deemed withdrawn after publication |