CN106293078A - Virtual reality exchange method based on photographic head and device - Google Patents
Virtual reality exchange method based on photographic head and device Download PDFInfo
- Publication number
- CN106293078A CN106293078A CN201610624148.1A CN201610624148A CN106293078A CN 106293078 A CN106293078 A CN 106293078A CN 201610624148 A CN201610624148 A CN 201610624148A CN 106293078 A CN106293078 A CN 106293078A
- Authority
- CN
- China
- Prior art keywords
- hand
- information
- photographic head
- virtual reality
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
For providing a kind of new virtual reality interaction technique scheme, inventor discloses a kind of virtual reality exchange method based on photographic head, comprising the steps: to be obtained the hand images of band hand information by photographic head, described hand information includes the information of the pre-placing graphic pattern of palm or the back of the hand；Preset pattern-information is decoded, obtains the binary sequence with verification frame；Decoding obtained compares with the binary sequence of the preset body of each hand in virtual scene with the binary sequence of verification frame, and restores the binary sequence preset body of consistent hand in virtual scene；Obtain hand the first attitude information, hand plan position information, hand depth information, hand the second attitude information and hand motion information by the hand images of band hand information, according to above-mentioned five kinds of information in virtual scene with hand preset volume reconstruction hand motion.Inventor discloses the virtual reality interactive device based on photographic head for realizing said method simultaneously.
Description
Technical field
The present invention relates to technical field of virtual reality, particularly to a kind of virtual reality exchange method based on photographic head and
Device.
Background technology
Existing virtual display interaction technique scheme be the most all by the outside interactive device such as handle, glove realize with
Virtual scene interacts, and hardware cost is higher.
Summary of the invention
For this reason, it may be necessary to provide a kind of new, easily, virtual reality interaction technique scheme with low cost.
For achieving the above object, a kind of virtual reality exchange method based on photographic head is inventor provided, including as follows
Step:
Obtained the hand images of band hand information by photographic head, described hand information includes the preset figure of palm or the back of the hand
The information of case；
Preset pattern-information is decoded, obtains the binary sequence with verification frame；
The binary system of the preset body of each hand in the binary sequence with verification frame that decoding is obtained and virtual scene
Sequence is compared, and restores the binary sequence preset body of consistent hand in virtual scene；
Hand the first attitude information, hand plan position information, hand is obtained deep by the hand images of band hand information
Degree information, hand the second attitude information and hand motion information, according to above-mentioned five kinds of information in virtual scene preset with hand
Volume reconstruction hand motion.
Further, in described virtual reality exchange method based on photographic head, obtain hand the first attitude information
Mode specifically includes: be in palm by preset pattern-information or the back of the hand judge the first attitude of hand be the back of the hand upwards or hands
The palm is upwards；
The mode obtaining hand the second attitude information specifically includes: have preset pattern to be positioned at finger-joint by identifying whether
Hand the second attitude that upper judgement is current.
Further, in described virtual reality exchange method based on photographic head, obtain hand plan position information
Mode specifically includes: judge that the angle of photographic head Radix Rumicis is the most identical with the viewport size of virtual reality device, the most preset
Pattern position in the hand images of band hand information is hand plan-position to be obtained；Otherwise hand information is entered
Row cutting makes its picture surplus ratio consistent with the viewport length-width ratio of virtual reality device, and the most pre-placing graphic pattern is after cropped
Position in picture is hand plan-position to be obtained.
Further, in described virtual reality exchange method based on photographic head, obtain the mode of hand depth information
Specifically include: obtain the photographic head distance to pre-placing graphic pattern by the range unit on virtual reality device, and press with this distance
Preset scaling or preset for hand body is located in virtual scene after reducing.
Further, in described virtual reality exchange method based on photographic head, obtain the mode of hand motion information
Specifically include: carried out the hand appearance of the successive frame picture composition of action conversion by the hand gestures preset higher than a predetermined number
State data set sets up hand gestures model and error equation, is trained image data collection judging and obtains hand motion letter
Breath.
Inventor additionally provides a kind of virtual reality interactive device based on photographic head simultaneously, including image acquisition unit,
Decoding unit, comparing unit, reduction unit, information analysis unit and reconstruction unit；
Described image acquisition unit for obtaining the hand images of band hand information, described hand information bag by photographic head
Include the information of the pre-placing graphic pattern of palm or the back of the hand；
Described decoding unit, for being decoded preset pattern-information, obtains the binary sequence with verification frame；
Described comparing unit is for the binary sequence with verification frame decoding obtained and each hands in virtual scene
The binary sequence of the preset body in portion is compared, and described reduction unit is for restoring binary sequence phase one in virtual scene
The preset body of hand caused；
Described information analysis unit is for obtaining hand the first attitude information, hand by the hand images of band hand information
Plan position information, hand depth information, hand the second attitude information and hand motion information, described reconstruction unit is used for basis
Above-mentioned five kinds of information acquired in information analysis unit in virtual scene with hand preset volume reconstruction hand motion.
Further, in described virtual reality interactive device based on photographic head, information analysis unit obtains hand the
The mode of one attitude information specifically includes: be in palm by preset pattern-information or the back of the hand judges that the first attitude of hand is
The back of the hand upwards or palm upwards；
The mode obtaining hand the second attitude information specifically includes: have preset pattern to be positioned at finger-joint by identifying whether
Hand the second attitude that upper judgement is current.
Further, in described virtual reality interactive device based on photographic head, information analysis unit obtains hand and puts down
The mode of face positional information specifically includes: judge the viewport size whether phase of the angle of photographic head Radix Rumicis and virtual reality device
With, the most pre-placing graphic pattern position in the hand images of band hand information is hand plan-position to be obtained；No
Hand information then carries out cutting makes its picture surplus ratio consistent with the viewport length-width ratio of virtual reality device, the most preset figure
Case position in picture after cropped is hand plan-position to be obtained.
Further, in described virtual reality interactive device based on photographic head, it is deep that information analysis unit obtains hand
The mode of degree information specifically includes: obtain the photographic head distance to pre-placing graphic pattern by the range unit on virtual reality device,
And with this distance by default scaling or preset for hand body is located in virtual scene after reducing.
Further, in described virtual reality interactive device based on photographic head, information analysis unit obtains hand and moves
The mode making information specifically includes: carried out the successive frame picture of action conversion by the hand gestures preset higher than a predetermined number
The hand gestures data set of composition sets up hand gestures model and error equation, is trained image data collection judging and obtains
Take hand motion information.
Being different from prior art, technique scheme is capable of a kind of novel virtual reality convenient and with low cost
Interactive function.
Accompanying drawing explanation
Fig. 1 is the flow chart of the virtual reality exchange method based on photographic head described in an embodiment of the present invention；
Fig. 2 is the structural representation of the virtual reality interactive device based on photographic head described in an embodiment of the present invention.
Description of reference numerals:
1-image acquisition unit
2-decoding unit
3-comparing unit
4-reduction unit
5-information analysis unit
6-reconstruction unit
Detailed description of the invention
By describing the technology contents of technical scheme, structural feature in detail, being realized purpose and effect, below in conjunction with concrete real
Execute example and coordinate accompanying drawing to be explained in detail.
Refer to Fig. 1, for the flow chart of the method described in an embodiment of the present invention；Described method comprises the steps:
S1, being obtained the hand images of band hand information by photographic head, described hand information includes the pre-of palm or the back of the hand
The information of placing graphic pattern；
S2, preset pattern-information is decoded, obtains the binary sequence with verification frame；
S3, the binary sequence with verification frame decoding obtained enter with two of the preset body of each hand in virtual scene
Sequence processed is compared, and restores the binary sequence preset body of consistent hand in virtual scene；
S4, obtain hand the first attitude information, hand plan position information, hand by the hand images of band hand information
Depth information, hand the second attitude information and hand motion information, according to above-mentioned five kinds of information in virtual scene pre-with hand
Put volume reconstruction hand motion.
Described virtual scene refers to the virtual three-dimensional scenic made by methods such as game engines, and it is main
Wanting function as follows: 1, the hand motion etc. recognized by photographic head is rebuild at virtual scene, and virtual scene is virtual existing
Provide platform alternately in fact；, 2, the manufacturing process of virtual scene contains the information of the preset body of hand, is believed by this preset body
The comparison of the label information that breath and video camera obtain judges whether to rebuild this preset body in virtual scene.
Described photographic head is integrated with on virtual reality device.Described virtual reality device, refers to for virtual
The display of real content, mutual etc. head-mounted display apparatus, can be headset equipment with mobile processing device (such as Gear
VR) virtual reality device combined, it is also possible to be the integrated virtual real world devices of headset equipment and processor one, also may be used
To be the headset equipment (such as Oculus Rift) being only responsible for display, the content of virtual scene is issued by content or in real time
The modes such as video flowing are transferred on virtual reality device, user by virtual reality device can browse through in virtual scene interior
Hold, and carry out certain interactive operation.Virtual reality device is provided with following assembly:
Display screen: user can be carried out the roaming of virtual scene by display screen and browse；
Gyroscope: virtual reality device detects the information such as the rotation of equipment, skew by gyroscope, these data is sent
In virtual scene, the photomoduel in virtual scene is carried out according to the data of this rotation, skew etc. in virtual scene relatively
The rotation answered, skew；
Photographic head: the picture in captured in real-time reality scene, when photographic head reads the pattern comprising label information
Time, this can be decoded with the pattern of label information, be transferred in virtual scene carry out data by decoded information
Comparison.Photographic head also comprises three below module: 1, light compensating lamp: when the brightness of reality scene is less than certain threshold value, start light filling
Lamp carries out the light filling of reality scene, it is to avoid because insufficient light causes video camera None-identified to the pattern with label information；
2, wide-angle lens: in order to avoid making owing to the Radix Rumicis of photographic head causes label information pattern to exceed photographic head coverage not
Its identify less than problem, its camera lens needs not less than the angle of virtual video camera viewport size in virtual scene；3, infrared
Equipment: the distance of photographic head and the pattern with label information can be accurately calculated by infrared ray.
Pre-placing graphic pattern described in method is to provide a kind of form of expression of preset label information, and this pattern is by presetting
A kind of specific coded system generate, the real-time sequence of pictures photographed is sent to processing equipment by photographic head, and process sets
For when recognizing the pattern with label information, according to specific decoding process, pattern is decoded, restores it original
Information, transmits that information to compare with preset information in scene.
Further, in step S4, the mode obtaining hand the first attitude information specifically includes: by preset pattern-information
Be in palm or the back of the hand judge the first attitude of hand be the back of the hand upwards or palm upwards.This needs to ensure that user will be with in advance
Placing graphic pattern fits on the back of the hand, palm and finger by the way of certain, when hand is in the range of photographic head viewport, and hands
The palm, the back of the hand at least a part of which have a pattern can be recognized by video camera, can determine and obtain the first attitude letter of hand
Breath.
In like manner, the mode obtaining hand the second attitude information is to have preset pattern to be positioned on finger-joint by identifying whether
Judge current hand the second attitude.Such as when the back of the hand is clenched fist upward, photographic head can only recognize the pattern on the back of the hand, and finger
Deng the pattern at remaining position then identify less than；When and for example palm is upwards clenched fist, can only recognize palm and in addition to thumb remaining
Pattern on four second joints referred to.Visible by judging preset pattern to be positioned on which finger-joint can to obtain further
Hand gestures information.
Further, in step S4, the mode obtaining hand plan position information specifically includes: judge photographic head Radix Rumicis
Angle is the most identical with the viewport size of virtual reality device, and the most pre-placing graphic pattern is in the hand images of band hand information
Position is hand plan-position to be obtained；Hand information otherwise carries out cutting makes its picture surplus ratio existing with virtual
The viewport length-width ratio of real equipment is consistent, and the most pre-placing graphic pattern position in picture after cropped is hand to be obtained
Plan-position.
Further, in step S4, the mode obtaining hand depth information specifically includes: by virtual reality device
Range unit obtains photographic head to the distance of pre-placing graphic pattern, and with this distance by default scaling or after reducing hand is pre-
Put body to be located in virtual scene.
Further, in step S4, the mode obtaining hand motion information specifically includes: by pre-higher than a predetermined number
The hand gestures data set of the successive frame picture composition that the hand gestures put carries out action conversion sets up hand gestures model and mistake
Eikonal equation, is trained image data collection judging and obtains hand motion information.
Refer to Fig. 2, for the structure of the virtual reality interactive device based on photographic head described in an embodiment of the present invention
Schematic diagram；Described device includes image acquisition unit 1, decoding unit 2, comparing unit 3, reduction unit 4, information analysis unit 5
With reconstruction unit 6；
Described image acquisition unit 1 for obtaining the hand images of band hand information, described hand information by photographic head
Including palm or the information of the pre-placing graphic pattern of the back of the hand；
Described decoding unit 2, for being decoded preset pattern-information, obtains the binary sequence with verification frame；
Described comparing unit 3 is for the binary sequence with verification frame decoding obtained and each hands in virtual scene
The binary sequence of the preset body in portion is compared, and described reduction unit 4 is for restoring binary sequence phase in virtual scene
The preset body of consistent hand；
Described information analysis unit 5 is for obtaining hand the first attitude information, hands by the hand images of band hand information
Facial planes positional information, hand depth information, hand the second attitude information and hand motion information, described reconstruction unit 6 is used for
According to the above-mentioned five kinds of information acquired in information analysis unit 5 in virtual scene with hand preset volume reconstruction hand motion.
Described virtual scene refers to the virtual three-dimensional scenic made by methods such as game engines, and it is main
Wanting function as follows: 1, the hand motion etc. recognized by photographic head is rebuild at virtual scene, and virtual scene is virtual existing
Provide platform alternately in fact；, 2, the manufacturing process of virtual scene contains the information of the preset body of hand, is believed by this preset body
The comparison of the label information that breath and video camera obtain judges whether to rebuild this preset body in virtual scene.
Described photographic head is integrated with on virtual reality device.Described virtual reality device, refers to for virtual
The display of real content, mutual etc. head-mounted display apparatus, can be headset equipment with mobile processing device (such as Gear
VR) virtual reality device combined, it is also possible to be the integrated virtual real world devices of headset equipment and processor one, also may be used
To be the headset equipment (such as Oculus Rift) being only responsible for display, the content of virtual scene is issued by content or in real time
The modes such as video flowing are transferred on virtual reality device, user by virtual reality device can browse through in virtual scene interior
Hold, and carry out certain interactive operation.Virtual reality device is provided with following assembly:
Display screen: user can be carried out the roaming of virtual scene by display screen and browse；
Gyroscope: virtual reality device detects the information such as the rotation of equipment, skew by gyroscope, these data is sent
In virtual scene, the photomoduel in virtual scene is carried out according to the data of this rotation, skew etc. in virtual scene relatively
The rotation answered, skew；
Photographic head: the picture in captured in real-time reality scene, when photographic head reads the pattern comprising label information
Time, this can be decoded with the pattern of label information, be transferred in virtual scene carry out data by decoded information
Comparison.Photographic head also comprises three below module: 1, light compensating lamp: when the brightness of reality scene is less than certain threshold value, start light filling
Lamp carries out the light filling of reality scene, it is to avoid because insufficient light causes video camera None-identified to the pattern with label information；
2, wide-angle lens: in order to avoid making owing to the Radix Rumicis of photographic head causes label information pattern to exceed photographic head coverage not
Its identify less than problem, its camera lens needs not less than the angle of virtual video camera viewport size in virtual scene；3, infrared
Equipment: the distance of photographic head and the pattern with label information can be accurately calculated by infrared ray.
Described pre-placing graphic pattern is to provide a kind of form of expression of preset label information, and this pattern is by the one preset
Specific coded system generates, and the real-time sequence of pictures photographed is sent to processing equipment, processing equipment identification by photographic head
When arriving the pattern with label information, according to specific decoding process, pattern is decoded, restores its original information, will
This information is transferred in scene compare with preset information.
Further, information analysis unit 5 obtains the mode of hand the first attitude information and specifically includes: by pre-placing graphic pattern
Information is in palm or the back of the hand judge the first attitude of hand be the back of the hand upwards or palm upwards；This needs to ensure that user will carry
Pre-placing graphic pattern is had to fit on the back of the hand, palm and finger by the way of certain, when hand is in the range of photographic head viewport,
Palm, the back of the hand at least a part of which have a pattern can be recognized by video camera, can determine and obtain the first attitude of hand
Information.
In like manner, information analysis unit 5 obtains the mode of hand the second attitude information is to have pre-placing graphic pattern by identifying whether
It is positioned on finger-joint and judges current hand the second attitude.Such as when the back of the hand is clenched fist upward, photographic head can only recognize the back of the hand
On pattern, the pattern at remaining position such as finger then identify less than；When and for example palm is upwards clenched fist, can only recognize palm and
The pattern on remaining four second joint referred in addition to thumb.Visible by judge that preset pattern is positioned at can on which finger-joint
To obtain further hand gestures information.
Further, in described virtual reality interactive device based on photographic head, information analysis unit 5 obtains hand and puts down
The mode of face positional information specifically includes: judge the viewport size whether phase of the angle of photographic head Radix Rumicis and virtual reality device
With, the most pre-placing graphic pattern position in the hand images of band hand information is hand plan-position to be obtained；No
Hand information then carries out cutting makes its picture surplus ratio consistent with the viewport length-width ratio of virtual reality device, the most preset figure
Case position in picture after cropped is hand plan-position to be obtained.
Further, in described virtual reality interactive device based on photographic head, it is deep that information analysis unit 5 obtains hand
The mode of degree information specifically includes: obtain the photographic head distance to pre-placing graphic pattern by the range unit on virtual reality device,
And with this distance by default scaling or preset for hand body is located in virtual scene after reducing.
Further, in described virtual reality interactive device based on photographic head, information analysis unit 5 obtains hand and moves
The mode making information specifically includes: carried out the successive frame picture of action conversion by the hand gestures preset higher than a predetermined number
The hand gestures data set of composition sets up hand gestures model and error equation, is trained image data collection judging and obtains
Take hand motion information.
Being different from prior art, technique scheme is capable of a kind of novel virtual reality convenient and with low cost
Interactive function.
It should be noted that in this article, the relational terms of such as first and second or the like is used merely to a reality
Body or operation separate with another entity or operating space, and deposit between not necessarily requiring or imply these entities or operating
Relation or order in any this reality.And, term " includes ", " comprising " or its any other variant are intended to
Comprising of nonexcludability, so that include that the process of a series of key element, method, article or terminal unit not only include those
Key element, but also include other key elements being not expressly set out, or also include for this process, method, article or end
The key element that end equipment is intrinsic.In the case of there is no more restriction, statement " including ... " or " comprising ... " limit
Key element, it is not excluded that there is also other key element in including the process of described key element, method, article or terminal unit.This
Outward, in this article, " be more than ", " being less than ", " exceeding " etc. are interpreted as not including this number；More than " ", " below ", " within " etc. understand
For including this number.
Those skilled in the art are it should be appreciated that the various embodiments described above can be provided as method, device or computer program product
Product.These embodiments can use complete hardware embodiment, complete software implementation or combine software and hardware in terms of embodiment
Form.All or part of step in the method that the various embodiments described above relate to can instruct relevant hardware by program
Completing, described program can be stored in the storage medium that computer equipment can read, and is used for performing the various embodiments described above side
All or part of step described in method.Described computer equipment, includes but not limited to: personal computer, server, general-purpose computations
Machine, special-purpose computer, the network equipment, embedded device, programmable device, intelligent mobile terminal, intelligent home device, Wearable
Smart machine, vehicle intelligent equipment etc.；Described storage medium, includes but not limited to: RAM, ROM, magnetic disc, tape, CD, sudden strain of a muscle
Deposit, the storage of USB flash disk, portable hard drive, storage card, memory stick, the webserver, network cloud storage etc..
The various embodiments described above are with reference to according to the method described in embodiment, equipment (system) and computer program
Flow chart and/or block diagram describe.It should be understood that can every by computer program instructions flowchart and/or block diagram
Flow process in one flow process and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computers can be provided
Programmed instruction to the processor of computer equipment to produce a machine so that the finger performed by the processor of computer equipment
Order produces for realizing specifying in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame
The device of function.
These computer program instructions may be alternatively stored in the computer that computer equipment can be guided to work in a specific way and set
In standby readable memory so that the instruction being stored in this computer equipment readable memory produces the manufacture including command device
Product, this command device realizes at one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame middle finger
Fixed function.
These computer program instructions also can be loaded on computer equipment so that performs a series of on a computing device
Operating procedure is to produce computer implemented process, thus the instruction performed on a computing device provides for realizing in flow process
The step of the function specified in one flow process of figure or multiple flow process and/or one square frame of block diagram or multiple square frame.
Although being described the various embodiments described above, but those skilled in the art once know basic wound
The property made concept, then can make other change and amendment to these embodiments, so the foregoing is only embodiments of the invention,
Not thereby the scope of patent protection of the present invention, every equivalent structure utilizing description of the invention and accompanying drawing content to be made are limited
Or equivalence flow process conversion, or directly or indirectly it is used in other relevant technical fields, the most in like manner it is included in the patent of the present invention
Within protection domain.
Claims (10)
1. a virtual reality exchange method based on photographic head, it is characterised in that comprise the steps:
Obtained the hand images of band hand information by photographic head, described hand information includes the pre-placing graphic pattern of palm or the back of the hand
Information；
Preset pattern-information is decoded, obtains the binary sequence with verification frame；
The binary sequence of the preset body of each hand in the binary sequence with verification frame that decoding is obtained and virtual scene
Compare, and in virtual scene, restore the binary sequence preset body of consistent hand；
Hand the first attitude information, hand plan position information, hand degree of depth letter is obtained by the hand images of band hand information
Breath, hand the second attitude information and hand motion information, according to above-mentioned five kinds of information in virtual scene with the preset body weight of hand
Build hand motion.
2. virtual reality exchange method based on photographic head as claimed in claim 1, it is characterised in that obtain hand the first appearance
The mode of state information specifically includes: be in palm by preset pattern-information or the back of the hand judges that the first attitude of hand is the back of the hand
Upwards or palm upwards；
The mode obtaining hand the second attitude information specifically includes: sentence by identifying whether to have preset pattern to be positioned on finger-joint
Disconnected current hand the second attitude.
3. virtual reality exchange method based on photographic head as claimed in claim 1 or 2, it is characterised in that obtain hand and put down
The mode of face positional information specifically includes: judge the viewport size whether phase of the angle of photographic head Radix Rumicis and virtual reality device
With, the most pre-placing graphic pattern position in the hand images of band hand information is hand plan-position to be obtained；No
Hand information then carries out cutting makes its picture surplus ratio consistent with the viewport length-width ratio of virtual reality device, the most preset figure
Case position in picture after cropped is hand plan-position to be obtained.
4. virtual reality exchange method based on photographic head as claimed in claim 3, it is characterised in that obtain hand degree of depth letter
The mode of breath specifically includes: by the distance of the range unit acquisition photographic head on virtual reality device to pre-placing graphic pattern, and with
This distance is by default scaling or be located in virtual scene by preset for hand body after reducing.
5. virtual reality exchange method based on photographic head as claimed in claim 4, it is characterised in that obtain hand motion letter
The mode of breath specifically includes: the successive frame picture being carried out action conversion by the hand gestures preset higher than a predetermined number is formed
Hand gestures data set set up hand gestures model and error equation, image data collection is trained with judge and obtain hands
Portion's action message.
6. a virtual reality interactive device based on photographic head, it is characterised in that include image acquisition unit, decoding unit,
Comparing unit, reduction unit, information analysis unit and reconstruction unit；
Described image acquisition unit for obtaining the hand images of band hand information by photographic head, and described hand information includes hands
The information of the pre-placing graphic pattern of the palm or the back of the hand；
Described decoding unit, for being decoded preset pattern-information, obtains the binary sequence with verification frame；
Described comparing unit is pre-with each hand in virtual scene for the binary sequence with verification frame decoding obtained
The binary sequence putting body is compared, and described reduction unit is consistent for restoring binary sequence in virtual scene
The preset body of hand；
Described information analysis unit is for obtaining hand the first attitude information, hand plane by the hand images of band hand information
Positional information, hand depth information, hand the second attitude information and hand motion information, described reconstruction unit is for according to information
Above-mentioned five kinds of information acquired in resolution unit in virtual scene with hand preset volume reconstruction hand motion.
7. virtual reality interactive device based on photographic head as claimed in claim 6, it is characterised in that information analysis unit obtains
The mode taking hand the first attitude information specifically includes: be in palm by preset pattern-information or the back of the hand judges the of hand
One attitude be the back of the hand upwards or palm upwards；
The mode obtaining hand the second attitude information specifically includes: sentence by identifying whether to have preset pattern to be positioned on finger-joint
Disconnected current hand the second attitude.
Virtual reality interactive device based on photographic head the most as claimed in claims 6 or 7, it is characterised in that information analysis list
Unit obtains the mode of hand plan position information and specifically includes: judge the angle of photographic head Radix Rumicis and the viewport of virtual reality device
Size is the most identical, and the most pre-placing graphic pattern position in the hand images of band hand information is hand to be obtained and puts down
Position, face；Hand information otherwise carries out cutting makes its picture surplus ratio consistent with the viewport length-width ratio of virtual reality device,
The most pre-placing graphic pattern position in picture after cropped is hand plan-position to be obtained.
9. virtual reality interactive device based on photographic head as claimed in claim 8, it is characterised in that information analysis unit obtains
The mode taking hand depth information specifically includes: obtain photographic head to pre-placing graphic pattern by the range unit on virtual reality device
Distance, and with this distance by default scaling or preset for hand body is located in virtual scene after reducing.
10. virtual reality interactive device based on photographic head as claimed in claim 9, it is characterised in that information analysis unit
The mode obtaining hand motion information specifically includes: carry out action conversion by the hand gestures preset higher than a predetermined number
The hand gestures data set of successive frame picture composition sets up hand gestures model and error equation, is trained image data collection
To judge and to obtain hand motion information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610624148.1A CN106293078A (en) | 2016-08-02 | 2016-08-02 | Virtual reality exchange method based on photographic head and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610624148.1A CN106293078A (en) | 2016-08-02 | 2016-08-02 | Virtual reality exchange method based on photographic head and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106293078A true CN106293078A (en) | 2017-01-04 |
Family
ID=57664367
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610624148.1A Pending CN106293078A (en) | 2016-08-02 | 2016-08-02 | Virtual reality exchange method based on photographic head and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106293078A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107358657A (en) * | 2017-06-30 | 2017-11-17 | 海南职业技术学院 | Interactive method and system is realized based on augmented reality |
| WO2017080533A3 (en) * | 2017-01-22 | 2017-12-07 | 广东虚拟现实科技有限公司 | Apparatus for interacting with virtual reality environment |
| CN109074404A (en) * | 2016-05-12 | 2018-12-21 | 三星电子株式会社 | For providing the method and apparatus of content navigation |
| CN112416133A (en) * | 2020-11-30 | 2021-02-26 | 魔珐(上海)信息科技有限公司 | Hand motion capture method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799717A (en) * | 2010-03-05 | 2010-08-11 | 天津大学 | Man-machine interaction method based on hand action catch |
| CN102193631A (en) * | 2011-05-05 | 2011-09-21 | 上海大学 | Wearable three-dimensional gesture interaction system and using method thereof |
| CN104460951A (en) * | 2013-09-12 | 2015-03-25 | 天津智树电子科技有限公司 | Human-computer interaction method |
| US20150138078A1 (en) * | 2013-11-18 | 2015-05-21 | Eyal Krupka | Hand pose recognition using boosted look up tables |
| CN104656890A (en) * | 2014-12-10 | 2015-05-27 | 杭州凌手科技有限公司 | Virtual realistic intelligent projection gesture interaction all-in-one machine |
| CN105051755A (en) * | 2013-01-18 | 2015-11-11 | 微软技术许可有限责任公司 | Part and state detection for gesture recognition |
-
2016
- 2016-08-02 CN CN201610624148.1A patent/CN106293078A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799717A (en) * | 2010-03-05 | 2010-08-11 | 天津大学 | Man-machine interaction method based on hand action catch |
| CN102193631A (en) * | 2011-05-05 | 2011-09-21 | 上海大学 | Wearable three-dimensional gesture interaction system and using method thereof |
| CN105051755A (en) * | 2013-01-18 | 2015-11-11 | 微软技术许可有限责任公司 | Part and state detection for gesture recognition |
| CN104460951A (en) * | 2013-09-12 | 2015-03-25 | 天津智树电子科技有限公司 | Human-computer interaction method |
| US20150138078A1 (en) * | 2013-11-18 | 2015-05-21 | Eyal Krupka | Hand pose recognition using boosted look up tables |
| CN104656890A (en) * | 2014-12-10 | 2015-05-27 | 杭州凌手科技有限公司 | Virtual realistic intelligent projection gesture interaction all-in-one machine |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109074404A (en) * | 2016-05-12 | 2018-12-21 | 三星电子株式会社 | For providing the method and apparatus of content navigation |
| WO2017080533A3 (en) * | 2017-01-22 | 2017-12-07 | 广东虚拟现实科技有限公司 | Apparatus for interacting with virtual reality environment |
| CN107358657A (en) * | 2017-06-30 | 2017-11-17 | 海南职业技术学院 | Interactive method and system is realized based on augmented reality |
| CN107358657B (en) * | 2017-06-30 | 2019-01-15 | 海南职业技术学院 | The method and system of interaction is realized based on augmented reality |
| CN112416133A (en) * | 2020-11-30 | 2021-02-26 | 魔珐(上海)信息科技有限公司 | Hand motion capture method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Memo et al. | Head-mounted gesture controlled interface for human-computer interaction | |
| CN110163048B (en) | Hand key point recognition model training method, hand key point recognition method and hand key point recognition equipment | |
| CN111325823B (en) | Method, device and equipment for acquiring face texture image and storage medium | |
| CN109635621B (en) | System and method for recognizing gestures based on deep learning in first-person perspective | |
| CN107820593B (en) | Virtual reality interaction method, device and system | |
| CN108875633B (en) | Expression detection and expression driving method, device and system and storage medium | |
| Wang et al. | Real-time hand-tracking with a color glove | |
| CN103400119B (en) | Face recognition technology-based mixed reality spectacle interactive display method | |
| KR20130016318A (en) | A method of real-time cropping of a real entity recorded in a video sequence | |
| CN105107200B (en) | Face Changing system and method based on real-time deep body feeling interaction and augmented reality | |
| CN106325509A (en) | Three-dimensional gesture recognition method and system | |
| WO2022174594A1 (en) | Multi-camera-based bare hand tracking and display method and system, and apparatus | |
| CN106293078A (en) | Virtual reality exchange method based on photographic head and device | |
| CN106030610A (en) | Real-time 3D gesture recognition and tracking system for mobile devices | |
| CN109035415B (en) | Virtual model processing method, device, equipment and computer readable storage medium | |
| CN109933190B (en) | Head-mounted display equipment and interaction method thereof | |
| CN111460937A (en) | Face feature point positioning method and device, terminal equipment and storage medium | |
| CN108305321A (en) | A kind of three-dimensional human hand 3D skeleton patterns real-time reconstruction method and apparatus based on binocular color imaging system | |
| CN107203961B (en) | Expression migration method and electronic equipment | |
| CN110544315A (en) | control method of virtual object and related equipment | |
| CN107092347B (en) | Augmented reality interaction system and image processing method | |
| CN109531578B (en) | Humanoid mechanical arm somatosensory control method and device | |
| CN109426336A (en) | A kind of virtual reality auxiliary type selecting equipment | |
| CN115953375A (en) | Hand acupuncture point positioning method and system with multiple methods integrated and electronic equipment | |
| CN115205974A (en) | Gesture recognition method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170104 |