CN106774871A - Nearly eye display device space-location method and system based on image recognition - Google Patents
Nearly eye display device space-location method and system based on image recognition Download PDFInfo
- Publication number
- CN106774871A CN106774871A CN201611131426.6A CN201611131426A CN106774871A CN 106774871 A CN106774871 A CN 106774871A CN 201611131426 A CN201611131426 A CN 201611131426A CN 106774871 A CN106774871 A CN 106774871A
- Authority
- CN
- China
- Prior art keywords
- light source
- display device
- eye display
- nearly eye
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000001514 detection method Methods 0.000 claims abstract description 4
- 238000000926 separation method Methods 0.000 claims description 3
- 238000005259 measurement Methods 0.000 abstract description 13
- 238000010586 diagram Methods 0.000 description 14
- 230000000739 chaotic effect Effects 0.000 description 4
- 230000004807 localization Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000035807 sensation Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000000205 computational method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
Abstract
The present invention provides a kind of nearly eye display device space-location method and system based on image recognition, including nearly eye display device and observation device, and the observation device is arranged on the top in located space region, and the main detection of the observation device is directed downward.Compared with prior art, light-emitting device is arranged on the present invention top of nearly eye display device, reduces the probability that the test light that light-emitting device when using sends is blocked, and increased the degree of accuracy and the continuity of measurement.By the method for identification marking linear feature, there is provided a kind of new attitude measurement means, it is independent of gyroscope and is capable of achieving attitude measurement.
Description
Technical field
The present invention relates to space orientation field, more specifically to a kind of nearly eye display device based on image recognition
Space-location method and system.
Background technology
Space orientation is typically positioned and calculated using the pattern of optics or ultrasonic wave, is derived by setting up model and treated
Survey the locus of object.General nearly eye display device space-location method and system based on image recognition use infrared point
The mode received with light sensation camera determines the locus of object, and measures the angle information of object according to gyroscope,
In the front end of nearly eye display device, in positioning, light sensation camera catches the position of infrared point and then extrapolates and uses infrared point
The physical coordinates of person.This localization method is widely used in current nearly eye display device, and the localization method as main flow has
There is the features such as reaction is fast, seizure is simple.But meanwhile, this localization method has certain limitation, on the one hand in position fixing process
In, IR is often blocked by the pedestrian of surrounding or article, causes of short duration to position；On the other hand, this space is determined
Position method depends on gyroscope unduly, and locating effect can be then had a strong impact on if there is gyroscope drift.
The content of the invention
In order to the nearly eye display device space-location method and system that solve to be currently based on image recognition are easily blocked and mistake
Degree relies on the defect of gyroscope, and the present invention provides a kind of nearly eye based on image recognition of the gyroscope that is difficult to be blocked, be independent of
Display device space-location method and system.
The technical solution adopted for the present invention to solve the technical problems is：A kind of nearly eye based on image recognition is provided to show
Device space-location method, comprises the following steps：
S1：Calculate user locus coordinate；
S2：Observation device shoots the image of nearly eye display device, and recognizes length and the side of mark lines image in image
To；
S3：According to user locus coordinate call to should space coordinates algorithm, the observation device applies mechanically this
The angle information of algorithm and the length according to mark lines and direction calculating user's head.
Preferably, the sign lines include lateral sources and longitudinal light source, the lateral sources and longitudinal light source
Intersect.
Preferably, longitudinal light source includes front located light source and rearmounted light source, the frequency of the light of the front located light source transmitting
Frequency from the light that the rearmounted light source is launched is different, and the frequency of the light of the rearmounted light source transmitting is launched with the lateral sources
Light frequency it is identical, observation device front located light source image according to the frequency separation of light, and according to the preposition light
The direction of the image judgement symbol lines in source.
Preferably, the sign lines include the headband that intersects.
Preferably, the nearly eye display device includes front panel, and mark light source, the mark light are provided with the headband
Source is positioned close to the direction of the front panel, side of the observation device according to the position judgment headband image of mark light source
To.
Preferably, it is PnP algorithms to calculate user locus and sit calibration method.
A kind of nearly eye display device space positioning system based on image recognition, including nearly eye display device and observation are provided
Device, the observation device is arranged on the top in located space region, and the main detection of the observation device is directed downward.
Preferably, the nearly eye display device includes lateral sources, longitudinal light source and front panel, the lateral sources and institute
State longitudinal light source to intersect, longitudinal light source includes front located light source and rearmounted light source, the front located light source is positioned close to
One end of the front panel, the rearmounted light source is identical with the frequency of the light that the lateral sources are launched, the front located light source with
The frequency of the light of the rearmounted light source transmitting is different.
Preferably, the nearly eye display device includes front panel and two cross one another headbands, and the headband is near institute
State and be provided with the direction of front panel mark light source.
Compared with prior art, light-emitting device is arranged on the present invention top of nearly eye display device, is reduced when using
The probability that the test light that light-emitting device sends is blocked, increased the degree of accuracy and the continuity of measurement.By identification marking line
A kind of method of bar feature, there is provided new attitude measurement means, is independent of gyroscope and is capable of achieving attitude measurement.Using transverse direction
Light source and longitudinal light source can indirectly be calculated as mark lines by measuring the method for lateral sources and longitudinal light source length
The attitude angle information of user's head, the feature for being different from other light sources glow frequency by front located light source may determine that transverse direction
The direction of light source and longitudinal light source, direction is chaotic when preventing test influences measurement accuracy.Can as mark lines by the use of headband
To calculate the attitude angle information of user's head indirectly by the method for headband length, by setting mark light source, prevent
The chaotic influence measurement accuracy in direction during test.By the way that observation device to be arranged on the top in located space region, can be effective
Preventing observation device cannot observe because being blocked, the stability of the positioning of raising.
Brief description of the drawings
Below in conjunction with drawings and Examples, the invention will be further described, in accompanying drawing：
Fig. 1 is the nearly eye display device space-location method and system structure diagram that prior art is based on image recognition；
Fig. 2 is the nearly eye display device space-location method and system principle schematic diagram that prior art is based on image recognition；
Fig. 3 is nearly eye display device space-location method and system structure diagram of the present invention based on image recognition；
Fig. 4 is nearly eye display device space-location method and system principle schematic diagram of the present invention based on image recognition；
Fig. 5 a are to observe the not inclined image schematic diagram of user's head that device is photographed；
Fig. 5 b are the image schematic diagrames that user's head that observation device is photographed leans forward；
Fig. 5 c are the image schematic diagrames for observing user's head layback that device is photographed；
Fig. 5 d are to observe the right-oblique image schematic diagram of user's head that device is photographed；
Fig. 5 e are to observe the left-oblique image schematic diagram of user's head that device is photographed；
Fig. 6 is that nearly eye display device space-location method and system second embodiment of the present invention based on image recognition are illustrated
Figure.
Specific embodiment
In order to the nearly eye display device space-location method and system that solve to be currently based on image recognition are easily blocked and mistake
Degree relies on the defect of gyroscope, and the present invention provides a kind of nearly eye based on image recognition of the gyroscope that is difficult to be blocked, be independent of
Display device space-location method and system.
In order to be more clearly understood to technical characteristic of the invention, purpose and effect, now compare accompanying drawing and describe in detail
Specific embodiment of the invention.
Fig. 1-Fig. 2 shows that prior art is based on the nearly eye display device space-location method and system of image recognition, bag
Nearly eye display device 10 and observation device 15 are included, nearly eye display device 10 includes setting the front panel of the nearly front end of eye display device 10
11, multiple light-emitting devices 13 are provided with front panel 11.In position fixing process, light-emitting device 13 is to emission infrared light.Observation
The infrared light of the observation transmitting of light-emitting device 13 of device 15, and the infrared light image for arriving according to the observation judges nearly eye display device 10
Horizontal coordinate, i.e. x-axis and y-axis coordinate as shown in the figure.In the existing nearly eye display device space orientation side based on image recognition
In method and system, observation device 15 is generally located on front or the front position on the upper side of nearly eye display device 10 to be easy to catch
Infrared ray, when the pedestrian of surrounding walked from the front of nearly eye display device 10 it is out-of-date, nearly eye display device 10 with observation device 15 it
Between light path be easily cut off, causing to observe device 15 cannot judge the position of nearly eye display device 10.
Fig. 3 shows that the nearly eye of nearly eye display device space-location method and system of the present invention based on image recognition shows
The top view of device 20, nearly eye display device 20 includes lateral sources 21, longitudinal light source 22 and front panel 23, and front panel 23 is set
In the front end of nearly eye display device 20, lateral sources 21 and longitudinal light source 22 are linear, can be as the mark of space identity
Lines, lateral sources 21 and longitudinal light source 22 intersect, and longitudinal light source 22 includes front located light source 221 and rearmounted light source 222, preceding
Put one end that light source 221 is positioned close to front panel 23.Lateral sources 21 are identical with the frequency of the light that rearmounted light source 222 is launched,
Front located light source 221 is different from the frequency of the light that rearmounted light source 222 is launched.Lateral sources 21 and longitudinal light source 22 can be arranged on closely
On the headband 24 of eye display device 20, towards the top of nearly eye display device 20.
Fig. 4 shows that nearly eye display device space-location method and system principle of the present invention based on image recognition are illustrated
Figure.The present invention includes nearly eye display device 20 and observation device 25, and observation device 25 is arranged on the top in located space region, bag
At least one camera is included, its main detection is directed downward.After user wears nearly eye display device 20, device 25 is observed
The top of nearly eye display device 20 can be clearly observable.Lateral sources 21 and the light of longitudinal transmitting of light source 22 can be observed
Device 25 is observed, image can processed after the observation shooting image of device 25, the frequency separation front located light source according to light
The image of 221 image, the image of rearmounted light source 222 and lateral sources 21, the image according to front located light source 221 judges preposition light
The direction in source 221, rearmounted light source 222 and lateral sources 21, observation device 25 can also judge the length of each image, according to each
The length of individual image can be determined that the attitude of user.
Fig. 5 a -5e shows the image of the observation shooting of device 25 and the corresponding relation of user's attitude.Wherein, Fig. 5 a are
The not inclined image schematic diagram of user's head that observation device 25 is photographed；Fig. 5 b are to observe the user that device 25 is photographed
The image schematic diagram that head leans forward；Fig. 5 c are the image schematic diagrames for observing user's head layback that device 25 is photographed；Fig. 5 d
It is to observe the right-oblique image schematic diagram of user's head that device 25 is photographed；Fig. 5 e are to observe the use that device 25 is photographed
The left-oblique image schematic diagram of person's head.When there is inclination all around in certain locus head in user, its
The unique observation image of gradient correspondence, according to the tilt data that user's head can be correspondingly found in measuring and calculating image, you can
Draw the angle information of user's head.This mode is simple and easy to apply, it is not necessary to which angularly survey tool can be rapid for gyroscope
The angle information of user's head is calculated, there is certain positive role for nearly eye display device space orientation.
The computational methods of user's head angle information when the above method shows user's head just to camera head 25,
It should be pointed out that when user changes in the position coordinates of located space, identical appearance of the user in different spatial
In the case of state, light source formed image in device 25 is observed is different, therefore, when user's head is in not just to observation
During the position of device 25, calculation at this moment will be more relative complex.After positioning starts, user wears nearly eye and shows
Showing device 20, calculates user locus coordinate, according to user locus according to algorithms most in use such as PnP algorithms first
Coordinate applies mechanically corresponding algorithm, and observation device 25 shoots the image of nearly eye display device 20, and image is processed, and draws horizontal stroke
To light source 21 it is each while length and length during each longitudinal light source 22.The length on each side of lateral sources 21 and longitudinal light source 22 is each
The length on side calculates the angle information of user's head by being inserted in corresponding algorithm.
Fig. 6 shows nearly eye display device space-location method and system second embodiment of the present invention based on image recognition
Principle schematic.Second embodiment of the invention is essentially identical with first embodiment, and difference is, second embodiment and first
Embodiment setting overhead is different, and in a second embodiment, nearly eye display device 30 includes two cross one another headbands 34,
The headband 34 of intersection can be observed device 25 and observe, mark is provided with the direction of front panel 33 with 34 in cross head
Light source 39, can be processed image after the observation shooting image of device 25, and the image according to mark light source 39 distinguishes cross head
The all directions of band, and judge the length of each headband image, the length according to each image can be determined that the attitude of user.
Compared with prior art, light-emitting device is arranged on the present invention top of nearly eye display device 20, is reduced and is used
When the probability that is blocked of the test light that sends of light-emitting device, increased the degree of accuracy and the continuity of measurement.By identification marking
A kind of method of linear feature, there is provided new attitude measurement means, is independent of gyroscope and is capable of achieving attitude measurement.Using horizontal stroke
Method that can be by measuring lateral sources 21 and longitudinal length of light source 22 as mark lines to light source 21 and longitudinal light source 22
The attitude angle information of user's head is calculated indirectly, and the spy of other light sources glow frequency is different from by front located light source 221
The direction that may determine that lateral sources 21 and longitudinal light source 22 is levied, direction is chaotic when preventing test influences measurement accuracy.Utilize
Headband 34 can indirectly calculate the attitude angle information of user's head as mark lines by the method for the length of headband 34,
By setting mark light source 39, when preventing test, direction is chaotic influences measurement accuracy.Determined by the way that observation device 25 is arranged on
The top in bit space region, can effectively prevent observation device 25 from cannot be observed because being blocked, the stability of the positioning of raising.
Embodiments of the invention are described above in conjunction with accompanying drawing, but the invention is not limited in above-mentioned specific
Implementation method, above-mentioned specific embodiment is only schematical, rather than restricted, one of ordinary skill in the art
Under enlightenment of the invention, in the case of present inventive concept and scope of the claimed protection is not departed from, can also make a lot
Form, these are belonged within protection of the invention.
Claims (9)
1. a kind of nearly eye display device space-location method based on image recognition, it is characterised in that：Comprise the following steps：
S1：Calculate user locus coordinate；
S2：Observation device shoots the image of nearly eye display device, and recognizes length and the direction of mark lines image in image；
S3：According to user locus coordinate call to should space coordinates algorithm, the observation device applies mechanically the algorithm
And length and the angle information of direction calculating user's head according to mark lines.
2. the nearly eye display device space-location method based on image recognition according to claim 1, it is characterised in that：Institute
Stating sign lines includes lateral sources and longitudinal light source, and the lateral sources intersect with longitudinal light source.
3. the nearly eye display device space-location method based on image recognition according to claim 2, it is characterised in that：Institute
Stating longitudinal light source includes front located light source and rearmounted light source, and frequency and the rearmounted light source of the light of the front located light source transmitting are launched
Light frequency it is different, the frequency of the light of the rearmounted light source transmitting is identical with the frequency of the light that the lateral sources are launched, institute
Observation device front located light source image according to the frequency separation of light is stated, and according to the image judgement symbol line of the front located light source
The direction of bar.
4. the nearly eye display device space-location method based on image recognition according to claim 1, it is characterised in that：Institute
Stating sign lines includes the headband that intersects.
5. the nearly eye display device space-location method based on image recognition according to claim 4, it is characterised in that：Institute
Stating nearly eye display device includes front panel, and mark light source is provided with the headband, and the mark light source is positioned close to described
The direction of front panel, direction of the observation device according to the position judgment headband image of mark light source.
6. the nearly eye display device space-location method based on image recognition according to claim 1, it is characterised in that：Meter
It is PnP algorithms to calculate user locus and sit calibration method.
7. a kind of nearly eye display device space positioning system based on image recognition, it is characterised in that：Including nearly eye display device
With observation device, the observation device is arranged on the top in located space region, the main detection direction court of the observation device
Under.
8. the nearly eye display device space positioning system based on image recognition according to claim 7, it is characterised in that：Institute
Stating nearly eye display device includes lateral sources, longitudinal light source and front panel, and the lateral sources and longitudinal light source are mutually handed over
Fork, longitudinal light source includes front located light source and rearmounted light source, and the front located light source is positioned close to one end of the front panel,
The rearmounted light source is identical with the frequency of the light that the lateral sources are launched, and the front located light source is launched with the rearmounted light source
The frequency of light is different.
9. the nearly eye display device space positioning system based on image recognition according to claim 7, it is characterised in that：Institute
Stating nearly eye display device includes front panel and two cross one another headbands, and the headband sets on the direction of the front panel
It is equipped with mark light source.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611131426.6A CN106774871A (en) | 2016-12-09 | 2016-12-09 | Nearly eye display device space-location method and system based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611131426.6A CN106774871A (en) | 2016-12-09 | 2016-12-09 | Nearly eye display device space-location method and system based on image recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106774871A true CN106774871A (en) | 2017-05-31 |
Family
ID=58875940
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611131426.6A Pending CN106774871A (en) | 2016-12-09 | 2016-12-09 | Nearly eye display device space-location method and system based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106774871A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104574357A (en) * | 2013-10-16 | 2015-04-29 | 康耐视公司 | System and method for locating fiducials with known shape |
| CN106020456A (en) * | 2016-05-11 | 2016-10-12 | 北京暴风魔镜科技有限公司 | Method, device and system for acquiring head posture of user |
| CN205766164U (en) * | 2016-05-20 | 2016-12-07 | 中国科学院上海高等研究院 | Cross laser assists in identifying alignment system and transfer robot |
-
2016
- 2016-12-09 CN CN201611131426.6A patent/CN106774871A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104574357A (en) * | 2013-10-16 | 2015-04-29 | 康耐视公司 | System and method for locating fiducials with known shape |
| CN106020456A (en) * | 2016-05-11 | 2016-10-12 | 北京暴风魔镜科技有限公司 | Method, device and system for acquiring head posture of user |
| CN205766164U (en) * | 2016-05-20 | 2016-12-07 | 中国科学院上海高等研究院 | Cross laser assists in identifying alignment system and transfer robot |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20160104298A1 (en) | Apparatus and method for poomsae recognition and dan promotion test of taekwondo based on skeleton of human body using depth camera | |
| US20180089524A1 (en) | Object recognition device and object recognition method | |
| CN106933343B (en) | Apparatus and method for recognizing gestures in virtual reality headset | |
| TWI405143B (en) | Object image correcting apparatus and method of identification | |
| US20150294158A1 (en) | Method and System for Tracking Objects | |
| US10223577B2 (en) | Face image processing apparatus | |
| WO2016008265A1 (en) | Method and apparatus for locating position | |
| JP2009009280A (en) | Three-dimensional signature authentication system | |
| CN110191234B (en) | Intelligent terminal unlocking method based on fixation point analysis | |
| CN106599873A (en) | Figure identity identification method based on three-dimensional attitude information | |
| US10606372B2 (en) | System and method for interaction with a computer implemented interactive application using a depth aware camera | |
| JP6266675B2 (en) | Search support device, search support method, and search support program | |
| CN106709398A (en) | Gaze analysis method and device | |
| CN110132129A (en) | The system based on augmented reality with circumference attributive function | |
| CN109815810A (en) | A kind of biopsy method based on single camera | |
| JP4566786B2 (en) | Position and orientation measurement method and information processing apparatus | |
| CN106774871A (en) | Nearly eye display device space-location method and system based on image recognition | |
| JP2002008012A (en) | Method for calculating position and attitude of subject and method for calculating position and attitude of observation camera | |
| US20160092743A1 (en) | Apparatus and method for measuring a gaze | |
| CN106767757A (en) | Nearly eye display device gesture recognition method and system based on database | |
| US20230405432A1 (en) | Device and method for sensing movement of sphere moving on plane surface using camera, and device and method for sensing golfball moving on putting mat | |
| JP2018046427A (en) | Target searching device, target searching method and target searching program | |
| CN108322710A (en) | Crowd evacuation apparatus and system | |
| CN206208204U (en) | Nearly eye display device with spatialization function | |
| JP6847442B2 (en) | Object tracking device, object tracking method, and object tracking program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |