CN108038916A - A kind of display methods of augmented reality - Google Patents
A kind of display methods of augmented reality Download PDFInfo
- Publication number
- CN108038916A CN108038916A CN201711443850.9A CN201711443850A CN108038916A CN 108038916 A CN108038916 A CN 108038916A CN 201711443850 A CN201711443850 A CN 201711443850A CN 108038916 A CN108038916 A CN 108038916A
- Authority
- CN
- China
- Prior art keywords
- input equipment
- display
- augmented reality
- screen
- virtual display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Abstract
The present embodiments relate to augmented reality field, discloses a kind of display methods of augmented reality.In the present invention, there is provided a kind of display methods of augmented reality, including：Obtain the two dimensional surface where the screen of input equipment；According to two dimensional surface, Target space position is obtained；The locus being superimposed upon using Target space position as virtual display in actual environment；Wherein, virtual display shows the content of input equipment input, allow to the position of quick obtaining virtual display, direct information exchange is carried out using the input equipment with display capabilities and augmented reality glasses so that the application power of augmented reality is improved.
Description
Technical field
The present embodiments relate to augmented reality field, more particularly to a kind of display methods of augmented reality.
Background technology
Augmented reality refers to the environment that real world is presented using image display, and increases some and generated by computer
Sense organ input, such as sound, video, figure data.As new man-machine interface and emulation tool, augmented reality by
The concern arrived is increasingly extensive, and important function has been played in many fields, for the mankind intelligent expansion provide it is strong
Means, generate the mode of production and social life huge far-reaching influence.Augmented reality glasses are as a kind of new meter
Device is calculated, has been had a wide range of applications in various fields such as military affairs, industry, medical treatment, science and technology.Augmented reality glasses, which combine, to be calculated
A variety of complex art means such as machine graph technology, emulation technology and Display Technique, by reality scene superposition calculation machine give birth to
Into virtual three-dimensional figure, intuitively can show and manipulate digital content.Since augmented reality glasses are in displaying digital content
When need to be overlapped with current true environment, therefore augmented reality glasses are needed by sensing system collection current environment
Spatial coordinated information.When being scanned using augmented reality glasses to environment, it is necessary to reference to computer graphics techniques, emulation technology
With Display Technique etc., the environment of an augmented reality is created, is interacted with actual environment.
However, it is found by the inventors that at least there are the following problems in the prior art：Generate augmented reality environment Structure of need light
Actual environment is taken multiple scan and is modeled, technology realize it is sufficiently complex, and when loading a virtual display,
Often can not be in the angular field of view of user, it is, thus, sought for the position of virtual display, largely have impact on user's body
Test.That is, in the prior art, it is difficult to quickly obtain virtual display position, and technology realize it is more complicated.
Another technical problem that augmented reality glasses need to solve is the information exchange with user, is set as wearable
It is standby, in the prior art generally using being integrated in physical button, Trackpad or wireless remote controller on glasses as input equipment,
And the application software for possessing a set of independent operating uses these interactive devices, these input equipment universal functionalities are simple, do not show
Show ability, it is difficult to carry out intuitively interaction or the input of complex word, it is very big that this make it that the application power of augmented reality is subject to
Limitation.
The content of the invention
The purpose of embodiment of the present invention is to provide a kind of display methods of augmented reality so that can be empty with quick obtaining
Intend the position of display screen, direct information exchange is carried out using the input equipment with display capabilities and augmented reality glasses, is made
The application power for obtaining augmented reality is improved.
In order to solve the above technical problems, embodiments of the present invention provide a kind of display methods of augmented reality, including：
Obtain the two dimensional surface where the screen of input equipment；
According to two dimensional surface, Target space position is obtained；
The locus being superimposed upon using Target space position as virtual display in actual environment；Wherein, virtual display
Screen shows the content of input equipment input.
Embodiment of the present invention in terms of existing technologies, obtains the two dimensional surface where the screen of input equipment；Root
According to two dimensional surface, Target space position is obtained；The sky being superimposed upon using Target space position as virtual display in actual environment
Between position；Wherein, virtual display shows the content of input equipment input.By where directly acquiring the screen of input equipment
Two dimensional surface can quickly obtain locus of the virtual display in actual environment, be conducive to avoid to complicated reality
Environment is scanned, then virtual display is added to the relative complex side of this in actual environment based on the result of scanning recognition
Method, is greatly reduced the workload of technological layer.Meanwhile it can directly display user in virtual display and pass through input equipment
The content of input, input equipment have screen, and screen has display capabilities, can directly be carried out with augmented reality glasses more multiple
Miscellaneous information exchange, this causes the application power of augmented reality to be improved.
In addition, obtaining the two dimensional surface where the screen of input equipment, specifically include：Shown on the screen of scan input device
The characteristic image shown；Extract the characteristic point on characteristic image；Where the screen that input equipment is obtained according to the characteristic point of extraction
Two dimensional surface.Since the feature of the characteristic point of the characteristic image on screen is more obvious, the characteristic point extracted is relatively steady
It is fixed, also stablized relatively based on the two dimensional surface that metastable characteristic point obtains, so that the sky of the virtual display obtained
Between position also relatively stablize, greatly improve user experience.
In addition, after the locus for being superimposed upon Target space position in actual environment as virtual display, also
Including：Receive the control information of input equipment input；According to control information, the dispaly state of virtual display is controlled.By defeated
Enter the control information of equipment input, the change of the dispaly states such as the size shape of virtual display can be controlled so that is virtual aobvious
The dispaly state of display screen can be adjusted according to the actual requirements, convenient for users to use.
In addition, after the dispaly state of control virtual display, further include：Judge whether to receive input equipment transmission
Screen locking signal；If receiving screen locking signal, virtual display is locked.Virtual display is carried out locking to cause
User can be used input equipment as the users such as keyboard, mouse or remote controler equipment used in everyday.By defeated
Enter equipment can very intuitive and convenient ground in locked virtual display carry out relevant operation so that augmented reality
Display methods it is more flexible.
Brief description of the drawings
One or more embodiments are illustrative by the picture in corresponding attached drawing, these exemplary theorys
The bright restriction not formed to embodiment, the element for having same reference numbers label in attached drawing are expressed as similar element, remove
Non- have a special statement, and composition does not limit the figure in attached drawing.
Fig. 1 is the flow diagram of the display methods of the augmented reality of first embodiment according to the present invention；
Fig. 2 (a) is a kind of characteristic image shown according to the present invention on the screen of the input equipment of first embodiment
Schematic diagram；
Fig. 2 (b) is a kind of characteristic image shown according to the present invention on the screen of the input equipment of first embodiment
Schematic diagram；
Fig. 2 (c) is a kind of characteristic image shown according to the present invention on the screen of the input equipment of first embodiment
Schematic diagram；
Fig. 3 is the practical application schematic diagram of the display methods of the augmented reality of first embodiment according to the present invention；
Fig. 4 is the flow diagram of the display methods of the augmented reality of second embodiment according to the present invention；
Fig. 5 is the arrange parameter interface schematic diagram of the input equipment of second embodiment according to the present invention；
Fig. 6 is the schematic diagram of the size and location change of the virtual display of second embodiment according to the present invention；
Fig. 7 is that the input equipment of second embodiment according to the present invention is considered as the schematic diagram of mouse；
Fig. 8 is that the input equipment of second embodiment according to the present invention is considered as the schematic diagram of keyboard；
Fig. 9 is the flow diagram of the display methods of the augmented reality of the 3rd embodiment according to the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with attached drawing to the present invention
Each embodiment be explained in detail.However, it will be understood by those skilled in the art that in each embodiment party of the present invention
In formula, many ins and outs are proposed in order to make reader more fully understand the application.But even if without these ins and outs
With many variations based on following embodiment and modification, the application technical solution claimed can also be realized.
The first embodiment of the present invention is related to a kind of display methods of augmented reality.The core of present embodiment is to obtain
Take the two dimensional surface where the screen of input equipment；According to two dimensional surface, Target space position is obtained；Target space position is made
The locus being superimposed upon for virtual display in actual environment；Wherein, virtual display shows the content of input equipment input,
Allow to the position of quick obtaining virtual display, carried out using the input equipment with display capabilities and augmented reality glasses
Direct information exchange so that the application power of augmented reality is improved.Below to the aobvious of the augmented reality of present embodiment
That shows method realizes that details is specifically described, and herein below only realizes details for convenience of what understanding provided, not implements this
Scheme it is necessary.
The flow diagram of the display methods of the augmented reality of first embodiment of the invention is as shown in Figure 1, augmented reality
Display methods can be applied to augmented reality glasses, specifically include：
Step 101：Obtain the two dimensional surface where the screen of input equipment.
Specifically, augmented reality glasses can obtain the two dimensional surface where the screen of input equipment, and input equipment can
Think that PC, mobile phone, tablet computer etc. can show the smart machine of image with screen.Input in present embodiment
Equipment is not limited thereto in practical applications by taking mobile phone as an example.
Augmented reality glasses can be with the screen of scanning cell phone, and extracts the characteristic point on mobile phone screen, and characteristic point can manage
As soon as solving to put different special points from other present in an image, such as feature is not present on a pure white image
Point, and if there is several stains on this pure white image, due to other points on these stains and this pure white image
Form difference, then can be using these stains as characteristic point.Characteristic point on mobile phone screen can be understood as mobile phone
Point at frame, or the point of mobile phone screen surrounding black and white intersection.It is understood that obtaining a two dimensional surface at least needs
The coordinate of four points is wanted, therefore, the two dimensional surface where obtaining mobile phone screen needs the coordinate of at least four characteristic points.Enhancing
Reality glasses can extract 1 points on mobile phone screen of coordinate, and the characteristic point extracted certainly is more, and the two dimension of acquisition is put down
Face is more accurate.Such as the characteristic point on the mobile phone screen of extraction can be characterized coordinate (u1, v1) a little on the screen,
(u2, v2) ... ..., (un, vn), then the two dimensional surface according to where the coordinate of these points can obtain mobile phone screen.
Augmented reality glasses can also be by the characteristic image that is shown on scanning cell phone screen, and extracts on characteristic image
Characteristic point.Characteristic image on mobile phone screen can be as shown in Fig. 2 (a), 2 (b), 2 (c), and certain present embodiment is only to provide
Three kinds of characteristic images being likely to occur, but be not limited thereto in practical applications, characteristic image can be various patterns, number
Word, letter etc..It is all obvious since the feature point feature of the characteristic image on mobile phone screen is more prominent, and strengthen existing
Real glasses are easy for that multiple more stable characteristic points can be extracted, then more based on these quantity and relatively stable
Characteristic point and the two dimensional surface where the mobile phone screen that obtains is just relatively accurate, and more stablize.
It should be noted that the two dimension where the screen of two kinds of acquisition input equipments is merely provided in present embodiment is put down
The method in face, but be not limited thereto in practical applications, any screen institute that input equipment is obtained on augmented reality glasses
Two dimensional surface method within present embodiment protection domain.
Step 102：According to two dimensional surface, Target space position is obtained.
Specifically, augmented reality glasses according to the two dimensional surface where mobile phone screen, can obtain the first sky of mobile phone
Between position；The first locus according to where mobile phone, obtains Target space position, and Target space position can be understood as virtually
The locus of display screen.Such as the camera in augmented reality glasses is scanned mobile phone screen, then can establish with
Camera coordinate system (Xc, Yc, Zc) centered on camera, origin are located at camera lens optical center, and X, Y-axis are put down with the both sides practised physiognomy respectively
OK, Z axis is camera lens optical axis, vertical with phase plane.Coordinate under camera coordinates system is the first locus where mobile phone
Coordinate.Meanwhile the world coordinate system of (Xw, Yw, the Zw) on the basis of mobile phone screen is established, the world coordinate system is with said extracted
Some characteristic point be origin, plane where X/Y plane (two dimensional surface) and mobile phone plane overlaps, and Z axis is put down perpendicular to mobile phone
Face.Coordinate under world coordinate system is the coordinate of the Target space position where virtual display.It can be established by algorithm
The transformational relation of camera coordinates system and world coordinate system, obtains world coordinate system to the spin matrix R of camera coordinates system and translation
Matrix T.The homography matrix Homography of world's plane and camera plane is calculated using direct linear transformation algorithm, so as to ask
Go out the spin matrix R and translation matrix T between two coordinate systems.Equally, can also be calculated using the method for nonlinear optimization
Obtain the spin matrix R and translation matrix T between two coordinate systems.So that the first locus according to where mobile phone,
Obtain Target space position.
The characteristic point of 4 or more than 4 extracted can also be utilized in order to obtain the locus of virtual display
To carry out the conversion of coordinate system.Assuming that coordinate (u1, v1) of the characteristic point in screen, (u2, v2) ... ..., (un, vn), passes through phase
The inner parameter of machine, two-dimensional coordinate of the characteristic point on the two dimensional surface where mobile phone screen can be converted into camera coordinates
(X1c, Y1c, Z1c), (X2c, Y2c, Z2c) ... ..., (Xnc, Ync, Znc).If shown on mobile phone screen or mobile phone screen
Characteristic image correlated characteristic information, for example size etc. is by advance demand flag mistake, then each corresponding characteristic point is alive
The position of boundary's coordinate system can also draw (X1w, Y1w, Z1w), (X2w, Y2w, Z2w) ... ..., (Xnw, Ynw, Znw).
It should be noted that present embodiment merely provides two kinds of realities that Target space position is obtained according to two dimensional surface
Existing method, is not limited thereto in practical applications, any to obtain the method for Target space position all at this based on two dimensional surface
Within invention embodiment protection domain.
Step 103：Virtual display is projected into Target space position.
Specifically, the Target space position obtained in step 102 is superimposed upon real ring as virtual display
Locus in border, i.e. augmented reality glasses can project to virtual display at Target space position, and virtual display can
To show the content of input equipment input.The locus of virtual display determines that its size and shape can be acquiescence
Value can also be the value that is configured by mobile phone.Such as augmented reality glasses 301, virtual display in present embodiment
Relation between screen 302, mobile phone 303 can show that mobile phone 303 inputs interior as shown in Figure 3, in virtual display 302
Hold.User can obtain a virtual display 302 above mobile phone, and 303 screen of mobile phone can be shown in the virtual display 302
Content on curtain, while the virtual display 302 can also follow the movement of mobile phone 303 and move, and increase equivalent to mobile phone 303
A portable giant-screen is added.
Compared with prior art, in present embodiment, the two dimensional surface where the screen of input equipment is obtained；According to two dimension
Plane, obtains Target space position；The locus being superimposed upon using Target space position as virtual display in actual environment；
Wherein, virtual display shows the content of input equipment input.Put down by the two dimension where directly acquiring the screen of input equipment
Face can quickly obtain locus of the virtual display in actual environment, be conducive to avoid to complicated actual environment into
Virtual display is added to the relative complex method of this in actual environment by row scanning based on the result of scanning recognition again, significantly
Degree alleviates the workload of technological layer.Meanwhile it can directly display what user was inputted by input equipment in virtual display
Content, input equipment have screen, and screen has display capabilities, directly can carry out complex letter with augmented reality glasses
Breath interaction, this causes the application power of augmented reality to be improved.
Second embodiment of the present invention is related to a kind of display methods of augmented reality.Second embodiment is the first implementation
The further improvement of mode, mainly thes improvement is that：Actual environment is superimposed upon using Target space position as virtual display
In locus after, further include：Receive the control information of input equipment input；According to control information, virtual display is controlled
The dispaly state of screen.
The flow diagram of the display methods of the augmented reality of second embodiment of the invention is as shown in figure 4, specifically include：
Step 401：Obtain the two dimensional surface where the screen of input equipment.
Step 402：According to two dimensional surface, Target space position is obtained.
Step 403：Virtual display is projected into Target space position.
Due in present embodiment step 401 to step 403 respectively with step 101 in first embodiment to step 103
It is roughly the same, therefore, to avoid repeating no longer repeating one by one again.
Step 404：Receive the control information of input equipment input.
Specifically, the control information of input equipment input can be size dimension, shape and the enhancing of virtual display
The information such as the distance of Reality glasses.Such as user thinks that the size of current virtual display is too small, then can pass through by
It is expected that size be input to input equipment, estimated size is sent to augmented reality glasses, certain augmented reality by input equipment
Glasses can also pass through wired connection with input equipment by wireless connection so that augmented reality glasses can receive defeated
Enter the control information of equipment input.User can also be configured the shape of virtual display according to the hobby of oneself, such as
Say circular, square or other any shapes.If the user feels that current virtual display is closer to the distance from oneself, look at
It is uncomfortable, above-mentioned distance can also be adjusted, to reach customer satisfaction system distance.
Such as the arrange parameter interface schematic diagram of input equipment is as shown in Figure 5.Input equipment can be mobile phone, pass through
Mobile phone input parameter, adjusts the dispaly states such as virtual display size, position., can be by void to be adapted to the various demands of user
Intend display screen size, shape, distance to change.On mobile phone screen button 501 be adjust virtual display move up and down or
The shape of virtual display is selected, button 502 is to adjust virtual display to move back and forth, and button 503 is to adjust virtual display
Size, button 504 are moving forward and backward for smart mobile phone interface.Present embodiment is only to provide a kind of setting ginseng of input equipment
Interface schematic diagram is counted, the interface of arrange parameter is not limited thereto in practical applications.Step 405：According to control information, control
The dispaly state of virtual display.
Specifically, if control information is to increase the size of virtual display, then augmented reality glasses will control
The size of virtual display increases to the size indicated by control information, the control information control that can also be inputted according to mobile phone
The position of virtual display processed changes.For example the schematic diagram of the size and location change of virtual display can be such as Fig. 6 institutes
Show, user thinks that the current position of virtual display 601 and size cannot all meet the needs of oneself is current, then can pass through
Mobile phone input control information causes the position for the size and display for changing virtual display 601, and augmented reality glasses are receiving
After control information, the virtual display 602 after renewal is included in the desired position of user.Virtually shown in certain present embodiment
The shape of display screen is not limited thereto in practical applications by taking quadrangle as an example.
Step 406：Judge whether to receive the screen locking signal that input equipment is sent, if it is, performing step 407, such as
Fruit is no, then the flow terminates.
Such as if the user feels that the dispaly state such as the size of current virtual display, shape is all proper, no
Think again because mobile phone (input equipment) moves and allow the position of current virtual display screen to change, then hand can be passed through
Machine sends screen locking signal to augmented reality glasses.Augmented reality glasses can decide whether to receive the screen locking letter of mobile phone transmission
Number, step 407 is performed if screen locking signal is received, otherwise the flow terminates.
Step 407：Virtual display is locked.
Specifically, after virtual display is locked, the position of virtual display can't be again because input equipment
Move and change, then input equipment can be considered as mouse as shown in fig. 7, input equipment can be mobile phone at this time, this
Shi Shouji is just provided with the function of mouse, and the content that shown in virtual display can be operated accordingly.Input equipment
Keyboard can also be considered as shown in figure 8, input equipment can be mobile phone, mobile phone just has the function of keyboard at this time, can pass through
Input through keyboard user wants the content seen in virtual display.It is, of course, also possible to using input equipment as remote controler, handle
Deng, input equipment is merely provided in present embodiment as mouse and the implementation of keyboard, but in practical applications not
As limit.
It should be noted that the input equipment in present embodiment is simply by taking mobile phone as an example, but in practical applications not
As limit.
Compared with prior art, embodiment of the present invention, the control information inputted by input equipment, can control virtual
The change of the dispaly states such as the size shape of display screen so that the dispaly state of virtual display can carry out according to the actual requirements
Adjustment, it is convenient for users to use.Virtual display is subjected to locking and allows user using input equipment as keyboard, mouse
Or the user such as remote controler equipment used in everyday is used.By input equipment can very intuitive and convenient ground in quilt
Relevant operation is carried out in the virtual display of locking so that the display methods of augmented reality is more flexible.
Third embodiment of the present invention is related to a kind of display methods of augmented reality.3rd embodiment is the first implementation
The further improvement of mode, mainly thes improvement is that, actual environment is superimposed upon using Target space position as virtual display
In locus after, further include：The acquisition of information display content inputted according to input equipment；Virtual display display input
The content of equipment input, is specially：The display content that virtual display display obtains.
The flow diagram of the display methods of the augmented reality of third embodiment of the invention is as shown in figure 9, specifically include：
Step 901：Obtain the two dimensional surface where the screen of input equipment.
Step 902：According to two dimensional surface, Target space position is obtained.
Step 903：Virtual display is projected into Target space position.
Due in present embodiment step 901 to step 903 respectively with step 101 in first embodiment to step 103
It is roughly the same, therefore, to avoid repeating no longer repeating one by one again.
Step 904：The acquisition of information display content inputted according to input equipment.
Specifically, augmented reality glasses by the screen of scan input device, can obtain the letter of input equipment input
Breath, according to the information of scanning, obtains display content.Input equipment can be mobile phone, and the information of mobile phone input can be Quick Response Code
Information, Quick Response Code are shown on the screen of mobile phone, and augmented reality glasses obtain content to be shown, by scanning the two-dimensional code
The content of display is exactly the content corresponding to Quick Response Code.The information of mobile phone input can also be a network address, and network address is with word graph
The form of piece is shown on the screen of mobile phone, and augmented reality glasses are obtained to be shown by the network address on scanning cell phone screen
Content, content to be shown can be the webpage corresponding to network address or network address in itself.If the information of mobile phone input is only
It is a common picture, then the content for the display that augmented reality glasses are obtained by the picture that is shown on scanning cell phone is exactly
The picture shown on mobile phone.Certainly, in reality use, mobile phone can also be connected with augmented reality glasses by Bluetooth pairing,
The information of input directly can be sent to augmented reality glasses, the letter that augmented reality glasses are sent by receiving mobile phone by mobile phone
Breath, obtains the information of mobile phone input.
It is noted that augmented reality glasses can also be believed account input by user when receiving account information
Breath, which is logged in, added, nullified or deleted etc., to be operated.Such as the corresponding content of Quick Response Code can also be user name (account
Information), if user needs to log in using Quick Response Code, in virtual display can with the corresponding user name of two-dimensional code display,
It can also show the interface for logging in success or failure.Augmented reality glasses can also be by the account corresponding to the Quick Response Code recognized
Information adds as a friend, and either deletes or nullifies from buddy list.Account information can be scanned defeated by augmented reality glasses
Enter the Quick Response Code that equipment is shown to obtain, account information can also be inputted directly in input equipment by user and be then forwarded to enhancing
Reality glasses and obtain.In short, the information of input equipment input can correspond to a variety of dispaly states, shown in virtual display
Content is either the information institute of the content or input equipment input representated by the image shown on input equipment screen
Corresponding other guide.
It should be noted that present embodiment merely provides the side that two kinds of augmented reality glasses obtain content to be shown
Method, is not limited thereto in practical applications, and the method that any augmented reality glasses obtain display content is implemented in the present invention
Within mode protection domain.
Step 905：Display content is included in virtual display.
Such as the display content of augmented reality glasses acquisition is the content of the corresponding webpage of Quick Response Code, then just by net
The content of page is shown in virtual display.If the display content that augmented reality glasses obtain is in the corresponding website of network address
Content, then just include the content in website in virtual display.If the display content that augmented reality glasses obtain is
The corresponding video of video link, then corresponding video can be played in virtual display.If augmented reality glasses obtain
Display content be user account information, then can be shown in virtual display and relevant log on or off interface, add
Plusing good friend interface, delete good friend interface, nullify account interface etc..Certainly, present embodiment is only to provide several be potentially displayed in
Content in virtual display, but be not limited thereto in practical applications.It is noted that input equipment will can also be taken out
The data of the forms such as the character of elephant, image, sound are sent to augmented reality glasses by wired or wireless passage, extend input
The input capability of equipment, while the fan-out capability of augmented reality glasses is greatly improved.
Compared with prior art, the acquisition of information display content that third embodiment of the invention is inputted according to input equipment,
Display content is changed according to the change of input information, user can be defeated by input equipment according to actual needs
Enter different information, make to show that user wants the content seen in virtual display, be greatly improved augmented reality glasses
I/O capability, creating one for user can be convenient for users to use with the augmented reality environment of flexible operating.
The step of various methods divide above, be intended merely to describe it is clear, can be merged into when realizing a step or
Some steps are split, are decomposed into multiple steps, as long as including identical logical relation, all protection domain in this patent
It is interior；To either adding inessential modification in algorithm in flow or introducing inessential design, but its algorithm is not changed
Core design with flow is all in the protection domain of the patent.
It will be understood by those skilled in the art that realize that all or part of step in above-described embodiment method is to pass through
Program instructs relevant hardware to complete, and the program storage is in a storage medium, including some instructions are used so that one
A equipment (can be microcontroller, chip etc.) or processor (processor) perform each embodiment the method for the application
All or part of step.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can store journey
The medium of sequence code.
It will be understood by those skilled in the art that the respective embodiments described above are to realize the specific embodiment of the present invention,
And in practical applications, can to it, various changes can be made in the form and details, without departing from the spirit and scope of the present invention.
Claims (10)
- A kind of 1. display methods of augmented reality, it is characterised in that including：Obtain the two dimensional surface where the screen of input equipment；According to the two dimensional surface, Target space position is obtained；The locus being superimposed upon using the Target space position as virtual display in actual environment；Wherein, it is described virtual Display screen shows the content of the input equipment input.
- 2. the display methods of augmented reality according to claim 1, it is characterised in that it is described according to the two dimensional surface, Target space position is obtained, is specifically included：According to the two dimensional surface, the first locus of the input equipment is obtained；According to first locus, the Target space position is obtained.
- 3. the display methods of augmented reality according to claim 1, it is characterised in that the screen for obtaining input equipment The two dimensional surface at place, specifically includes：Scan the screen of the input equipment；Extract the characteristic point on the screen of the input equipment；Two dimensional surface where the screen of the input equipment is obtained according to the characteristic point of extraction.
- 4. the display methods of augmented reality according to claim 1, it is characterised in that the screen for obtaining input equipment The two dimensional surface at place, specifically includes：Scan the characteristic image shown on the screen of the input equipment；Extract the characteristic point on the characteristic image；Two dimensional surface where the screen of the input equipment is obtained according to the characteristic point of extraction.
- 5. the display methods of augmented reality according to claim 1, it is characterised in that described by the target empty meta Put and be superimposed upon as virtual display after the locus in actual environment, further included：Receive the control information of the input equipment input；According to the control information, the dispaly state of the virtual display is controlled.
- 6. the display methods of augmented reality according to claim 5, it is characterised in that in the control virtual display After the dispaly state of screen, further include：Judge whether to receive the screen locking signal that the input equipment is sent；If receiving the screen locking signal, the virtual display is locked.
- 7. the display methods of augmented reality according to claim 1, it is characterised in that described by the Target space position It is superimposed upon after the locus in actual environment, further includes as virtual display：The acquisition of information display content inputted according to the input equipment；The virtual display shows the content of the input equipment input, is specially：What the virtual display display obtained The display content.
- 8. the display methods of augmented reality according to claim 7, it is characterised in that described defeated according to the input equipment The acquisition of information display content entered, specifically includes：By scanning the screen of the input equipment, the information of the input equipment input is obtained；According to the described information of scanning, the display content is obtained.
- 9. the display methods of augmented reality according to claim 7, it is characterised in that the acquisition input equipment is defeated The characteristic information entered, is specially：The information sent by receiving the input equipment, obtains the information of the input equipment input；According to the described information of transmission, the display content is obtained.
- 10. the display methods of augmented reality according to claim 7, it is characterised in that described by the target empty meta Put and be superimposed upon as virtual display after the locus in actual environment, further included：Judge whether to receive the account information that input equipment provides；If receiving the account information, the account information is logged in, is nullified, added or deleted.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711443850.9A CN108038916B (en) | 2017-12-27 | 2017-12-27 | Augmented reality display method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711443850.9A CN108038916B (en) | 2017-12-27 | 2017-12-27 | Augmented reality display method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108038916A true CN108038916A (en) | 2018-05-15 |
| CN108038916B CN108038916B (en) | 2022-12-02 |
Family
ID=62097980
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711443850.9A Active CN108038916B (en) | 2017-12-27 | 2017-12-27 | Augmented reality display method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108038916B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109085924A (en) * | 2018-08-03 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | The management method and device of smart machine based on AR |
| CN112506463A (en) * | 2020-12-04 | 2021-03-16 | 歌尔光学科技有限公司 | Display method, device and equipment based on head-mounted equipment |
| CN113539436A (en) * | 2020-04-20 | 2021-10-22 | 佳能医疗系统株式会社 | Medical image display device, medical image output device, medical image medium, and medical image display device control method |
| CN116932119A (en) * | 2023-09-15 | 2023-10-24 | 深圳市其域创新科技有限公司 | Virtual screen display method, device, equipment and computer readable storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130215230A1 (en) * | 2012-02-22 | 2013-08-22 | Matt Miesnieks | Augmented Reality System Using a Portable Device |
| US20130286048A1 (en) * | 2012-04-25 | 2013-10-31 | Christian STERNITZKE | Method and system for managing data in terminal-server environments |
| EP2704102A2 (en) * | 2004-08-19 | 2014-03-05 | Sony Computer Entertainment Inc. | Portable augmented reality device and method |
| CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
| CN105026982A (en) * | 2012-11-20 | 2015-11-04 | 微软技术许可有限责任公司 | Head mount display and method for controlling the same |
| CN105917268A (en) * | 2014-02-20 | 2016-08-31 | Lg电子株式会社 | Head mounted display and method for controlling the same |
| CN106355153A (en) * | 2016-08-31 | 2017-01-25 | 上海新镜科技有限公司 | Virtual object display method, device and system based on augmented reality |
| CN106683196A (en) * | 2016-12-30 | 2017-05-17 | 上海悦会信息科技有限公司 | Display method and system of augmented reality, and smart terminal |
| CN206226634U (en) * | 2016-10-13 | 2017-06-06 | 上海分众软件技术有限公司 | It is wireless to throw screen system in real time |
| CN107250891A (en) * | 2015-02-13 | 2017-10-13 | Otoy公司 | Being in communication with each other between head mounted display and real-world objects |
-
2017
- 2017-12-27 CN CN201711443850.9A patent/CN108038916B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2704102A2 (en) * | 2004-08-19 | 2014-03-05 | Sony Computer Entertainment Inc. | Portable augmented reality device and method |
| US20130215230A1 (en) * | 2012-02-22 | 2013-08-22 | Matt Miesnieks | Augmented Reality System Using a Portable Device |
| US20130286048A1 (en) * | 2012-04-25 | 2013-10-31 | Christian STERNITZKE | Method and system for managing data in terminal-server environments |
| CN105026982A (en) * | 2012-11-20 | 2015-11-04 | 微软技术许可有限责任公司 | Head mount display and method for controlling the same |
| CN105917268A (en) * | 2014-02-20 | 2016-08-31 | Lg电子株式会社 | Head mounted display and method for controlling the same |
| CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
| CN107250891A (en) * | 2015-02-13 | 2017-10-13 | Otoy公司 | Being in communication with each other between head mounted display and real-world objects |
| CN106355153A (en) * | 2016-08-31 | 2017-01-25 | 上海新镜科技有限公司 | Virtual object display method, device and system based on augmented reality |
| CN206226634U (en) * | 2016-10-13 | 2017-06-06 | 上海分众软件技术有限公司 | It is wireless to throw screen system in real time |
| CN106683196A (en) * | 2016-12-30 | 2017-05-17 | 上海悦会信息科技有限公司 | Display method and system of augmented reality, and smart terminal |
Non-Patent Citations (5)
| Title |
|---|
| SHUO ZHOU 等: "An "Elder Mode" of New Generation Phone Using Augment Reality", 《PROCEDIA ENVIRONMENTAL SCIENCES》 * |
| 张锐 等: "基于虚拟现实的智能实验仿真系统", 《工业控制计算机》 * |
| 李旭东: "基于特征点的增强现实三维注册算法研究", 《中国博士学位论文全文数据库 信息科技辑》 * |
| 王乘 等: "基于投影重建的增强现实虚实注册方法研究", 《工程图学学报》 * |
| 郭晓明: "基于VR眼镜和智能手机的虚拟现实系统", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109085924A (en) * | 2018-08-03 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | The management method and device of smart machine based on AR |
| CN113539436A (en) * | 2020-04-20 | 2021-10-22 | 佳能医疗系统株式会社 | Medical image display device, medical image output device, medical image medium, and medical image display device control method |
| CN112506463A (en) * | 2020-12-04 | 2021-03-16 | 歌尔光学科技有限公司 | Display method, device and equipment based on head-mounted equipment |
| CN116932119A (en) * | 2023-09-15 | 2023-10-24 | 深圳市其域创新科技有限公司 | Virtual screen display method, device, equipment and computer readable storage medium |
| CN116932119B (en) * | 2023-09-15 | 2024-01-02 | 深圳市其域创新科技有限公司 | Virtual screen display method, device, equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108038916B (en) | 2022-12-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10657716B2 (en) | Collaborative augmented reality system | |
| US10460512B2 (en) | 3D skeletonization using truncated epipolar lines | |
| US11145134B2 (en) | Augmented virtual reality object creation | |
| US11275481B2 (en) | Collaborative augmented reality system | |
| WO2018188499A1 (en) | Image processing method and device, video processing method and device, virtual reality device and storage medium | |
| KR101784328B1 (en) | Augmented reality surface displaying | |
| CN105981076B (en) | Synthesize the construction of augmented reality environment | |
| EP3769509B1 (en) | Multi-endpoint mixed-reality meetings | |
| CN108038916A (en) | A kind of display methods of augmented reality | |
| US9268410B2 (en) | Image processing device, image processing method, and program | |
| US10296359B2 (en) | Interactive system control apparatus and method | |
| US20190130648A1 (en) | Systems and methods for enabling display of virtual information during mixed reality experiences | |
| CN110442245A (en) | Display methods, device, terminal device and storage medium based on physical keyboard | |
| US9043707B2 (en) | Configurable viewcube controller | |
| CN112099681B (en) | Interaction method and device based on three-dimensional scene application and computer equipment | |
| JP2022512525A (en) | AR scene image processing methods and devices, electronic devices and storage media | |
| CN105975259A (en) | Implementation method and device of 3D (Three-dimensional) space user interface | |
| JP2016016319A (en) | Game program for display-controlling objects arranged on virtual spatial plane | |
| US20190130633A1 (en) | Systems and methods for using a cutting volume to determine how to display portions of a virtual object to a user | |
| US20240070302A1 (en) | Collaborative object associated with a geographical location | |
| CN109816723A (en) | Method for controlling projection, device, projection interactive system and storage medium | |
| US20240070300A1 (en) | Selective collaborative object access based on timestamp | |
| US20240070243A1 (en) | Authenticating a selective collaborative object | |
| US20240070299A1 (en) | Revealing collaborative object using countdown timer | |
| US20240069643A1 (en) | Physical gesture interaction with objects based on intuitive design |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |