CN112634463A - Size matching augmented reality method and system for AR glasses - Google Patents
Size matching augmented reality method and system for AR glasses Download PDFInfo
- Publication number
- CN112634463A CN112634463A CN202011521109.1A CN202011521109A CN112634463A CN 112634463 A CN112634463 A CN 112634463A CN 202011521109 A CN202011521109 A CN 202011521109A CN 112634463 A CN112634463 A CN 112634463A
- Authority
- CN
- China
- Prior art keywords
- real object
- size
- glasses
- virtual
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a method and a system for enhancing reality sense by matching sizes of AR glasses, wherein the method comprises the following steps: a virtual article size obtaining step: acquiring the size of a virtual article; a step of acquiring the size of the real object: acquiring the size of a real object: size matching enhancement step: finding a real object with the size which is most matched with the size of the virtual object from the plurality of real objects, and marking as an overlapped real object; an image superposition step: and superposing and displaying the virtual object on the superposed real object through AR glasses. The invention can display the virtual article on the real article with the matched size in a superposed manner, thereby realizing the touch sense of simulating the virtual article in the size.
Description
Technical Field
The invention relates to the field of AR, in particular to a method and a system for enhancing reality by matching the size of AR glasses.
Background
The encyclopedia AR entry discloses: augmented Reality (AR), which is a relatively new technology content that promotes integration between real world information and virtual world information content, implements analog simulation processing on the basis of computer and other scientific technologies of entity information that is relatively difficult to experience in the spatial range of the real world, superimposes the virtual information content for effective application in the real world, and can be perceived by human senses in the process, thereby realizing sensory experience beyond Reality. After the real environment and the virtual object are overlapped, the real environment and the virtual object can exist in the same picture and space at the same time. The augmented reality technology not only can effectively embody the content of the real world, but also can promote the display of virtual information content, and the fine content is mutually supplemented and superposed. In the visual augmented reality, a user needs to enable the real world to be overlapped with computer graphics on the basis of a helmet display, and the real world can be fully seen around the computer graphics after the real world is overlapped. The augmented reality technology mainly comprises new technologies and means such as multimedia, three-dimensional modeling, scene fusion and the like, and the information content provided by augmented reality and the information content which can be perceived by human beings are obviously different.
The haptic experience of the user in the prior art for the virtual object in size needs to be optimized.
Disclosure of Invention
In view of the deficiencies in the prior art, it is an object of the present invention to provide a method and system for size matching augmented reality of AR glasses.
The method for enhancing the reality sense of the AR glasses through size matching comprises the following steps:
a virtual article size obtaining step: acquiring the size of a virtual article;
a step of acquiring the size of the real object: acquiring the size of a real object:
size matching enhancement step: finding a real object with the size which is most matched with the size of the virtual object from the plurality of real objects, and marking as an overlapped real object;
an image superposition step: and superposing and displaying the virtual object on the superposed real object through AR glasses.
Preferably, in the step of acquiring the size of the real object, the AR glasses wearer is prompted to watch the real object, the distance between the real object and the AR glasses wearer and the size of the real object in an image captured by a camera of the AR glasses are determined according to the point of gaze of the AR glasses wearer, and then the actual size of the real object is obtained according to the distance and the size in the image, and is used as the size of the real object to be matched with the size of the virtual object.
Preferably, the virtual object is a virtual display screen, the size of the virtual object is the length and width of the virtual display screen, and the size of the real object is the length and width of a flat surface of the real object.
Preferably, when the flat surface of the real object faces the AR glasses wearer, if the length and width of the outline of the flat surface of the real object, which is acquired by the camera of the AR glasses, match with the length and width of the virtual display screen, the virtual display screen is displayed on the flat surface of the real object in an overlapping manner; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed.
Preferably, when the flat surface of the real object faces the AR glasses wearer, the length and width of the outline of the flat surface of the real object, which is acquired by the camera of the AR glasses, match the length and width of the virtual display screen, and if the AR glasses wearer inputs an instruction to turn on the virtual display screen, the virtual display screen is displayed on the flat surface of the real object in a superimposed manner; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed if the AR glasses wearer inputs an instruction for closing the virtual display screen.
The method for enhancing the reality sense of the AR glasses through size matching comprises the following steps:
a virtual article size obtaining step: acquiring the size of a virtual article;
a step of acquiring the size of the real object: acquiring the size of a real object:
size matching enhancement step: finding a real object with the size which is most matched with the size of the virtual object from the plurality of real objects, and marking as an overlapped real object;
an image superposition step: and superposing and displaying the virtual object on the superposed real object through AR glasses.
Preferably, in the step of acquiring the size of the real object, the AR glasses wearer is prompted to watch the real object, the distance between the real object and the AR glasses wearer and the size of the real object in an image captured by a camera of the AR glasses are determined according to the point of gaze of the AR glasses wearer, and then the actual size of the real object is obtained according to the distance and the size in the image, and is used as the size of the real object to be matched with the size of the virtual object.
Preferably, the virtual object is a virtual display screen, the size of the virtual object is the length and width of the virtual display screen, and the size of the real object is the length and width of a flat surface of the real object.
Preferably, when the flat surface of the real object faces the AR glasses wearer, if the length and width of the outline of the flat surface of the real object, which is acquired by the camera of the AR glasses, match with the length and width of the virtual display screen, the virtual display screen is displayed on the flat surface of the real object in an overlapping manner; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed.
Preferably, when the flat surface of the real object faces the AR glasses wearer, the length and width of the outline of the flat surface of the real object, which is acquired by the camera of the AR glasses, match the length and width of the virtual display screen, and if the AR glasses wearer inputs an instruction to turn on the virtual display screen, the virtual display screen is displayed on the flat surface of the real object in a superimposed manner; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed if the AR glasses wearer inputs an instruction for closing the virtual display screen.
Compared with the prior art, the invention has the following beneficial effects:
the invention can display the virtual article on the real article with the matched size in a superposed manner, thereby realizing the touch sense of simulating the virtual article in the size.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a flow chart of the steps of the method of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
The method for enhancing the reality sense of the AR glasses through size matching comprises the following steps:
a virtual article size obtaining step: acquiring the size of a virtual article; specifically, the size of the virtual article is an attribute of the virtual article when the virtual article is constructed, and the size given by the virtual article is obtained from the attribute of the virtual article. The size of the virtual article is only the size of the surface of the virtual article displayed to the AR glasses wearer, for example, the size of the virtual mobile phone is only the length and width of the surface of the body where the screen of the virtual mobile phone is located, and does not include the thickness of the body of the virtual mobile phone.
A step of acquiring the size of the real object: acquiring the size of a real object: in a preferred example, what real object is obtained through image recognition, and then the size of the real object is found in a database; in another preferred example, in the step of acquiring the size of the real object, the AR glasses wearer is prompted to watch on the real object, the distance between the real object and the AR glasses wearer and the size of the real object in the image captured by the camera of the AR glasses are determined according to the point of gaze of the AR glasses wearer, and then the actual size of the real object is obtained according to the distance and the size in the image, and is used as the size of the real object to be matched with the size of the virtual object. Wherein, according to the point of regard and according to AR glasses wearer's eye movement, can obtain AR glasses wearer and fix a gaze the department reality article and AR glasses wearer's interval, more specifically, through knowing the sight that AR glasses wearer binocular watched, can obtain the angle between the binocular vision line, regard as the interval between fix a gaze department reality article and AR glasses wearer with the interval of binocular vision line and AR glasses wearer.
Size matching enhancement step: finding a real object with the size which is most matched with the size of the virtual object from the plurality of real objects, and marking as an overlapped real object; the virtual article is a virtual display screen, the size of the virtual article is the length and width of the virtual display screen, and the size of the real article is the length and width of the flat surface of the real article. When the front surface of the flat surface of the real object faces the AR glasses wearer, the length and the width of the outline of the flat surface of the real object, which are acquired by a camera of the AR glasses, are matched with the length and the width of the virtual display screen, and then the virtual display screen is superposed and displayed on the flat surface of the real object; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed. Further preferably, the AR glasses wearer can turn on or off the display of the virtual item by adjusting the posture of the real item. When the front surface of the flat surface of the real object faces the AR glasses wearer, the length and the width of the outline of the flat surface of the real object, which are acquired by a camera of the AR glasses, are matched with the length and the width of the virtual display screen, and if the AR glasses wearer inputs an instruction for starting the virtual display screen, the virtual display screen is superposed and displayed on the flat surface of the real object; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed if the AR glasses wearer inputs an instruction for closing the virtual display screen.
An image superposition step: and superposing and displaying the virtual object on the superposed real object through AR glasses.
The invention provides a system for matching and enhancing reality of AR glasses in size, which comprises:
a virtual article size acquisition module: acquiring the size of a virtual article; specifically, the size of the virtual article is an attribute of the virtual article when the virtual article is constructed, and the size given by the virtual article is obtained from the attribute of the virtual article. The size of the virtual article is only the size of the surface of the virtual article displayed to the AR glasses wearer, for example, the size of the virtual mobile phone is only the length and width of the surface of the body where the screen of the virtual mobile phone is located, and does not include the thickness of the body of the virtual mobile phone.
Real object size acquisition module: acquiring the size of a real object: in a preferred example, what real object is obtained through image recognition, and then the size of the real object is found in a database; in another preferred example, in the real object size obtaining module, the AR glasses wearer is prompted to watch the real object, the distance between the real object and the AR glasses wearer and the size of the real object in the image captured by the camera of the AR glasses are determined according to the gazing point of the AR glasses wearer, and then the actual size of the real object is obtained according to the distance and the size in the image, and is used as the size of the real object to be matched with the size of the virtual object. Wherein, according to the point of regard and according to AR glasses wearer's eye movement, can obtain AR glasses wearer and fix a gaze the department reality article and AR glasses wearer's interval, more specifically, through knowing the sight that AR glasses wearer binocular watched, can obtain the angle between the binocular vision line, regard as the interval between fix a gaze department reality article and AR glasses wearer with the interval of binocular vision line and AR glasses wearer.
A size matching enhancement module: finding a real object with the size which is most matched with the size of the virtual object from the plurality of real objects, and marking as an overlapped real object; the virtual article is a virtual display screen, the size of the virtual article is the length and width of the virtual display screen, and the size of the real article is the length and width of the flat surface of the real article. When the front surface of the flat surface of the real object faces the AR glasses wearer, the length and the width of the outline of the flat surface of the real object, which are acquired by a camera of the AR glasses, are matched with the length and the width of the virtual display screen, and then the virtual display screen is superposed and displayed on the flat surface of the real object; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed. Further preferably, the AR glasses wearer can turn on or off the display of the virtual item by adjusting the posture of the real item. When the front surface of the flat surface of the real object faces the AR glasses wearer, the length and the width of the outline of the flat surface of the real object, which are acquired by a camera of the AR glasses, are matched with the length and the width of the virtual display screen, and if the AR glasses wearer inputs an instruction for starting the virtual display screen, the virtual display screen is superposed and displayed on the flat surface of the real object; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed if the AR glasses wearer inputs an instruction for closing the virtual display screen.
An image superimposition module: and superposing and displaying the virtual object on the superposed real object through AR glasses.
Those skilled in the art will appreciate that, in addition to implementing the systems, apparatus, and various modules thereof provided by the present invention in purely computer readable program code, the same procedures can be implemented entirely by logically programming method steps such that the systems, apparatus, and various modules thereof are provided in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system, the device and the modules thereof provided by the present invention can be considered as a hardware component, and the modules included in the system, the device and the modules thereof for implementing various programs can also be considered as structures in the hardware component; modules for performing various functions may also be considered to be both software programs for performing the methods and structures within hardware components.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.
Claims (10)
1. A method for matching sizes of AR glasses to enhance reality, comprising:
a virtual article size obtaining step: acquiring the size of a virtual article;
a step of acquiring the size of the real object: acquiring the size of a real object:
size matching enhancement step: finding a real object with the size which is most matched with the size of the virtual object from the plurality of real objects, and marking as an overlapped real object;
an image superposition step: and superposing and displaying the virtual object on the superposed real object through AR glasses.
2. The method for augmented reality of size matching of AR glasses according to claim 1, wherein in the step of obtaining the size of the real object, the AR glasses wearer is prompted to gaze at the real object, the distance between the real object and the AR glasses wearer is determined according to the gaze point of the AR glasses wearer, and the size of the real object in the image captured by the camera of the AR glasses, and then the actual size of the real object is obtained according to the distance and the size in the image, and is used as the size of the real object to be matched with the size of the virtual object.
3. The method of claim 2, wherein the virtual object is a virtual display screen, the size of the virtual object is the length and width of the virtual display screen, and the size of the real object is the length and width of a flat surface of the real object.
4. The AR glasses size matching augmented reality method according to claim 3, wherein when the flat surface of the real object faces the AR glasses wearer, the virtual display screen is displayed superimposed on the flat surface of the real object when the length and width of the outline of the flat surface of the real object, which is acquired by the camera of the AR glasses, matches with the length and width of the virtual display screen; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed.
5. The AR glasses size matching augmented reality method according to claim 4, wherein when the flat surface of the real object faces the AR glasses wearer, the length and width of the outline of the flat surface of the real object acquired by the camera of the AR glasses match the length and width of the virtual display screen, and when the AR glasses wearer is considered to input an instruction to turn on the virtual display screen, the virtual display screen is displayed on the flat surface of the real object in an overlapping manner; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed if the AR glasses wearer inputs an instruction for closing the virtual display screen.
6. A method for matching sizes of AR glasses to enhance reality, comprising:
a virtual article size obtaining step: acquiring the size of a virtual article;
a step of acquiring the size of the real object: acquiring the size of a real object:
size matching enhancement step: finding a real object with the size which is most matched with the size of the virtual object from the plurality of real objects, and marking as an overlapped real object;
an image superposition step: and superposing and displaying the virtual object on the superposed real object through AR glasses.
7. The AR glasses size matching augmented reality method according to claim 6, wherein in the real object size obtaining step, the AR glasses wearer is prompted to watch on the real object, the distance between the real object and the AR glasses wearer is determined according to the gazing point of the AR glasses wearer, and the size of the real object in the image captured by the camera of the AR glasses, and then the actual size of the real object is obtained according to the distance and the size in the image and is used as the size of the real object and the size of the virtual object to be matched.
8. The method of claim 7, wherein the virtual object is a virtual display screen, the size of the virtual object is the length and width of the virtual display screen, and the size of the real object is the length and width of a flat surface of the real object.
9. The method for matching the size of the AR glasses to enhance the sense of reality according to claim 8, wherein when the flat surface of the real object faces the AR glasses wearer, if the length and width of the contour of the flat surface of the real object, which is captured by the camera of the AR glasses, matches the length and width of the virtual display screen, the virtual display screen is displayed in a superimposed manner on the flat surface of the real object; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed.
10. The method for matching the size of the AR glasses to enhance the sense of reality according to claim 9, wherein when the flat surface of the real object faces the AR glasses wearer, the length and width of the outline of the flat surface of the real object captured by the camera included in the AR glasses match the length and width of the virtual display screen, and when the AR glasses wearer inputs an instruction to turn on the virtual display screen, the virtual display screen is displayed in a superimposed manner on the flat surface of the real object; when the flat surface of the real object does not face the AR glasses wearer, the length and the width of the outline of the flat surface of the real object collected by the camera of the AR glasses are not matched with the length and the width of the virtual display screen, and the virtual display screen is hidden and not displayed if the AR glasses wearer inputs an instruction for closing the virtual display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011521109.1A CN112634463A (en) | 2020-12-21 | 2020-12-21 | Size matching augmented reality method and system for AR glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011521109.1A CN112634463A (en) | 2020-12-21 | 2020-12-21 | Size matching augmented reality method and system for AR glasses |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112634463A true CN112634463A (en) | 2021-04-09 |
Family
ID=75320428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011521109.1A Pending CN112634463A (en) | 2020-12-21 | 2020-12-21 | Size matching augmented reality method and system for AR glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112634463A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113676721A (en) * | 2021-08-20 | 2021-11-19 | 融信信息科技有限公司 | Image acquisition method and system of AR glasses |
-
2020
- 2020-12-21 CN CN202011521109.1A patent/CN112634463A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113676721A (en) * | 2021-08-20 | 2021-11-19 | 融信信息科技有限公司 | Image acquisition method and system of AR glasses |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11756269B2 (en) | Tangibility visualization of virtual objects within a computer-generated reality environment | |
| Carmigniani et al. | Augmented reality technologies, systems and applications | |
| Esteves et al. | Smoothmoves: Smooth pursuits head movements for augmented reality | |
| US11302086B1 (en) | Providing features of an electronic product in an augmented reality environment | |
| DE112017001718T5 (en) | EXTENDED REALITY IN A FIELD OF VIEW THAT CONTAINS A REFLECTION | |
| US11170521B1 (en) | Position estimation based on eye gaze | |
| KR20170085477A (en) | Method and system for reconstructing obstructed face portions for virtual reality environment | |
| US20200387215A1 (en) | Physical input device in virtual reality | |
| US11314396B2 (en) | Selecting a text input field using eye gaze | |
| US20200401804A1 (en) | Virtual content positioned based on detected object | |
| CN111273766B (en) | Method, apparatus and system for generating an affordance linked to a simulated reality representation of an item | |
| US20240104813A1 (en) | Techniques for enabling drawing in a computer-generated reality environment | |
| US11682138B2 (en) | Localization and mapping using images from multiple devices | |
| CN103546733A (en) | Display method and electronic device | |
| CN112634463A (en) | Size matching augmented reality method and system for AR glasses | |
| CN109032350B (en) | Vertigo sensation alleviating method, virtual reality device, and computer-readable storage medium | |
| CN103257703A (en) | Augmented reality device and method | |
| CN112634346A (en) | AR (augmented reality) glasses-based real object size acquisition method and system | |
| Yokoro et al. | DecluttAR: An Interactive Visual Clutter Dimming System to Help Focus on Work | |
| CN106504063B (en) | A kind of virtual hair tries video frequency showing system on | |
| CN114299263A (en) | Display method and device for augmented reality AR scene | |
| EP4295219A1 (en) | Devices, methods, and graphical user interfaces for maps | |
| Nakahara et al. | Sensory property in fusion of visual/haptic cues by using mixed reality | |
| CN113612985A (en) | Processing method of interactive VR image | |
| CN112634462A (en) | Temperature matching augmented reality method and system for AR glasses |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |