CN108829250A - A kind of object interaction display method based on augmented reality AR - Google Patents
A kind of object interaction display method based on augmented reality AR Download PDFInfo
- Publication number
- CN108829250A CN108829250A CN201810561624.9A CN201810561624A CN108829250A CN 108829250 A CN108829250 A CN 108829250A CN 201810561624 A CN201810561624 A CN 201810561624A CN 108829250 A CN108829250 A CN 108829250A
- Authority
- CN
- China
- Prior art keywords
- target object
- image
- present image
- relevant information
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 230000003993 interaction Effects 0.000 title claims abstract description 9
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 7
- 230000001747 exhibiting effect Effects 0.000 claims abstract description 26
- 239000000463 material Substances 0.000 description 3
- 241000690275 Phlebotomus wui Species 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/61—Scene description
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2004—Aligning objects, relative positioning of parts
Abstract
This application involves a kind of object interaction display methods based on augmented reality AR, belong to AR technical field, this method includes：Present image is acquired in real time by image collection assembly；By whether there is target object in present image described in image recognition component recognition；There are when the target object in the present image, the relevant information of the target object is obtained；The relevant information is shown by the position by AR component exhibiting based on the target object in the present image in a manner of intended display；When can solve the historical relic in displaying museum, user needs to scan the two-dimensional code or input phonetic order, causes to show that equipment shows that the efficiency of historical relic is lower by AR, the not high problem of real-time；The real-time and efficiency of the relevant information for showing that AR equipment shows target object can be improved.
Description
Technical field
The present invention relates to a kind of object interaction display methods for being based on augmented reality (Augmented Reality, AR), belong to
In AR technical field.
Background technique
AR technology is that the information provided by computer system increases the technology that user perceives real world, will be virtual
Information application is to real world, and dummy object, scene or system prompt information superposition that computer is generated are to real scene
In, to realize the enhancing to reality.Currently, AR technology, which can be applied, carries out cultural relic exhibition in museum.
When being shown by AR technology, usually using two dimensional code identification or voice command control AR equipment display text
The relevant information of object.
But by two dimensional code identification, perhaps voice command control needs scanning input two dimensional code or user to input language
Sound instruction, shows the inefficient of the relevant information of historical relic.
Summary of the invention
The purpose of the present invention is to provide a kind of object interaction display method based on AR.In order to achieve the above objectives, this hair
It is bright to provide the following technical solutions：The method includes：
Present image is acquired in real time by image collection assembly；
By whether there is target object in present image described in image recognition component recognition；
There are when the target object in the present image, the relevant information of the target object is obtained；
Position by AR component exhibiting based on the target object in the present image, by the relevant information with
Intended display mode is shown.
Optionally, the target object is incomplete class object, and the relevant information includes the restored map of the target object
Picture；
The position by AR component exhibiting based on the target object in the present image, by the related letter
Breath is shown in a manner of intended display, including：
The size of the restored image is determined according to size of the target object in the present image；
Position of the target object in the present image is determined as to the display location of the restored image；
In the display location of the present image, by the AR component exhibiting with the size of the restored image
It is shown in a manner of occurring line by line based on the target object.
Optionally, the relevant information for obtaining the target object, including：
The target object and at least one template restored image in template library are compared；
The template restored image that matching degree is higher than preset threshold is determined as to the restored image of the target image.
Optionally, the relevant information includes the character introduction information of the target object；
The position by AR component exhibiting based on the target object in the present image, by the related letter
Breath is shown in a manner of intended display, including：
Determine the target position of the target object；
It is shown in the form of bubble in the target position the AR component exhibiting.
Optionally, it is described present image is acquired in real time by image collection assembly before, further include：
Current geographic position is obtained by positioning component；
Determine template library corresponding with the current geographic position, the template library is for storing the current geographic position
The object of displaying and corresponding relevant information.
Optionally, the target object is gardens ruins.
The beneficial effects of the present invention are：As the movement of user acquires present image by image collection assembly in real time,
Then when image includes target object in this prior, position by AR component exhibiting based on target object in present image,
Relevant information is shown in a manner of intended display；When can solve the historical relic in displaying museum, user needs to scan two
Code or input phonetic order are tieed up, causes to show that equipment shows that the efficiency of historical relic is lower by AR, the not high problem of real-time；By
Present image can be acquired in real time by image collection assembly in AR equipment, led in image there are when target object in this prior
The relevant information that AR component exhibiting shows the target object in a manner of intended display is crossed, it is thus possible to improve showing the exhibition of AR equipment
Show the real-time and efficiency of the relevant information of target object.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And can be implemented in accordance with the contents of the specification, the following is a detailed description of the preferred embodiments of the present invention and the accompanying drawings.
Detailed description of the invention
Fig. 1 is the structural schematic diagram for the AR equipment that the application one embodiment provides；
Fig. 2 is the flow chart for the object interaction display method based on augmented reality AR that the application one embodiment provides.
Specific embodiment
With reference to the accompanying drawings and examples, specific embodiments of the present invention will be described in further detail.Implement below
Example is not intended to limit the scope of the invention for illustrating the present invention.
Fig. 1 is the structural schematic diagram for the AR equipment that the application one embodiment provides, as shown in Figure 1, the equipment is at least wrapped
It includes：Image collection assembly 110, image recognition component 120, AR component exhibiting 130 and control assembly 140.
Wherein, image collection assembly 110, image recognition component 120, AR component exhibiting 130 with 140 phase of control assembly
Even.
Image collection assembly 110 can be CCD camera assembly, and image collection assembly 110 is used for as the movement of user is real-time
Acquire present image.
Present image is sent to control assembly 140 by image collection assembly 110；Again by control assembly 140 by present image
It is sent to image recognition component 120.
Image recognition component 120 can be run in the hardware devices such as computer, mobile phone, tablet computer, personal computer,
Image recognition component 120 is for identifying the collected present image of image collection assembly 110, to identify in present image
With the presence or absence of target object.
Target object can be the historical relic in museum；Alternatively, being also possible to the ruins in gardens, the present embodiment is not to mesh
The type of mark object limits.
Image recognition component 120 is also used to for recognition result to be sent to control assembly 140.
It is there are when target object in present image in recognition result, control assembly 140 obtains the related letter of target object
Breath.
Optionally, the relevant information of target object can be text information, image information, video information etc., this implementation is not
The content of the relevant information is limited.
Control assembly 140 is also used to be based on by AR component exhibiting 130 after getting the relevant information of target image
Position of the target object in present image, which is shown in a manner of intended display.
Optionally, according to the difference of target object, corresponding intended display mode is also different.Schematically, in mesh
Marking object is incomplete class object, which includes the restored image of target object, and intended display mode is at this time：It will restore
Image is covered on target object, and is shown in a manner of occurring line by line；When target object is complete historical relic object, this
When intended display mode be the target object the upper right corner show relevant information.Certainly, the corresponding target of every kind of target object
Exhibition method can also in other ways, and the present embodiment is not construed as limiting this.
AR component exhibiting 130 can be AR glasses, and the content that AR component exhibiting 130 is shown can be two-dimensional；Alternatively,
It can be three-dimensional, it is of course also possible to be more multidimensional, the present embodiment is not construed as limiting this.
Optionally, image collection assembly 110, image recognition component 120, AR component exhibiting 130 and control assembly 140 can be with
It is arranged in same equipment；It is of course also possible to be arranged in distinct device, this implementation is not construed as limiting this.
Certainly, AR equipment can also include other assemblies, such as：AR handle, sensor, positioning component etc..
Fig. 2 is the flow chart for the object interaction display method based on AR that the application one embodiment provides, the present embodiment
With this method be applied to AR equipment shown in FIG. 1 in, and the executing subject of each step be control assembly 140 for said
It is bright.This method includes at least following steps：
Step 201, present image is acquired by image collection assembly in real time.
Optionally, image collection assembly moves as users move, at this point, image collection assembly is collected in real time
Present image is the currently watched object of the user.
Step 202, by whether there is target object in image recognition component recognition present image.
Optionally, image recognition component is carried out the Template Information in present image and template library by image recognition algorithm
Compare, when there is the Template Information to match with the picture material in present image in template library, determines in the present image
There are target objects, at this point, executing step 203；There is no match with the picture material in present image in template library
When Template Information, determine that, there is no target object in the present image, process terminates, or execute step 201 again.
Schematically, target object is incomplete class object, which includes the restored image of target object, control group
Part compares target object and at least one template restored image in template library；Matching degree is higher than to the mould of preset threshold
Plate restored image is determined as the restored image of target image.Such as：Target object is gardens ruins.
Step 203, the relevant information of target object is obtained there are when target object in present image.
The corresponding relevant information of each target object is stored in AR equipment, there are the targets pair identifying present image
As later, reading the relevant information.
Step 204, the position by AR component exhibiting based on target object in present image, by relevant information with target
Exhibition method is shown.
Schematically, target object is incomplete class object, which includes the restored image of target object.At this point,
Control assembly determines the size of restored image according to size of the target object in present image；By target object in present image
In position be determined as the display location of restored image；In the display location of present image, by AR component exhibiting to restore
The size of image is shown in a manner of occurring line by line based on target object.
Optionally, relevant information further includes the character introduction information of target object；At this point, being based on mesh by AR component exhibiting
Position of the object in present image is marked, relevant information is shown in a manner of intended display, can also include：Determine target
The target position of object；It is shown in the form of bubble in target position AR component exhibiting.
Such as：The recommended information of target object is shown in the form of bubble in the upper right corner of target object, such as：Historical relic goes out
Native date, effect, age, user etc..
In conclusion the object interaction display method provided in this embodiment based on AR, as the movement of user passes through figure
As acquisition component acquires present image in real time, when then image includes target object in this prior, it is based on by AR component exhibiting
Relevant information is shown by position of the target object in present image in a manner of intended display；It can solve displaying natural science
When historical relic in shop, user needs to scan the two-dimensional code or input phonetic order, causes to show equipment displaying historical relic by AR
Efficiency is lower, the not high problem of real-time；Since AR equipment can acquire present image by image collection assembly in real time, at this
There are when target object in present image, show that the related of the target object is believed in a manner of intended display by AR component exhibiting
Breath, it is thus possible to improve showing that AR equipment shows the real-time and efficiency of the relevant information of target object.
In addition, the restored image that relevant information includes target object, and root is arranged when target object is incomplete class object
The size of restored image is determined according to size of the target object in present image；Position of the target object in present image is true
It is set to the display location of restored image；In the display location of present image, by AR component exhibiting with the size of restored image
It is shown in a manner of occurring line by line based on target object；AR equipment is allowed to show incomplete class in the form that material object restores
Object improves the vividness that AR equipment shows incomplete class object.
Optionally, based on the above embodiment, before step 201, AR equipment can also be obtained current by positioning component
Geographical location；Determine that template library corresponding with the current geographic position, the template library are used to store current geographic position displaying
Object and corresponding relevant information.
Such as：Current geographic position is Phlebotomus wui garden, then AR equipment is corresponding with Phlebotomus wui garden by collected present image
Template library matched to obtain target object, and the relevant information of the target object is obtained from the template library.
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, all should be considered as described in this specification.
The embodiments described above only express several embodiments of the present invention, and the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to protection of the invention
Range.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.
Claims (6)
1. a kind of object interaction display method based on augmented reality AR, which is characterized in that the method includes：
Present image is acquired in real time by image collection assembly；
By whether there is target object in present image described in image recognition component recognition；
There are when the target object in the present image, the relevant information of the target object is obtained；
Position by AR component exhibiting based on the target object in the present image, by the relevant information with target
Exhibition method is shown.
2. the correlation is believed the method according to claim 1, wherein the target object is incomplete class object
Breath includes the restored image of the target object；
The position by AR component exhibiting based on the target object in the present image, by the relevant information with
Intended display mode is shown, including：
The size of the restored image is determined according to size of the target object in the present image；
Position of the target object in the present image is determined as to the display location of the restored image；
In the display location of the present image, it is based on by the AR component exhibiting with the size of the restored image
The target object is shown in a manner of occurring line by line.
3. according to the method described in claim 2, it is characterized in that, the relevant information for obtaining the target object, including：
The target object and at least one template restored image in template library are compared；
The template restored image that matching degree is higher than preset threshold is determined as to the restored image of the target image.
4. the method according to claim 1, wherein the text that the relevant information includes the target object is situated between
Continue information；
The position by AR component exhibiting based on the target object in the present image, by the relevant information with
Intended display mode is shown, including：
Determine the target position of the target object；
It is shown in the form of bubble in the target position the AR component exhibiting.
5. the method according to claim 1, wherein described acquire present image by image collection assembly in real time
Before, further include：
Current geographic position is obtained by positioning component；
Determine that template library corresponding with the current geographic position, the template library are shown for storing the current geographic position
Object and corresponding relevant information.
6. method according to any one of claims 1 to 5, which is characterized in that the target object is gardens ruins.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810561624.9A CN108829250A (en) | 2018-06-04 | 2018-06-04 | A kind of object interaction display method based on augmented reality AR |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810561624.9A CN108829250A (en) | 2018-06-04 | 2018-06-04 | A kind of object interaction display method based on augmented reality AR |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108829250A true CN108829250A (en) | 2018-11-16 |
Family
ID=64143362
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810561624.9A Pending CN108829250A (en) | 2018-06-04 | 2018-06-04 | A kind of object interaction display method based on augmented reality AR |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829250A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109885172A (en) * | 2019-02-27 | 2019-06-14 | 苏州市职业大学 | A kind of object interaction display method and system based on augmented reality AR |
| CN109917918A (en) * | 2019-03-07 | 2019-06-21 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment based on augmented reality |
| CN110716645A (en) * | 2019-10-15 | 2020-01-21 | 北京市商汤科技开发有限公司 | Augmented reality data presentation method and device, electronic equipment and storage medium |
| CN110908504A (en) * | 2019-10-10 | 2020-03-24 | 浙江大学 | Augmented reality museum cooperative interaction method and system based on user-exhibit distance |
| CN111552076A (en) * | 2020-05-13 | 2020-08-18 | 歌尔科技有限公司 | Image display method, AR glasses and storage medium |
| CN111862340A (en) * | 2020-07-09 | 2020-10-30 | 北京市商汤科技开发有限公司 | Augmented reality data presentation method and device, display equipment and storage medium |
| WO2021088161A1 (en) * | 2019-11-08 | 2021-05-14 | 福建工程学院 | Ar-based description method and description system |
| CN113326709A (en) * | 2021-06-17 | 2021-08-31 | 北京市商汤科技开发有限公司 | Display method, device, equipment and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105491365A (en) * | 2015-11-25 | 2016-04-13 | 罗军 | Image processing method, device and system based on mobile terminal |
| US20160124257A1 (en) * | 2012-03-27 | 2016-05-05 | Japan Display Inc. | Liquid crystal display device |
| CN105677021A (en) * | 2015-12-31 | 2016-06-15 | 周岩 | New method based on fusion of AR system and VR system and applying new method to recurrence of relics |
| CN106355153A (en) * | 2016-08-31 | 2017-01-25 | 上海新镜科技有限公司 | Virtual object display method, device and system based on augmented reality |
| CN107894842A (en) * | 2017-12-19 | 2018-04-10 | 北京盈拓文化传媒有限公司 | Augmented reality scene restored method, terminal and computer-readable recording medium |
-
2018
- 2018-06-04 CN CN201810561624.9A patent/CN108829250A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160124257A1 (en) * | 2012-03-27 | 2016-05-05 | Japan Display Inc. | Liquid crystal display device |
| CN105491365A (en) * | 2015-11-25 | 2016-04-13 | 罗军 | Image processing method, device and system based on mobile terminal |
| CN105677021A (en) * | 2015-12-31 | 2016-06-15 | 周岩 | New method based on fusion of AR system and VR system and applying new method to recurrence of relics |
| CN106355153A (en) * | 2016-08-31 | 2017-01-25 | 上海新镜科技有限公司 | Virtual object display method, device and system based on augmented reality |
| CN107894842A (en) * | 2017-12-19 | 2018-04-10 | 北京盈拓文化传媒有限公司 | Augmented reality scene restored method, terminal and computer-readable recording medium |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109885172A (en) * | 2019-02-27 | 2019-06-14 | 苏州市职业大学 | A kind of object interaction display method and system based on augmented reality AR |
| CN109885172B (en) * | 2019-02-27 | 2022-04-29 | 苏州市职业大学 | Object interaction display method and system based on Augmented Reality (AR) |
| CN109917918A (en) * | 2019-03-07 | 2019-06-21 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment based on augmented reality |
| CN110908504A (en) * | 2019-10-10 | 2020-03-24 | 浙江大学 | Augmented reality museum cooperative interaction method and system based on user-exhibit distance |
| CN110716645A (en) * | 2019-10-15 | 2020-01-21 | 北京市商汤科技开发有限公司 | Augmented reality data presentation method and device, electronic equipment and storage medium |
| WO2021088161A1 (en) * | 2019-11-08 | 2021-05-14 | 福建工程学院 | Ar-based description method and description system |
| CN111552076A (en) * | 2020-05-13 | 2020-08-18 | 歌尔科技有限公司 | Image display method, AR glasses and storage medium |
| CN111552076B (en) * | 2020-05-13 | 2022-05-06 | 歌尔科技有限公司 | Image display method, AR glasses and storage medium |
| US11835726B2 (en) | 2020-05-13 | 2023-12-05 | Goertek, Inc. | Image display method, AR glasses and storage medium |
| CN111862340A (en) * | 2020-07-09 | 2020-10-30 | 北京市商汤科技开发有限公司 | Augmented reality data presentation method and device, display equipment and storage medium |
| CN113326709A (en) * | 2021-06-17 | 2021-08-31 | 北京市商汤科技开发有限公司 | Display method, device, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829250A (en) | A kind of object interaction display method based on augmented reality AR | |
| USRE43545E1 (en) | Virtual skywriting | |
| CN106355153A (en) | Virtual object display method, device and system based on augmented reality | |
| CN106664376B (en) | Augmented reality device and method | |
| CN107481190B (en) | A kind of image processing method and device | |
| CN111638796A (en) | Virtual object display method and device, computer equipment and storage medium | |
| CN109815776B (en) | Action prompting method and device, storage medium and electronic device | |
| CN108304075B (en) | Method and device for performing man-machine interaction on augmented reality device | |
| KR20170122725A (en) | Modifying scenes of augmented reality using markers with parameters | |
| CN106683195B (en) | AR scene rendering method based on indoor positioning | |
| CN112037314A (en) | Image display method, image display device, display equipment and computer readable storage medium | |
| CN105323252A (en) | Method and system for realizing interaction based on augmented reality technology and terminal | |
| US10127667B2 (en) | Image-based object location system and process | |
| WO2016114930A2 (en) | Systems and methods for augmented reality art creation | |
| CN105023266A (en) | Method and device for implementing augmented reality (AR) and terminal device | |
| CN109934931A (en) | Acquisition image, the method and device for establishing target object identification model | |
| KR20140090022A (en) | Method and Apparatus for displaying the video on 3D map | |
| AU2018202767A1 (en) | Data structure and algorithm for tag less search and svg retrieval | |
| CN103428537A (en) | Video processing method and video processing device | |
| JP2015079354A (en) | Three-dimensional map display system using virtual reality | |
| CN108597034A (en) | Method and apparatus for generating information | |
| KR101586071B1 (en) | Apparatus for providing marker-less augmented reality service and photographing postion estimating method therefor | |
| JP2022507502A (en) | Augmented Reality (AR) Imprint Method and System | |
| KR101214612B1 (en) | Building navigation system based on augmented reality | |
| CN111651049B (en) | Interaction method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181116 |