CN108615260A - The method and device that shows of augmented reality digital culture content is carried out under a kind of exception actual environment - Google Patents
The method and device that shows of augmented reality digital culture content is carried out under a kind of exception actual environment Download PDFInfo
- Publication number
- CN108615260A CN108615260A CN201810251820.6A CN201810251820A CN108615260A CN 108615260 A CN108615260 A CN 108615260A CN 201810251820 A CN201810251820 A CN 201810251820A CN 108615260 A CN108615260 A CN 108615260A
- Authority
- CN
- China
- Prior art keywords
- culture
- image
- ich
- cultural
- label
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 19
- 230000004927 fusion Effects 0.000 claims abstract description 28
- 239000000654 additive Substances 0.000 claims abstract description 6
- 230000000996 additive effect Effects 0.000 claims abstract description 6
- 239000000463 material Substances 0.000 claims description 60
- 238000012545 processing Methods 0.000 claims description 57
- 238000005516 engineering process Methods 0.000 claims description 33
- 238000009877 rendering Methods 0.000 claims description 15
- 230000004044 response Effects 0.000 claims description 13
- 238000000605 extraction Methods 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 5
- 239000000284 extract Substances 0.000 claims description 3
- 230000002159 abnormal effect Effects 0.000 abstract description 12
- 238000004891 communication Methods 0.000 description 16
- 230000008569 process Effects 0.000 description 16
- 239000000047 product Substances 0.000 description 14
- 239000003550 marker Substances 0.000 description 8
- 230000008859 change Effects 0.000 description 6
- 239000003973 paint Substances 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 4
- 230000011664 signaling Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 230000035611 feeding Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000010422 painting Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000011897 real-time detection Methods 0.000 description 2
- 239000004575 stone Substances 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003796 beauty Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000000155 melt Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W84/00—Network topologies
- H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/61—Scene description
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Architecture (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses under a kind of abnormal actual environment mobile augmented reality MAR devices and carry out the method that AR digital culture contents show, under abnormal actual environment (such as it is dim, background is mixed and disorderly, backlight etc.), when the cultural label of identification first fails, the acquisition and identification of second culture label are carried out by the framework of AR and wireless sensing, to get digital culture content corresponding with the second culture label by second culture label, and it is shown on additive fusion to the image of acquisition, solve the problems, such as that ICH digital culture contents are displayed without or show and is inaccurate under prior art exception actual environment, improve AR discriminations and accuracy rate, the user experience is improved.
Description
Technical field
The invention belongs to augmented reality (Augmented Reality, AR) technical fields, and in particular, to a kind of exception
The method and device that augmented reality digital culture content is shown is carried out under actual environment.
Background technology
Augmented reality (Augmented Reality, AR) has been developed in recent years grinding for field of Computer Graphics
Study carefully hot spot, the virtual digit information superposition that it can generate computer is among actual environment, and by this virtual digit information
It combines together with actual environment, by showing that the scene of this virtual reality fusion is presented in equipment, to make actual environment be in
Reveal the effect of information enhancement.The presentation of this enhancement information makes experiencer that can not only perceive the information of real world, moreover it is possible to same
When perception real world other than virtual digit information, so as to effectively enhance perception of the experiencer to real world.With
The development of computer science and technology, the research of AR technologies also turns from the application study of the high-end fields such as the military affairs of early stage, aviation
Research for application and development to various fields such as education, amusement, culture, tourisms.
Non-material cultural heritage (Intangible Cultural Heritage, ICH) is different from matter input, it
It is a kind of particularly important cultural heritage form, it is to represent the multifarious cultural base of China's national characters traditional culture to be called
Cause.ICH does not see, can not touch, being difficult to experience, and increasingly deficienter, how to protect one that ICH is domestic and international expert's research
Emphasis.
Currently, the abundant ICH in China is combined with AR technologies, fully it can highlight and play mutual supplement with each other's advantages between the two and close
System can promote effective annotation, displaying and the propagation of ICH, the final rational exploitation and utilization for realizing ICH and protection.
In the prior art, there are many hypostazation applications, such as museum in the application for AR and cultural tour industry
AR guides to visitors, AR scenario reductions of historical places such as Yuanmingyuan Park etc., to the feeling that user find everything fresh and new, for example,
In the AR applications for the nonmaterial culture heritage conservation that CN104778654A is referred to, uses two dimension and paint the cultural label knowledge of this progress
Not, and by ICH culture presentation on 2d, such as the threedimensional model of Yellow Crane Tower is presented etc..But in abnormal real ring
Under border, such as backlight, dim, fogging image, shooting environmental are noisy, lack necessary cultural label letter in material and culture carrier
Under the environment such as breath, it may appear that cultural tag recognition does not go out or identify inaccurate problem, leads to not show ICH digital culture contents
Or display is inaccurate.
Invention content
The present invention provides carry out the method and a kind of movement that AR digital culture contents are shown under a kind of abnormal actual environment
Augmented reality (Mobile Augmented Reality, MAR) device, solves ICH numbers under prior art exception actual environment
Word cultural issues is displayed without or shows inaccurate problem.
To achieve the goals above, an embodiment of the present invention provides the mobile augmented realities under a kind of abnormal actual environment
MAR devices, the system comprises image capture module, sending module, receiving module, wireless sensing module, display module and places
Manage module, wherein
Described image acquisition module, the image for acquiring material and culture carrier；
The sending module, for the image of the acquisition to be sent to the processing module；
The processing module, it is corresponding for extracting the material and culture carrier in the image of the material and culture carrier
First cultural label；When the described first cultural tag extraction or parsing failure, the failure response message of generation is forwarded to institute
State receiving module；
The receiving module, for after receiving the failure response message, receiving what the wireless sensing module was sent
Second culture label information corresponding with the material and culture carrier；
The sending module is additionally operable to the second culture label information being sent to the processing module；
The processing module is additionally operable to obtain non-material cultural heritage ICH corresponding with the second culture label information
The ICH digital cultures content mergence is superimposed on the image of the material and culture carrier, and sends institute by digital culture content
The image after fusion superposition is stated to the display module；
The display module, for showing the image merged after being superimposed.
Optionally, the processing module is used to the ICH digital cultures content mergence being superimposed to the material and culture and carry
On the image of body, including：
The ICH digital cultures content and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digital cultures content is subjected to real-time rendering rendering, and according to the ICH after virtual combat processing
Mapping relations of the digital culture content in reality scene, by the ICH digital cultures content and the material and culture carrier figure
As being overlapped fusion,
Wherein, the ICH digital cultures content includes ICH digital three-dimensional models and ICH digital cartoons, ICH number shadows
Depending on the combination of the, one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.
Optionally, the wireless sensing module is additionally operable to：
Receive the cultural label that wireless network node is sent, the wireless network node fixed placement, the wireless sensing
Module is placed in the range of transmission of the wireless network node.
Optionally, the material and culture carrier includes cultural creative product, Museum Exhibit product or cultural landscape, then described
Second culture label includes the cultural label of cultural creative product, the cultural label of museum interior showpiece or cultural landscape culture
The combination of the one or more of which of label.
Optionally, the processor is additionally operable to：
When the material and culture carrier is museum exhibits, and the second culture label is museum interior showpiece label
When, identification database is built, according to the identification database, dynamic marks switching identification matching is carried out to described image；
Attitude orientation coordinate in described image is obtained, the showpiece matching detection is carried out；
The posture position information for determining described image acquisition module, by the corresponding ICH digital cultures content of the showpiece with
The showpiece image carries out virtual reality fusion.
Optionally, the wireless sensing module is Zigbee radio receiving transmitting modules.
The embodiment of the present invention also provides and carries out the side that augmented reality digital culture content is shown under a kind of abnormal actual environment
Method, including：
Image capture module acquires the image of material and culture carrier, is sent to the image of the acquisition by sending module
The processing module；
Processing module extracts corresponding first culture of the material and culture carrier in the image of the material and culture carrier
Label；When the described first cultural tag extraction or parsing failure, the failure response message of generation is forwarded to receiving module；
It is sending with the substance to receive wireless sensing module after receiving the failure response message for the receiving module
The corresponding second culture label information of culture carrier；
The second culture label information is sent to the processing module by the sending module；
The processing module obtains non-material cultural heritage ICH digital cultures corresponding with the second culture label information
The ICH digital cultures content mergence is superimposed on the image of the material and culture carrier by content, and it is folded to send the fusion
Image after adding is to display module；
The display module shows the image after the fusion superposition.
Optionally, the processing module melts ICH digital cultures content corresponding with the signal chinesization label information
Conjunction is superimposed in described image, including：
The ICH digital cultures content and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digital cultures content is subjected to real-time rendering rendering, and according to the ICH after virtual combat processing
Mapping relations of the digital culture content in reality scene, by the ICH digital cultures content and the material and culture carrier figure
As being overlapped fusion,
Wherein, the ICH digital cultures content includes ICH digital three-dimensional models and ICH digital cartoons, ICH number shadows
Depending on the combination of the, one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.
Optionally, the method further includes：
The processing module makes number corresponding with the second culture label using computer graphic image CG technologies
Threedimensional model.
Optionally, the material and culture carrier includes cultural creative product, Museum Exhibit product or cultural landscape, then described
Second culture label includes the cultural label, the cultural label of museum interior showpiece or the text of cultural landscape of cultural creative product
Change the combination of the one or more of which of label.
The method and device of the embodiment of the present invention has following advantages：
In the embodiment of the present invention, (such as dim, mixed and disorderly, backlight of background etc.), the first text of identification under abnormal actual environment
When changing label failure, the acquisition and identification of second culture label are carried out by the framework of AR and wireless sensing, to pass through second
Cultural label gets digital culture content corresponding with the second culture label, and is carried out on additive fusion to the image of acquisition
Display solves the problems, such as that ICH digital culture contents are displayed without or show and is inaccurate under prior art exception actual environment, improve
AR discriminations and accuracy rate, the user experience is improved.
Description of the drawings
Fig. 1 is MAR composite structural diagrams under abnormal actual environment in the embodiment of the present invention；
Fig. 2 is three-dimensional registration techniqueflow schematic diagram in the embodiment of the present invention；
Fig. 3 is to carry out the method flow schematic diagram that AR is shown in the embodiment of the present invention under abnormal reality scene.
Specific implementation mode
In order to keep the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, to this hair
It is bright to be further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and do not have to
It is of the invention in limiting.In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other
Between do not constitute conflict and can be combined with each other.
Embodiment one
To achieve the above objectives, as shown in Figure 1, the present invention provides a kind of mobile augmented reality MAR devices 11, the device
Including image capture module 12, sending module 13, receiving module 14, wireless sensing module 15, display module 16 and processing module
17, wherein
Described image acquisition module 12, the image for acquiring material and culture carrier；
Image capture module can be individual camera or the camera battle array that is made of the camera of multiple and different angles
Row, can also be the mobile terminal for including camera, mobile terminal can be common mobile terminal, such as PC, intelligence
It can mobile phone and tablet computer etc..
Material and culture carrier in embodiments of the present invention, can be divided into following three types：First, for traditional technology class, tradition
Artifacts, souvenir, the product with national characteristics of ICH resources such as art class, folk literature class etc.；Second is that the exhibition in the museums ICH
It lookes at product, including various historical relics, calligraphy and painting, paints sheet, classical architecture model etc.；Third, ICH ecomuseums, folk customs village, nationality amorous feedings
National characters/region feature product in the cultural tours scenic spot such as garden and the scenic spot, including ethnic garment, specialty, all kinds of gardens
Woods landscape (flowers, plants and trees, strange stone, park etc.) etc..
The sending module 13, for the image of the acquisition to be sent to the processing module；
Sending module 13 can be radio transmitter, such as WIFI, bluetooth, the communication module etc. suitable for 3G/LTE.It can
To be integrated in inside mobile terminal, image transmitting can also be carried out by communication protocol with mobile terminal independently of mobile terminal.
The processing module 17 is corresponded to for extracting the material and culture carrier in the image of the material and culture carrier
The first cultural label；When the described first cultural tag extraction or parsing failure, the failure response message of generation is forwarded to
The receiving module；
Processing module 17 can be the processing module of mobile terminal, can also be server, since processing module 17 will be into
The a large amount of data processing of row, therefore processing module of the embodiment of the present invention 17 is preferably Cloud Server.
It may include that the first cultural label, cultural label information are a kind of for indicating that ICH's is specific in material and culture carrier
Label, for ICH, label determines the type of ICH, content and shows form, meanwhile, cultural label can also be one
A trigger mechanism triggers corresponding AR elements (such as the digital culture content referred to below) after receiving the culture label and adds
It is downloaded on the image of acquisition.In addition, cultural label can also be a kind of marker, the black and white identification object of handmarking can be divided into
(Marker) and prosthetic label natural image pattern image identification object (Markerless), which is according to ICH
What cultural issues was related to carries the markers such as all kinds of patterns of elements of Traditional Culture symbol, figure, is that the three-dimensional tracking of follow-up progress is noted
The target object of volume.As described in CN104778654A, cultural label can be that two dimension paints this, can also be the wheel of three-dimension object
It is wide.When actual environment occurs abnormal, such as actual environment is dim, backlight, background are noisy etc., it is easily sent out in real identification process
The problem of raw culture tag recognition is inaccurate or can not identify assert the first cultural tag extraction or parsing failure, can not carry out
Next step is to obtain ICH digital culture contents.Entire AR identifications show procedure failure.
The receiving module 14, for after receiving the failure response message, receiving the hair of the wireless sensing module 15
The second culture label information corresponding with the material and culture carrier sent；
Receiving module 14 is corresponding transceiver module with sending module 13, is described again here.
After receiving module receives the failure response, the second culture label letter that wireless sensing module 15 is sent is received
Breath.Optionally, before wireless sensing module 15 sends second culture label, which also receives wireless network
The cultural label that node is sent, the wireless network node fixed placement, the wireless sensing module are placed in the wireless network
In the range of transmission of node.
It is passed it should be noted that the wireless sensing module 15 includes but not limited to that Zigbee, WIFI, bluetooth, NFC etc. are wireless
Feel module.In embodiments of the present invention, according to the difference of scene, the wireless sensing module used also differs, for example, close
In distance (within 10 meters) communication range, NFC and bluetooth can be used to complete sending and receiving for data, and in middle distance (10-
100 meters) communication range when, then use the communication modes such as Zigbee, WIFI.
Wherein, in embodiments of the present invention preferred Zigbee module as wireless sensing module 15, the Zigbee module 15
It can inherit inside mobile terminal, signalling can also be carried out by communication protocol with mobile terminal independently of mobile terminal
With interaction.Wherein, ZigBee is the low-power consumption LAN protocol based on IEEE802.15.4 standards.It is provided according to international standard,
ZigBee technology is the wireless communication technique of a kind of short distance, low-power consumption.Its main feature is that short distance, low complex degree, self-organizing, low
Power consumption, low data rate.It is mainly suitable for, for automatically controlling and remote control field, various equipment being embedded in.
Wireless network node can fixed placement in specific location, wireless network node is used for and wireless sensing module carries out
Communication, by taking Zigbee as an example, wireless network node gets the information of Zigbee in communication range, is transmitted and is assisted using Zigbee
View is shaken hands with Zigbee module, completion Signalling exchange, and by the cultural label information and active wireless network of storage inside
The information of material and culture carrier is sent to the Zigbee module at node location.
In embodiments of the present invention, second culture label information can be the cultural label information of cultural creative product, win
The combination of the one or more of which of the cultural label information or cultural landscape culture label information of showpiece inside object shop.Second text
Change the digital coding that label information can also be a string of specific formats, is stored in wireless network node, works as wireless sensing module
15 with wireless network node interact when, which is encapsulated in signal format by wireless network node, and passes through report
Literary form is sent in wireless sensing module 15, and wireless sensing module 15 is extracted therein by being decoded to the signal
Cultural label information, and the culture label information is forwarded to receiving module 14.Optionally, cultural label can also be QR codes
Deng there is no restriction to the specific form of expression of cultural label by the present invention.
In the embodiment of the present invention, for the reception mode of cultural label, there are priority, and first is preferentially obtained from image
Cultural label, if obtaining successfully, this need not obtain second culture label (cost declining), you can be obtained according to the first cultural label
ICH digital cultures content simultaneously realizes that additive fusion is handled.And when the first cultural tag recognition failure, just carry out second
The identification of cultural label increases the stability of discrimination and identification.
The sending module 14 is additionally operable to the second culture label information being sent to the processing module；
The processing module 17 is additionally operable to obtain ICH digital cultures content corresponding with the second culture label information,
The ICH digital cultures content mergence is superimposed on the image of the material and culture carrier, and after sending fusion superposition
Image to the display module；
Wherein, the ICH digital cultures content mergence is superimposed to the figure of the material and culture carrier by the processing module
As upper, specially：
The ICH digital cultures content and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digital cultures content is subjected to real-time rendering rendering, and according to the ICH after virtual combat processing
Mapping relations of the digital culture content in reality scene, by the ICH digital cultures content and the material and culture carrier figure
As being overlapped fusion,
Wherein, the ICH digital cultures content includes ICH digital three-dimensional models (such as threedimensional model of Yellow Crane Tower), with
And the one of which or more of ICH digital cartoons, ICH Active-Movie, ICH digital audios, ICH digital pictures and ICH digital texts
The combination of kind.
Three-dimensional Tracing Registration refer to device in the process of running, the image for needing to detect, identify in real time actual environment is special
Sign, position of the camera relative to true environment in three dimensions is determined according to the feature of the actual environment video image frame of acquisition
And direction, to which virtual objects to be properly placed on to the correct position in reality scene.Realize virtual objects and real field
The seamless fusion of scape, three-dimensional Tracing Registration technology are the most crucial key technologies of AR devices.
The realization of three-dimensional Tracing Registration technology (3D Registration) generally can be divided into three kinds of approach：Based on computer
The three-dimensional Tracing Registration technology of vision, the three-dimensional Tracing Registration technology based on hardware device and hybrid three-dimensional Tracing Registration technology.
Three-dimensional Tracing Registration technology based on computer vision：Mainly by identifying the feature of image in reality scene come really
Determine position and the posture of video camera, this register method can be divided into the method based on handmarking's object (Marker) and be based on nature
Two kinds of the method for characteristics of image.Device by identify in real time the parallel lines of marker in reality scene, vertical line, planar object,
The methods of angle point, textural characteristics obtain the inside and outside portion's parameter of video camera.The advantages of method based on Marker is reality scene spy
Sign is apparent, has higher robustness and arithmetic speed fast, but needs that black and white marker is artificially arranged in the scene in advance, can influence
The beauty of scene, the method based on natural image feature can overcome the disadvantages mentioned above of handmarking's object.
Three-dimensional Tracing Registration technology based on hardware device：Sender unit and sensing device are mainly utilized, is obtained
Related data calculates the required position of three-dimensional registration and posture information.There are commonly electromagnetic type tracks of device, optical profile types to track
The hardware devices such as device, ultrasonic type tracks of device, GPS positioning device, inertial navigation, electronic compass.Electromagnetic type tracks of device
It is to utilize coil signal transmitter, the coupling interactive relationship between signal and magnetic strength induction signal is emitted according to magnetic to determine real field
The relative position and posture information of target object in scape.Optical profile type tracks of device is by picture pick-up device or photosensitive component, root
According to the light that the light source information or reflection sphere of reception are sent out, pass through the three-dimensional space meta position of the image of acquisition, light source information and sensor
Confidence ceases to determine the six-degree-of-freedom information of target object.Ultrasonic type tracks of device is the ultrasonic wave sent out according to different sound sources
Time difference, phase difference and acoustic pressure caused by the specific target object of reality scene are reached to carry out three-dimensional registration.It is fixed by GPS
The hardware devices such as position, inertial navigation, electronic compass come determine reality scene target object relative position information be usually used in be based on position
Set the augmented reality information server of service.
Hybrid three-dimensional Tracing Registration technology：In certain specific applications, in summary a variety of three-dimensional Tracing Registration methods
To determine location information of the virtual objects relative to real scene, the three-dimensional Tracing Registration function of realization device.
In the embodiment of the present invention, being superimposed for ICH and reality scene is realized using three-dimensional Tracing Registration technology：Pass through video
Coordinate information in image carries out between world coordinate system, camera coordinate system, imaging plane coordinate system and pixel coordinate system
Conversion calculates, and realizes that ICH digital cultures content object is precisely superimposed with reality scene.To realize virtual objects and reality scene
It is perfectly combined and is registrated, MAR devices need to detect and calculate the position and direction of mobile terminal camera in real time, according to camera shooting
Machine external parameter calculates the mapping relations between ICH digital cultures content and reality scene in real time, to realize cultural number text
Change content object accurately " to place " on the correct position of the reality scene video image where target object；In addition, MAR is filled
It sets and also needs to by the ICH digital cultures such as digital three-dimensional model, digital cartoon, Active-Movie, sound, picture, digital text
Content object carries out real-time rendering rendering, and mapping of the virtual objects obtained in real time according to MAR devices in reality scene is closed
System, the virtual image that these computers generate is merged with reality scene video image, realizes the enhancing to reality scene information
Effect obtains the video image of enhancing ICH digital culture information on the basis of reality scene video image.
Specifically, in the embodiment of the present invention, device captures actual environment video figure by the camera on mobile terminal
As sequence frame, identifies the target object in actual environment, further determine that intelligent terminal video camera relative in actual environment
The position orientation relation of target object, device is according to the pose of camera data information of acquisition and the location data obtained from real scene
Information determines virtual objects (the digitized digital three-dimensional model of ICH i.e. corresponding with cultural label, digital cartoon, video, sound
Frequently, one or more digital culture contents such as figure, digital text) accurate location in actual environment, finally in real ring
Virtual objects are merged display on mobile terminals, shape by real-time rendering and the generation that virtual objects are completed in border with actual environment
At the new scene of virtual reality fusion, the process of three-dimensional Tracing Registration is completed, to reach the mesh enhanced actual environment cultural information
's.
In this operational process of MAR devices, on the one hand, the posture information of mobile terminal camera is in dynamic change
State, device must real-time and accurately obtain location information of the video camera relative to target object in true environment, could be complete
At subsequently accurately three-dimensional registered task, another aspect, device must be able to detect in real time, identify, track in actual environment
Cultural label information, could rapidly obtain the pose data information of video camera, to target object (culture under three-dimensional space environment
Label) it is real-time detection, identification, tracking and in real time completion actual situation scene match.Three-dimensional Tracing Registration based on computer vision
Technology is device in the sequence of video images frame of reality scene, using the picture frame comprising target object as positioning datum, is passed through
To obtain video camera and real ring in real time to the method for the characteristic point detection of target object picture frame, identification matching and real-time tracking
The position orientation relation in border, and the coordinate transformation relation of target object in virtual objects to actual environment is updated in real time, and then to void
The scene merged in fact is updated in real time, completes the task of three-dimensional registration.Three-dimensional Tracing Registration mistake based on computer vision
Journey includes mainly image characteristic point detection, identification matching, the real-time tracking of target object and virtual reality fusion four processes.
In MAR devices, three-dimensional Tracing Registration be to ensure that virtual objects be accurately superimposed, the key merged in actual environment
Property technology, during this, device is the reality scene video image that is captured by camera to obtain the data of real scene
Information, the data of three-dimensional Tracing Registration are directed to the image information of video camera capture, if the inner parameter of video camera is not
Accurately, it will seriously affect three-dimensional registration precision, even result in registration failure.Therefore, augmented reality device is imaged
Machine demarcates (Camera Calibration) to determine that video camera relevant parameter, camera parameters include that inner parameter is joined with external
Number, inner parameter refer to the geometry of video camera itself, the relevant parameter of optical characteristics, external parameter refer to video camera relative to
Three-dimensional space position in a certain world coordinate system and direction, the process that MAR devices carry out camera calibration are just to determine camera shooting
The process of the inside and outside portion's parameter of machine.Augmented reality device three-dimensional Tracing Registration process is as shown in Figure 2.In addition, in three-dimensional Tracing Registration
The essence of coordinate transform three-dimensional Tracing Registration process be related to world coordinate system, camera coordinate system, imaging plane coordinate system
Transformational relation between pixel coordinate system, by the determination of the transition matrix between this four coordinate systems, MAR devices can incite somebody to action
It includes mainly camera calibration, in real time that virtual objects, which are accurately superimposed upon among the scene of actual environment three-dimensional Tracing Registration process,
Track the main contents drawn with three-dimensional scenic and merge three aspects.The purpose of camera calibration is that aid-device determines camera shooting
Machine inner parameter and external parameter obtain real world coordinates system, camera coordinate system, imaging plane coordinate system and pixel coordinate
Transformational relation between system is accurately superimposed upon in reality scene for subsequent virtual objects and provides data information.Real-time tracking mistake
Journey include to reality scene target object it is real-time detection and tracking, by reality scene target object it is real-time detect,
Identification matching and tracking obtain position and direction of the video camera relative to real world coordinates system, to determine real world coordinates
Transition matrix between system and camera coordinate system.Three-dimensional scenic draw fusion mainly by device obtain world coordinate system,
Transformational relation between camera coordinate system, imaging plane coordinate system and pixel coordinate system, is drawn using computer graphic image
Generation technique among virtual objects are superimposed upon the targeted object region of reality scene, forms the new scene of virtual reality fusion.
It should be noted that the case where for museum exhibits, i.e., when the material and culture carrier is museum exhibits, and
When cultural label information is museum interior exhibit information, processing module 17 is additionally operable to：Identification database is built, according to the mark
Know database, dynamic marks switching identification matching is carried out to described image；And obtain posture in the mobile terminal acquisition image
The elements of a fix carry out the showpiece matching detection；Determine the posture position information of the mobile terminal, the showpiece is corresponding
ICH digital cultures content carries out virtual reality fusion with the showpiece image, can not only realize the reconstruct and reproduction of historical relic, can also be real
Existing ICH and historical place are perfectly combined.
The display module 18, for showing the image merged after being superimposed.
There are mainly two types of patterns for the development and application of mobile augmented reality MAR, and one is based on location-based service LBS
The MAR devices of (Location Based Service, LBS), mainly pass through the GPS positioning of mobile intelligent terminal, electronic compass
Position and the posture that intelligent terminal is determined with equipment such as gravitational accelerometers are superimposed ring around user in the intelligent terminal of user
The relevant information of border point of interest POI (Point of Interest, POI), such as to the hotel, navigation, main public around user
The markup information of the progress such as facility.Another kind is the mobile increasing of the computer vision Tracing Registration method based on natural image feature
Strong real device application mainly identifies the feature of user's surrounding objects object to determine intelligence by mobile intelligent terminal camera
Position and posture of the terminal relative to target object, superposition and the relevant information of target object in the intelligent terminal of user.
In both application models of current MAR, the former mainly marks the POI information around user within the scope of certain distance, generally
The information of superposition belongs to the information such as two-dimensional word, picture, unsuitable to pass through the more rich digitlizations such as tangibility, situation
Information superposition is annotated and is shown to the detailed of target object to realize.And the embodiment of the present invention creatively proposes one kind different
The scheme combined with AR technologies based on wireless sensor technology under real environment is often occurred, the case where the first cultural tag recognition fails
Under, wireless network node is received by wireless sensing module, the cultural label within the scope of current region is sent to receiving module,
And it is forwarded to processing module, processing module is according to the image and second culture label information identified, by the second culture mark
The corresponding ICH digital cultures content of label information is superimposed upon the image specific location, realizes the superposition of AR actual situations.Using of the invention real
Apply example offer scheme, can not only more improve the discrimination of AR, can also be achieved commercial application, to realize it is commercial at
Work(.
Embodiment two
As shown in figure 3, the embodiment of the invention discloses carry out AR under a kind of abnormal actual environment to show digital culture content
Method, including：
The image of S201, image capture module acquisition material and culture carrier, by sending module by the image of the acquisition
It is sent to the processing module；
Image capture module can be individual camera or the camera battle array that is made of the camera of multiple and different angles
Row, can also be the mobile terminal for including camera, mobile terminal can be common mobile terminal, such as PC, intelligence
It can mobile phone and tablet computer etc..
Material and culture carrier in embodiments of the present invention, can be divided into following three types：First, for traditional technology class, tradition
Artifacts, souvenir, the product with national characteristics of ICH resources such as art class, folk literature class etc.；Second is that the exhibition in the museums ICH
It lookes at product, including various historical relics, calligraphy and painting, paints sheet, classical architecture model etc.；Third, ICH ecomuseums, folk customs village, nationality amorous feedings
National characters/region feature product in the cultural tours scenic spot such as garden and the scenic spot, including ethnic garment, specialty, all kinds of gardens
Woods landscape (flowers, plants and trees, strange stone, park etc.) etc..
S202, processing module extract the material and culture carrier corresponding first in the image of the material and culture carrier
Cultural label；When the described first cultural tag extraction or parsing failure, the failure response message of generation is forwarded to reception mould
Block；
Processing module 17 can be the processing module of mobile terminal, can also be server, since processing module 17 will be into
The a large amount of data processing of row, therefore processing module of the embodiment of the present invention 17 is preferably Cloud Server.
It may include that the first cultural label, cultural label information are a kind of for indicating that ICH's is specific in material and culture carrier
Label, for ICH, label determines the type of ICH, content and shows form, meanwhile, cultural label can also be one
A trigger mechanism triggers corresponding AR elements (such as the digital culture content referred to below) after receiving the culture label and adds
It is downloaded on the image of acquisition.In addition, cultural label can also be a kind of marker, the black and white identification object of handmarking can be divided into
(Marker) and prosthetic label natural image pattern image identification object (Markerless), which is according to ICH
What cultural issues was related to carries the markers such as all kinds of patterns of elements of Traditional Culture symbol, figure, is that the three-dimensional tracking of follow-up progress is noted
The target object of volume.As described in CN104778654A, cultural label can be that two dimension paints this, can also be the wheel of three-dimension object
It is wide.When actual environment occurs abnormal, such as actual environment is dim, backlight, background are noisy etc., it is easily sent out in real identification process
The problem of raw culture tag recognition is inaccurate or can not identify assert the first cultural tag extraction or parsing failure, can not carry out
Next step is to obtain ICH digital culture contents.Entire AR identifications show procedure failure.
S203, the receiving module after receiving the failure response message, receive that wireless sensing module sends with institute
State the corresponding second culture label information of material and culture carrier；
It should be noted that the wireless sensing module includes but not limited to the wireless sensings such as Zigbee, WIFI, bluetooth, NFC
Module.In embodiments of the present invention, according to the difference of scene, the wireless sensing module used also differs, for example, in low coverage
From in (within 10 meters) communication range, NFC and bluetooth can be used to complete sending and receiving for data, and in middle distance (10-
100 meters) communication range when, then use the communication modes such as Zigbee, WIFI.
Wherein, for preferred Zigbee module as wireless sensing module, which can be after in embodiments of the present invention
It holds inside mobile terminal, can also carry out signalling by communication protocol with mobile terminal independently of mobile terminal and hand over
Mutually.Wherein, ZigBee is the low-power consumption LAN protocol based on IEEE802.15.4 standards.It is provided according to international standard,
ZigBee technology is the wireless communication technique of a kind of short distance, low-power consumption.Its main feature is that short distance, low complex degree, self-organizing, low
Power consumption, low data rate.It is mainly suitable for, for automatically controlling and remote control field, various equipment being embedded in.
Wireless network node can fixed placement in specific location, wireless network node is used for and wireless sensing module carries out
Communication, by taking Zigbee as an example, wireless network node gets the information of Zigbee in communication range, is transmitted and is assisted using Zigbee
View is shaken hands with Zigbee module, completion Signalling exchange, and by the cultural label information and active wireless network of storage inside
The information of material and culture carrier is sent to the Zigbee module at node location.Wireless network node can be regarded as Zigbee " bases
It stands ".
In embodiments of the present invention, second culture label information can be the cultural label information of cultural creative product, win
The combination of the one or more of which of the cultural label information or cultural landscape culture label information of showpiece inside object shop.Second text
Change the digital coding that label information can also be a string of specific formats, is stored in wireless network node, works as wireless sensing module
15 with wireless network node interact when, which is encapsulated in signal format by wireless network node, and passes through report
Literary form is sent in wireless sensing module 15, and wireless sensing module 15 is extracted therein by being decoded to the signal
Cultural label information, and the culture label information is forwarded to receiving module 14.Optionally, cultural label can also be QR codes
Deng there is no restriction to the specific form of expression of cultural label by the present invention.
In the embodiment of the present invention, for the reception mode of cultural label, there are priority, and first is preferentially obtained from image
Cultural label, if obtaining successfully, this need not obtain second culture label (cost declining), you can be obtained according to the first cultural label
ICH digital cultures content simultaneously realizes that additive fusion is handled.And when the first cultural tag recognition failure, just carry out second
The identification of cultural label increases the stability of discrimination and identification.
The second culture label information is sent to the processing module by S204, the sending module；
S205, the processing module obtain non-material cultural heritage ICH numbers corresponding with the second culture label information
The ICH digital cultures content mergence is superimposed on the image of the material and culture carrier by word cultural issues, and described in transmission
The image after superposition is merged to display module；
The ICH digital cultures content and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digital cultures content is subjected to real-time rendering rendering, and according to the ICH after virtual combat processing
Mapping relations of the digital culture content in reality scene, by the ICH digital cultures content and the material and culture carrier figure
As being overlapped fusion,
Wherein, the ICH digital cultures content includes ICH digital three-dimensional models and ICH digital cartoons, ICH number shadows
Depending on the combination of the, one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.Wherein, the processing mould
Block makes digital three-dimensional model corresponding with the second culture label using computer graphic image CG technologies.
It should be noted that the case where for museum exhibits, i.e., when the material and culture carrier is museum exhibits, and
When cultural label information is museum interior exhibit information, this method further includes：Identification database is built, according to the mark number
According to library, dynamic marks switching identification matching is carried out to described image；And obtain attitude orientation in the mobile terminal acquisition image
Coordinate carries out the showpiece matching detection；The posture position information for determining the mobile terminal, by the corresponding ICH of the showpiece
Digital culture content carries out virtual reality fusion with the showpiece image, can not only realize the reconstruct and reproduction of historical relic, can also realize
ICH and historical place are perfectly combined.
S206, the display module show the image after the fusion superposition.
The embodiment of the present invention creatively proposes a kind of based on wireless sensing skill in the first cultural tag recognition failure
The scheme that art is combined with AR technologies receives wireless network node by wireless sensing module and marks the culture within the scope of current region
It signs and issues and gives wireless sensing module, and be forwarded to processing module, when user uses the figure of mobile terminal acquisition material and culture carrier
When picture, processing module is according to the image identified and cultural label information, by the corresponding ICH numbers text of the culture label information
Change content and be superimposed upon the image specific location, realizes the superposition of AR actual situations.Using scheme provided in an embodiment of the present invention, improve
Discrimination and the stability of AR are, it can be achieved that commercial application, to realize commercial success.
It should be understood that in the various embodiments of the application, the size of the serial number of each process is not meant to execution sequence
Successively, the execution sequence of each process should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present application
Constitute any restriction.
Those of ordinary skill in the art may realize that moulds described in conjunction with the examples disclosed in the embodiments of the present disclosure
Block and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, depends on the specific application and design constraint of technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description,
The specific work process of device and module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
The various pieces of this specification are all made of progressive mode and are described, identical similar portion between each embodiment
Point just to refer each other, and what each embodiment introduced is and other embodiment difference.Especially for device and dress
For setting embodiment, since it is substantially similar to the method embodiment, so description is fairly simple, related place is referring to method reality
Apply the explanation of example part.
Finally, it should be noted that：The foregoing is merely the preferred embodiments of technical scheme, are not intended to
Limit the protection domain of the application.Obviously, those skilled in the art can carry out the application various modification and variations without de-
From scope of the present application.If these modifications and variations of the application belong to the range of the application claim and its equivalent technologies
Within, then any modification, equivalent replacement, improvement and so on, should be included within the protection domain of the application.
Claims (10)
1. the mobile augmented reality MAR devices under a kind of exception actual environment, which is characterized in that the system comprises Image Acquisition
Module, sending module, receiving module, wireless sensing module, display module and processing module, wherein
Described image acquisition module, the image for acquiring material and culture carrier；
The sending module, for the image of the acquisition to be sent to the processing module；
The processing module, for extracting the material and culture carrier corresponding first in the image of the material and culture carrier
Cultural label；When the described first cultural tag extraction or parsing failure, the failure response message of generation is forwarded to described connect
Receive module；
The receiving module, for after receiving the failure response message, receiving that the wireless sensing module sends and institute
State the corresponding second culture label information of material and culture carrier；
The sending module is additionally operable to the second culture label information being sent to the processing module；
The processing module is additionally operable to obtain non-material cultural heritage ICH numbers corresponding with the second culture label information
The ICH digital cultures content mergence is superimposed on the image of the material and culture carrier by cultural issues, and is melted described in transmission
The image after superposition is closed to the display module；
The display module, for showing the image merged after being superimposed.
2. the apparatus according to claim 1, which is characterized in that the processing module is used for will be in the ICH digital cultures
Hold fusion to be superimposed on the image of the material and culture carrier, including：
Virtual combat processing is carried out to the ICH digital cultures content and the acquisition image using three-dimensional Tracing Registration technology；
The ICH digital cultures content is subjected to real-time rendering rendering, and according to the ICH numbers after virtual combat processing
Mapping relations of the cultural issues in reality scene, by the ICH digital cultures content and the material and culture carrier image into
Row additive fusion,
Wherein, the ICH digital cultures content include ICH digital three-dimensional models and ICH digital cartoons, ICH Active-Movie,
The combination of the one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.
3. the apparatus according to claim 1, which is characterized in that the wireless sensing module is additionally operable to：
Receive the cultural label that wireless network node is sent, the wireless network node fixed placement, and the wireless sensing mould
Block is placed in the range of transmission of the wireless network node.
4. according to claim 1-3 any one of them devices, which is characterized in that the material and culture carrier includes cultural creative
Product, Museum Exhibit product or cultural landscape, then the second culture label includes cultural label, the natural science of cultural creative product
The combination of the one or more of which of the cultural label or cultural landscape culture label of showpiece inside shop.
5. device according to claim 4, which is characterized in that the processor is additionally operable to：
When the material and culture carrier is museum exhibits, and the second culture label is museum interior showpiece label,
Identification database is built, according to the identification database, dynamic marks switching identification matching is carried out to described image；
Attitude orientation coordinate in described image is obtained, the showpiece matching detection is carried out；
The posture position information for determining described image acquisition module, by the corresponding ICH digital cultures content of the showpiece with it is described
Showpiece image carries out virtual reality fusion.
6. the apparatus according to claim 1, which is characterized in that the wireless sensing module is Zigbee wireless receiving and dispatching moulds
Block.
7. carrying out the method that augmented reality digital culture content is shown under a kind of exception actual environment, which is characterized in that including：
Image capture module acquires the image of material and culture carrier, is sent to the image of the acquisition by sending module described
Processing module；
Processing module extracts the corresponding first cultural label of the material and culture carrier in the image of the material and culture carrier；
When the described first cultural tag extraction or parsing failure, the failure response message of generation is forwarded to receiving module；
It is sending with the material and culture to receive wireless sensing module after receiving the failure response message for the receiving module
The corresponding second culture label information of carrier；
The second culture label information is sent to the processing module by the sending module；
The processing module obtains in non-material cultural heritage ICH digital cultures corresponding with the second culture label information
Hold, the ICH digital cultures content mergence is superimposed on the image of the material and culture carrier, and sends the fusion superposition
Image afterwards is to display module；
The display module shows the image after the fusion superposition.
8. the method according to the description of claim 7 is characterized in that the processing module will be believed with the signal chinesization label
Corresponding ICH digital cultures content mergence is ceased to be superimposed in described image, including：
Virtual combat processing is carried out to the ICH digital cultures content and the acquisition image using three-dimensional Tracing Registration technology；
The ICH digital cultures content is subjected to real-time rendering rendering, and according to the ICH numbers after virtual combat processing
Mapping relations of the cultural issues in reality scene, by the ICH digital cultures content and the material and culture carrier image into
Row additive fusion,
Wherein, the ICH digital cultures content include ICH digital three-dimensional models and ICH digital cartoons, ICH Active-Movie,
The combination of the one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.
9. according to the method described in claim 8, it is characterized in that, the method further includes：
The processing module makes digital three-dimensional corresponding with the second culture label using computer graphic image CG technologies
Model.
10. according to claim 7-9 any one of them methods, which is characterized in that the material and culture carrier includes that culture is created
It anticipates product, Museum Exhibit product or cultural landscape, then the second culture label includes the cultural label, rich of cultural creative product
The combination of the one or more of which of the cultural label or cultural landscape culture label of showpiece inside object shop.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810251820.6A CN108615260A (en) | 2018-03-26 | 2018-03-26 | The method and device that shows of augmented reality digital culture content is carried out under a kind of exception actual environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810251820.6A CN108615260A (en) | 2018-03-26 | 2018-03-26 | The method and device that shows of augmented reality digital culture content is carried out under a kind of exception actual environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108615260A true CN108615260A (en) | 2018-10-02 |
Family
ID=63658702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810251820.6A Pending CN108615260A (en) | 2018-03-26 | 2018-03-26 | The method and device that shows of augmented reality digital culture content is carried out under a kind of exception actual environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108615260A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109974733A (en) * | 2019-04-02 | 2019-07-05 | 百度在线网络技术（北京）有限公司 | POI display methods, device, terminal and medium for AR navigation |
| CN111651049A (en) * | 2020-06-08 | 2020-09-11 | 浙江商汤科技开发有限公司 | Interaction method and device, computer equipment and storage medium |
| CN114489344A (en) * | 2022-02-16 | 2022-05-13 | 海南热带海洋学院 | Augmented reality digital culture content display device and method based on Internet of things |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060289645A1 (en) * | 2005-06-22 | 2006-12-28 | Symbol Technologies, Inc. | System and method for machine readable symbol backup for radio frequency identification tags |
| CN101023437A (en) * | 2004-07-27 | 2007-08-22 | 卡勒兹普麦迪亚公司 | Hybrid tag interface system and method using the hybrid tag interface |
| US20100026470A1 (en) * | 2008-08-04 | 2010-02-04 | Microsoft Corporation | Fusing rfid and vision for surface object tracking |
| CN104467893A (en) * | 2014-12-29 | 2015-03-25 | 重庆甲虫网络科技有限公司 | Reality augmenting wireless communication module |
| CN104571522A (en) * | 2015-01-22 | 2015-04-29 | 重庆甲虫网络科技有限公司 | Augmented reality mobile APP application system |
| CN104778654A (en) * | 2015-03-10 | 2015-07-15 | 湖北大学 | Intangible cultural heritage digital display system and method thereof |
-
2018
- 2018-03-26 CN CN201810251820.6A patent/CN108615260A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101023437A (en) * | 2004-07-27 | 2007-08-22 | 卡勒兹普麦迪亚公司 | Hybrid tag interface system and method using the hybrid tag interface |
| US20060289645A1 (en) * | 2005-06-22 | 2006-12-28 | Symbol Technologies, Inc. | System and method for machine readable symbol backup for radio frequency identification tags |
| US20100026470A1 (en) * | 2008-08-04 | 2010-02-04 | Microsoft Corporation | Fusing rfid and vision for surface object tracking |
| CN104467893A (en) * | 2014-12-29 | 2015-03-25 | 重庆甲虫网络科技有限公司 | Reality augmenting wireless communication module |
| CN104571522A (en) * | 2015-01-22 | 2015-04-29 | 重庆甲虫网络科技有限公司 | Augmented reality mobile APP application system |
| CN104778654A (en) * | 2015-03-10 | 2015-07-15 | 湖北大学 | Intangible cultural heritage digital display system and method thereof |
Non-Patent Citations (4)
| Title |
|---|
| 余日季: "基于AR技术的非物质文化遗产数字化开发研究", 《中国优秀博硕士学位论文全文数据库(博士)信息科技辑》 * |
| 余日季等: "基于移动终端和AR技术的博物馆文化教育体验系统的设计与应用研究", 《中国电化教育》 * |
| 深圳市计算机行业协会: "《2005年全国单片机与嵌入式系统学术交流会论文集》", 31 August 2005 * |
| 马飒飒第: "《物联网基础技术及应用》", 31 January 2018 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109974733A (en) * | 2019-04-02 | 2019-07-05 | 百度在线网络技术（北京）有限公司 | POI display methods, device, terminal and medium for AR navigation |
| CN111651049A (en) * | 2020-06-08 | 2020-09-11 | 浙江商汤科技开发有限公司 | Interaction method and device, computer equipment and storage medium |
| CN111651049B (en) * | 2020-06-08 | 2024-01-09 | 浙江商汤科技开发有限公司 | Interaction method, device, computer equipment and storage medium |
| CN114489344A (en) * | 2022-02-16 | 2022-05-13 | 海南热带海洋学院 | Augmented reality digital culture content display device and method based on Internet of things |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108540542B (en) | Mobile augmented reality system and display method | |
| CN108564662A (en) | The method and device that augmented reality digital culture content is shown is carried out under a kind of remote scene | |
| US11887312B2 (en) | Fiducial marker patterns, their automatic detection in images, and applications thereof | |
| CN102741797B (en) | Method and apparatus for transforming three-dimensional map objects to present navigation information | |
| CA2949543C (en) | Platform for constructing and consuming realm and object feature clouds | |
| CN106462322A (en) | Device-provided tracking data for augmented reality | |
| CN110908504B (en) | Augmented reality museum collaborative interaction method and system | |
| CN103561065A (en) | System and method for achieving 3D virtual advertisement with mobile terminal | |
| US20140274143A1 (en) | Personal information communicator | |
| CN108615260A (en) | The method and device that shows of augmented reality digital culture content is carried out under a kind of exception actual environment | |
| US20230162394A1 (en) | Aligning and Augmenting a Partial Subspace of a Physical Infrastructure with at Least One Information Element | |
| CN108257177A (en) | Alignment system and method based on space identification | |
| CN110568934A (en) | Low-error high-efficiency multi-label-graph augmented reality system | |
| TW201126451A (en) | Augmented-reality system having initial orientation in space and time and method | |
| Tian et al. | Augmented reality technology overview for tourism app development | |
| CN206574041U (en) | A kind of AR map systems | |
| Trivedi et al. | A Systematic Review of Tools Available in the Field of Augmented Reality | |
| CN104144287A (en) | Reality augmentation camera | |
| Zhang et al. | Mixed reality annotations system for museum space based on the UWB positioning and mobile device | |
| CN112419508B (en) | Method for realizing mixed reality based on large-scale space accurate positioning | |
| CN107687853A (en) | New localization method based on augmented reality | |
| Stillini et al. | Indoor navigation techniques: a comparative analysis between radio frequency and computer vision-based technologies | |
| CN113450439A (en) | Virtual-real fusion method, device and system | |
| CN110389691A (en) | Using the augmented reality equipment of three-dimensional scenic computer graphics principle | |
| CN115631310A (en) | Positioning system, method and device of three-dimensional space map and computing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181002 |
|
| RJ01 | Rejection of invention patent application after publication |