CN108564662A - The method and device that augmented reality digital culture content is shown is carried out under a kind of remote scene - Google Patents
The method and device that augmented reality digital culture content is shown is carried out under a kind of remote scene Download PDFInfo
- Publication number
- CN108564662A CN108564662A CN201810251806.6A CN201810251806A CN108564662A CN 108564662 A CN108564662 A CN 108564662A CN 201810251806 A CN201810251806 A CN 201810251806A CN 108564662 A CN108564662 A CN 108564662A
- Authority
- CN
- China
- Prior art keywords
- ich
- image
- cultural
- culture
- culture carrier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses the method and mobile augmented reality MAR devices that augmented reality AR digital culture contents are shown are carried out under a kind of remote scene, under remote scene, when the material and culture carrier identified occupy in the picture it is too small, cultural label is then received by wireless sensing module, non-material cultural heritage ICH digitized contents corresponding with the culture label are obtained by cultural label again, and it is shown on additive fusion to the image of acquisition, solve the problems, such as that AR digital culture contents are displayed without under the remote scene of the prior art, improve AR discriminations and accuracy rate, the user experience is improved.
Description
Technical field
The invention belongs to augmented reality (Augmented Reality, AR) technical fields, and in particular, to a kind of long distance
It leaves the theatre and carries out the method and device that augmented reality digital culture content is shown under scape.
Background technology
Augmented reality (Augmented Reality, AR) has been developed in recent years grinding for field of Computer Graphics
Study carefully hot spot, the virtual digit information superposition that it can generate computer is among actual environment, and by this virtual digit information
It combines together with actual environment, by showing that the scene of this virtual reality fusion is presented in equipment, to make actual environment be in
Reveal the effect of information enhancement.The presentation of this enhancement information makes experiencer that can not only perceive the information of real world, moreover it is possible to same
When perception real world other than virtual digit information, so as to effectively enhance perception of the experiencer to real world.With
The development of computer science and technology, the research of AR technologies also turns from the application study of the high-end fields such as the military affairs of early stage, aviation
Research for application and development to various fields such as education, amusement, culture, tourisms.
Non-material cultural heritage (Intangible Cultural Heritage, ICH) is different from matter input, it
It is a kind of particularly important cultural heritage form, it is to represent the multifarious cultural base of China's national characters traditional culture to be called
Cause.ICH does not see, can not touch, being difficult to experience, and increasingly deficienter, how to protect one that ICH is domestic and international expert's research
Emphasis.
Currently, the abundant ICH in China is combined with AR technologies, fully it can highlight and play mutual supplement with each other's advantages between the two and close
System can promote effective annotation, displaying and the propagation of ICH, the final rational exploitation and utilization for realizing ICH and protection.
In the prior art, there are many hypostazation applications, such as museum in the application for AR and cultural tour industry
AR guides to visitors, AR scenario reductions of historical places such as Yuanmingyuan Park etc., to the feeling that user find everything fresh and new, for example,
In the AR applications for the nonmaterial culture heritage conservation that CN104778654A is referred to, uses two dimension and paint the cultural label knowledge of this progress
Not, and by ICH culture presentation on 2d, such as the threedimensional model of Yellow Crane Tower is presented etc..But in remote scene
Under, the material and culture carrier of shooting is often small and fuzzy, it is not easy to identify, therefore can not carry out AR number texts under remote scene
The display for changing content, causes AR discriminations low, user experience is low.
Invention content
The present invention provides the method and a kind of shifting that AR digital culture contents are shown are carried out under a kind of remote scene environment
Dynamic augmented reality (Mobile Augmented Reality, MAR) device solves AR numbers under the remote scene of the prior art
The problem of cultural issues is displayed without.
To achieve the goals above, an embodiment of the present invention provides augmented reality AR numbers are carried out under a kind of remote scene
The method that cultural issues is shown, the method includes：
Mobile terminal acquires the image of material and culture carrier, and described image is sent to Cloud Server；
Described image is identified in the Cloud Server, obtains the material and culture carrier profiles in described image；
When the material and culture carrier profiles occupied area is less than predetermined threshold value, acquisition for mobile terminal wireless sensor hair
The cultural label sent, and the cultural label information is sent to the cloud processor；
The Cloud Server obtains in non-material cultural heritage ICH digital cultures corresponding with the culture label information
Hold, ICH digitized contents fusion is superimposed on the image of the material and culture carrier, and sends after the fusion is superimposed
Image to mobile terminal；
The mobile terminal shows the image after the fusion superposition.
Optionally, described image is identified in the Cloud Server, obtains the material and culture carrier wheel in described image
Exterior feature, including：
The material and culture carrier image is subjected to binary conversion treatment, geometrical morphological analysis and clustering processing, identification
Go out the material and culture carrier profiles, and calculates the occupied area ratio of the material and culture carrier profiles and whole image.
Optionally, the Cloud Server will ICH digitized contents fusion corresponding with the signal chinesization label information
It is superimposed in described image, including：
The ICH digitized contents and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digitized contents are subjected to real-time rendering rendering, and according to the ICH numbers after virtual combat processing
Mapping relations of the word content in reality scene carry out the ICH digitized contents and the material and culture carrier image
Additive fusion,
Wherein, the ICH digitized contents include ICH digital three-dimensional models and ICH digital cartoons, ICH number shadows
Depending on the combination of the, one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.
Optionally, the material and culture carrier includes cultural creative product, Museum Exhibit product or cultural landscape, then described
Cultural label information includes the cultural label information of cultural creative product, the cultural label information of museum interior showpiece or culture
The combination of the one or more of which of Landscape Culture label information.
Optionally, the method further includes：
When the material and culture carrier is museum exhibits, and cultural label information is museum interior exhibit information,
Identification database is built, according to the identification database, dynamic marks switching identification matching is carried out to described image；
Attitude orientation coordinate in the mobile terminal acquisition image is obtained, the showpiece matching detection is carried out；
The posture position information for determining the mobile terminal, by the corresponding ICH digitized contents of the showpiece and the exhibition
Product image carries out virtual reality fusion.
The embodiment of the present invention also provides and carries out the shifting that augmented reality AR digital culture contents are shown under a kind of remote scene
Dynamic augmented reality MAR devices, the MAR devices include：
Described image is sent to processing module by image capture module, the image for acquiring material and culture carrier；
The processing module obtains the material and culture carrier profiles in described image for described image to be identified；
Acquisition module, for when the material and culture carrier profiles occupied area is less than predetermined threshold value, obtaining wireless pass
The cultural label that sensor is sent, and the cultural label information is sent to the processing module；
The processing module is additionally operable to obtain non-material cultural heritage ICH numbers corresponding with the culture label information
ICH digitized contents fusion is superimposed on the image of the material and culture carrier, and sends the fusion by cultural issues
Image after superposition is to display module；
The display module, for showing the image merged after being superimposed.
Optionally, described image is identified in the processing module, obtains the material and culture carrier wheel in described image
Exterior feature, including：
The material and culture carrier image is subjected to binary conversion treatment, geometrical morphological analysis and clustering processing, identification
Go out the material and culture carrier profiles, and calculates the occupied area ratio of the material and culture carrier profiles and whole image.
Optionally, the processing module will ICH digitized contents fusion corresponding with the signal chinesization label information
It is superimposed in described image, including：
The ICH digitized contents and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digitized contents are subjected to real-time rendering rendering, and according to the ICH numbers after virtual combat processing
Mapping relations of the word content in reality scene carry out the ICH digitized contents and the material and culture carrier image
Additive fusion,
Wherein, the ICH digitized contents include ICH digital three-dimensional models and ICH digital cartoons, ICH number shadows
Depending on the combination of the, one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.
Optionally, the material and culture carrier includes cultural creative product, Museum Exhibit product or cultural landscape, then described
Cultural label information includes the cultural label information of cultural creative product, the cultural label information of museum interior showpiece or culture
The combination of the one or more of which of Landscape Culture label information.
Optionally, the processing module is additionally operable to：
When the material and culture carrier is museum exhibits, and cultural label information is museum interior exhibit information,
Identification database is built, according to the identification database, dynamic marks switching identification matching is carried out to described image；
Attitude orientation coordinate in the mobile terminal acquisition image is obtained, the showpiece matching detection is carried out；
The posture position information for determining the mobile terminal, by the corresponding ICH digitized contents of the showpiece and the exhibition
Product image carries out virtual reality fusion.
The method and device of the embodiment of the present invention has following advantages：
In the embodiment of the present invention, under remote scene, when the material and culture carrier identified is occupied in the picture
It is too small, then cultural label is received by wireless sensing module, then number corresponding with the culture label is obtained by cultural label
Word content, and shown solve AR numbers text under the remote scene of the prior art on additive fusion to the image of acquisition
Change the problem of content is displayed without, improves AR discriminations and accuracy rate, the user experience is improved.
Description of the drawings
Fig. 1 is the method flow signal for carrying out AR digital culture contents under medium and long distance scene of the embodiment of the present invention and showing
Figure；
Fig. 2 is the MAR composite structural diagrams for carrying out AR digital culture contents under medium and long distance scene of the embodiment of the present invention and showing；
Fig. 3 is three-dimensional registration techniqueflow schematic diagram in the embodiment of the present invention.
Specific implementation mode
In order to keep the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, to this hair
It is bright to be further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and do not have to
It is of the invention in limiting.In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other
Between do not constitute conflict and can be combined with each other.
Embodiment one
To achieve the above objectives, as shown in Figure 1, the invention discloses carry out AR displaying digitized under a kind of remote scene
The method of content, including：
The image of S101, mobile terminal acquisition material and culture carrier, Cloud Server is sent to by described image；
Mobile terminal can be common mobile terminal, such as PC, smart mobile phone and tablet computer.
Material and culture carrier in embodiments of the present invention, can be divided into following three types：First, for traditional technology class, tradition
Artifacts, souvenir, the product with national characteristics of ICH resources such as art class, folk literature class etc.；Second is that the exhibition in the museums ICH
It lookes at product, including various historical relics, calligraphy and painting, paints sheet, classical architecture model etc.；Third, ICH ecomuseums, folk customs village, nationality amorous feedings
National characters/region feature product in the cultural tours scenic spot such as garden and the scenic spot, including ethnic garment, specialty, all kinds of gardens
Woods landscape (flowers, plants and trees, strange stone, park etc.) etc..
Described image is identified in S102, the Cloud Server, obtains the material and culture carrier profiles in described image；
Wherein, described image is identified in the Cloud Server, obtains the material and culture carrier profiles in described image,
It is specifically as follows：
The material and culture carrier image is subjected to binary conversion treatment, geometrical morphological analysis and clustering processing, identification
Go out the material and culture carrier profiles, and calculates the occupied area ratio of the material and culture carrier profiles and whole image.
More specifically, the material and culture carrier image carries out at binary conversion treatment, geometrical morphological analysis and clustering
Reason, identifies the material and culture carrier profiles, includes the following steps：
First, the image of acquisition is converted into black and white binary image using adaptive thresholding algorithm.Adaptive thresholding algorithm
Basis for estimation be：
Wherein
Wherein, v is the gray value of pixel, and N (v) is the pixel set near v, and C is pre-set threshold value, and v ' is represented
Pixel inside field N (v).
Secondly, two-value contours extract is carried out to the result, i.e., the connected region in bianry image is scanned, obtains area
The data such as the lines of outline in domain, the area in region, perimeter.
Again, profile screening is carried out, i.e., fast geometric morphological analysis is carried out to the profile of previous step extraction, only retains likeness in form
The profile of material and culture carrier, to reduce the processing time of subsequent step.Specifically, using the method pair of local average first
Contour line progress is primary smooth, then neighbour's calculus of finite differences is used to calculate the tangent vector each put on contour line, finally uses and is classified
Clustering method analyzes all tangent vector coordinates.
Further, polygon fractionation is carried out to previous step handling result, the cluster analysis result based on previous step will be multiple
It significantly clusters corresponding profile point coordinates to extract in multiple set, corresponds to the fitting data of polygon multiple summits.
Further, least square fitting is carried out to the fitting data of previous step.The data for the multiple summits that previous step generates
Fitting a straight line can be carried out respectively to obtain the equation of multiple summits, intended to carry out straight line using least-squares algorithm in the present invention
It closes, optimization aim is：
It completes to can determine the specific location of material and culture carrier in the picture after the fitting of four edges.
Finally, according to the specific location, the size of material and culture carrier in the picture is calculated, and calculate this
The ratio magnitude of material and culture carrier area and whole image region area.If the area is excessively small, (such as the area is less than a certain
Threshold value, or it is less than a certain threshold value with whole image area ratio), it is determined that the image of shooting belongs to remote scene capture
(when wide-long shot, the ratio which accounts in the picture is smaller) then triggers wireless sensor and carries out cultural mark
Label receive and the mechanism of transmission.
S103, when the material and culture carrier profiles occupied area be less than predetermined threshold value when, acquisition for mobile terminal wirelessly passes
The cultural label that sensor is sent, and the cultural label information is sent to the cloud processor；
Mobile terminal receives the cultural label information that wireless sensor is sent, and optionally, culture is sent in wireless sensor
Before label, which also receives the cultural label of wireless network node transmission, and the wireless network node fixation is put
It sets, the wireless sensor is placed in the range of transmission of the wireless network node.
It should be noted that the wireless sensor includes but not limited to the wireless sensings mould such as Zigbee, WIFI, bluetooth, NFC
Block.In embodiments of the present invention, according to the difference of scene, the wireless sensing module used also differs, for example, closely
In (within 10 meters) communication range, NFC and bluetooth can be used to complete sending and receiving for data, and in middle distance (10-100
Rice) communication range when, then use the communication modes such as Zigbee, WIFI.
Wherein, preferred Zigbee module can be inherited as wireless sensor, the Zigbee devices in embodiments of the present invention
Inside mobile terminal, signalling and interaction can also be carried out by communication protocol with mobile terminal independently of mobile terminal.Its
In, ZigBee is the low-power consumption LAN protocol based on IEEE802.15.4 standards.It is provided according to international standard, ZigBee technology
It is the wireless communication technique of a kind of short distance, low-power consumption.Its main feature is that short distance, low complex degree, self-organizing, low-power consumption, low number
According to rate.It is mainly suitable for, for automatically controlling and remote control field, various equipment being embedded in.
Wireless network node can fixed placement in specific location, wireless network node is used for and wireless sensing module carries out
Communication, by taking Zigbee as an example, wireless network node gets the information of Zigbee in communication range, is transmitted and is assisted using Zigbee
View is shaken hands with Zigbee module, completion Signalling exchange, and by the cultural label information and active wireless network of storage inside
The information of material and culture carrier is sent to the Zigbee module at node location.
It may include that cultural label, cultural label information are a kind of specific labels for indicating ICH in material and culture carrier,
For ICH, label determines the type of ICH, content and shows form, meanwhile, cultural label can also be one and touch
Hair mechanism triggers corresponding AR elements (such as the digitized content referred to below) after receiving the culture label and is loaded into and adopts
On the image of collection.In addition, cultural label can also be a kind of marker, the black and white identification object of handmarking can be divided into
(Marker) and prosthetic label natural image pattern image identification object (Markerless), which is according to ICH
What cultural issues was related to carries the markers such as all kinds of patterns of elements of Traditional Culture symbol, figure, is that the three-dimensional tracking of follow-up progress is noted
The target object of volume.As described in CN104778654A, cultural label can be that two dimension paints this, can also be the wheel of three-dimension object
It is wide.When shooting substance culture carrier image under remote scene, cultural tag recognition easily occurs not in real identification process
Accurate problem assert cultural tag extraction or parsing failure, can not carry out next step to obtain ICH digital culture contents.
Entire AR identifications show procedure failure.In embodiments of the present invention, cultural label information can be the culture of cultural creative product
The one or more of which of label information, the cultural label information of museum interior showpiece or cultural landscape culture label information
Combination.Cultural label information can also be the digital coding of a string of specific formats, be stored in wireless network node, be passed when wireless
When sensor is interacted with wireless network node, which is encapsulated in signal format by wireless network node, and passes through
Message form is sent in wireless sensor, and wireless sensor extracts culture mark therein by being decoded to the signal
Information is signed, and the culture label information is forwarded to mobile terminal.Optionally, cultural label can also be QR codes etc., the present invention
To the specific form of expression of cultural label, there is no restriction.
It should be noted that the embodiment of the present invention is provided with trigger condition whether a cultural label receives, i.e., when and
Only in the case where identifying that material and culture carrier belongs to wide-long shot scene, triggering wireless sensor, which received, to be carried with material and culture
The corresponding cultural label of body, and by the culture label forwarding to mobile terminal, by the interaction of mobile terminal and Cloud Server, in fact
The superposition of existing ICH contents.
S104, the Cloud Server obtain non-material cultural heritage ICH number texts corresponding with the culture label information
Change content, ICH digitized contents fusion is superimposed on the image of the material and culture carrier, and it is folded to send the fusion
Image after adding is to mobile terminal；
Wherein, ICH digitized contents fusion is superimposed on the image of the material and culture carrier, it specifically can be with
For：
The ICH digitized contents and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digitized contents are subjected to real-time rendering rendering, and according to the ICH numbers after virtual combat processing
Mapping relations of the word content in reality scene carry out the ICH digitized contents and the material and culture carrier image
Additive fusion,
Wherein, the ICH digitized contents include ICH digital three-dimensional models and ICH digital cartoons, ICH number shadows
Depending on the combination of the, one or more of which of ICH digital audios, ICH digital pictures and ICH digital texts.Wherein, the processing mould
Block makes digital three-dimensional model corresponding with the culture label using computer graphic image CG technologies.
S105, the mobile terminal show the image after the fusion superposition.
It should be noted that the case where for museum exhibits, i.e., when the material and culture carrier is museum exhibits, and
When cultural label information is museum interior exhibit information, this method further includes：Identification database is built, according to the mark number
According to library, dynamic marks switching identification matching is carried out to described image；And obtain attitude orientation in the mobile terminal acquisition image
Coordinate carries out the showpiece matching detection；The posture position information for determining the mobile terminal, by the corresponding ICH of the showpiece
Digitized content carries out virtual reality fusion with the showpiece image, can not only realize the reconstruct and reproduction of historical relic, can also realize ICH
With being perfectly combined for historical place.
The embodiment of the present invention when AR recognition failures, creatively proposes a kind of based on wireless sensing under remote scene
The scheme that technology is combined with AR technologies receives wireless network node by the culture within the scope of current region by wireless sensing module
Label is sent to wireless sensing module, and is forwarded to Cloud Server, when user acquires material and culture carrier using mobile terminal
When image, Cloud Server is according to the image identified and cultural label information, by the corresponding ICH numbers of the culture label information
Change content and be superimposed upon the image specific location, realizes the superposition of AR actual situations.Using scheme provided in an embodiment of the present invention, improve
Discrimination and the stability of AR are, it can be achieved that commercial application, to realize commercial success.
Embodiment two
The embodiment of the present invention also provides and carries out the MAR devices 21 that AR numbers are shown under a kind of remote scene, the device 21
Including：
Described image is sent to processing module by image capture module 22, the image for acquiring material and culture carrier；
Image capture module can be individual camera or the camera battle array that is made of the camera of multiple and different angles
Row, can also be the mobile terminal for including camera, mobile terminal can be common mobile terminal, such as PC, intelligence
It can mobile phone and tablet computer etc..
Material and culture carrier in embodiments of the present invention, can be divided into following three types：First, for traditional technology class, tradition
Artifacts, souvenir, the product with national characteristics of ICH resources such as art class, folk literature class etc.；Second is that the exhibition in the museums ICH
It lookes at product, including various historical relics, calligraphy and painting, paints sheet, classical architecture model etc.；Third, ICH ecomuseums, folk customs village, nationality amorous feedings
National characters/region feature product in the cultural tours scenic spot such as garden and the scenic spot, including ethnic garment, specialty, all kinds of gardens
Woods landscape (flowers, plants and trees, strange stone, park etc.) etc..
Processing module can be the processing module of mobile terminal, can also be server, since processing module will carry out greatly
The data processing of amount, therefore processing module of the embodiment of the present invention is preferably Cloud Server.
The processing module 23 obtains the material and culture carrier wheel in described image for described image to be identified
It is wide；
Wherein, described image is identified in the processing module, obtains the material and culture carrier profiles in described image,
Specially：
The material and culture carrier image is subjected to binary conversion treatment, geometrical morphological analysis and clustering processing, identification
Go out the material and culture carrier profiles, and calculates the occupied area ratio of the material and culture carrier profiles and whole image.More
Specific technical solution can refer to one relevant portion of embodiment, be described again here.
Acquisition module 24, for when the material and culture carrier profiles occupied area is less than predetermined threshold value, obtaining wireless
The cultural label that sensor is sent, and the cultural label information is sent to the processing module；
Acquisition module 24 receives the cultural label information that wireless sensor is sent, and optionally, text is sent in wireless sensor
Before changing label, which is additionally operable to：Receive the cultural label that wireless network node is sent, the wireless network node
Fixed placement, the wireless sensor are placed in the range of transmission of the wireless network node.
It should be noted that the wireless sensor includes but not limited to the wireless sensings mould such as Zigbee, WIFI, bluetooth, NFC
Block.In embodiments of the present invention, according to the difference of scene, the wireless sensing module used also differs, for example, closely
In (within 10 meters) communication range, NFC and bluetooth can be used to complete sending and receiving for data, and in middle distance (10-100
Rice) communication range when, then use the communication modes such as Zigbee, WIFI.
Wherein, preferred Zigbee module can be inherited as wireless sensor, the Zigbee devices in embodiments of the present invention
Inside mobile terminal, signalling and interaction can also be carried out by communication protocol with mobile terminal independently of mobile terminal.Its
In, ZigBee is the low-power consumption LAN protocol based on IEEE802.15.4 standards.It is provided according to international standard, ZigBee technology
It is the wireless communication technique of a kind of short distance, low-power consumption.Its main feature is that short distance, low complex degree, self-organizing, low-power consumption, low number
According to rate.It is mainly suitable for, for automatically controlling and remote control field, various equipment being embedded in.
Wireless network node can fixed placement in specific location, wireless network node is used for and wireless sensing module carries out
Communication, by taking Zigbee as an example, wireless network node gets the information of Zigbee in communication range, is transmitted and is assisted using Zigbee
View is shaken hands with Zigbee module, completion Signalling exchange, and by the cultural label information and active wireless network of storage inside
The information of material and culture carrier is sent to the Zigbee module at node location.
It may include that cultural label, cultural label information are a kind of specific labels for indicating ICH in material and culture carrier,
For ICH, label determines the type of ICH, content and shows form, meanwhile, cultural label can also be one and touch
Hair mechanism triggers corresponding AR elements (such as the digitized content referred to below) after receiving the culture label and is loaded into and adopts
On the image of collection.In addition, cultural label can also be a kind of marker, the black and white identification object of handmarking can be divided into
(Marker) and prosthetic label natural image pattern image identification object (Markerless), which is according to ICH
What cultural issues was related to carries the markers such as all kinds of patterns of elements of Traditional Culture symbol, figure, is that the three-dimensional tracking of follow-up progress is noted
The target object of volume.As described in CN104778654A, cultural label can be that two dimension paints this, can also be the wheel of three-dimension object
It is wide.When shooting substance culture carrier image under remote scene, cultural tag recognition easily occurs not in real identification process
Accurate problem assert cultural tag extraction or parsing failure, can not carry out next step to obtain ICH digital culture contents.
Entire AR identifications show procedure failure.In embodiments of the present invention, cultural label information can be the culture of cultural creative product
The one or more of which of label information, the cultural label information of museum interior showpiece or cultural landscape culture label information
Combination.Cultural label information can also be the digital coding of a string of specific formats, be stored in wireless network node, be passed when wireless
When sensor is interacted with wireless network node, which is encapsulated in signal format by wireless network node, and passes through
Message form is sent in wireless sensor, and wireless sensor extracts culture mark therein by being decoded to the signal
Information is signed, and the culture label information is forwarded to mobile terminal.Optionally, cultural label can also be QR codes etc., the present invention
To the specific form of expression of cultural label, there is no restriction.
The processing module 23 is additionally operable to obtain non-material cultural heritage ICH numbers corresponding with the culture label information
ICH digitized contents fusion is superimposed on the image of the material and culture carrier, and melts described in transmission by word cultural issues
The image after superposition is closed to display module；
Wherein, ICH digitized contents fusion is superimposed to the image of the material and culture carrier by the processing module
On, specially：
The ICH digitized contents and the acquisition image are carried out at virtual combat using three-dimensional Tracing Registration technology
Reason；
The ICH digitized contents are subjected to real-time rendering rendering, and according to the ICH numbers after virtual combat processing
Mapping relations of the word content in reality scene carry out the ICH digitized contents and the material and culture carrier image
Additive fusion,
Wherein, the ICH digitized contents include ICH digital three-dimensional models (such as threedimensional model of Yellow Crane Tower), and
The one or more of which of ICH digital cartoons, ICH Active-Movie, ICH digital audios, ICH digital pictures and ICH digital texts
Combination.
Three-dimensional Tracing Registration refer to device in the process of running, the image for needing to detect, identify in real time actual environment is special
Sign, position of the camera relative to true environment in three dimensions is determined according to the feature of the actual environment video image frame of acquisition
And direction, to which virtual objects to be properly placed on to the correct position in reality scene.Realize virtual objects and real field
The seamless fusion of scape, three-dimensional Tracing Registration technology are the most crucial key technologies of AR devices.
The realization of three-dimensional Tracing Registration technology (3D Registration) generally can be divided into three kinds of approach：Based on computer
The three-dimensional Tracing Registration technology of vision, the three-dimensional Tracing Registration technology based on hardware device and hybrid three-dimensional Tracing Registration technology.
Three-dimensional Tracing Registration technology based on computer vision：Mainly by identifying the feature of image in reality scene come really
Determine position and the posture of video camera, this register method can be divided into the method based on handmarking's object (Marker) and be based on nature
Two kinds of the method for characteristics of image.Device by identify in real time the parallel lines of marker in reality scene, vertical line, planar object,
The methods of angle point, textural characteristics obtain the inside and outside portion's parameter of video camera.The advantages of method based on Marker is reality scene spy
Sign is apparent, has higher robustness and arithmetic speed fast, but needs that black and white marker is artificially arranged in the scene in advance, can influence
The beauty of scene, the method based on natural image feature can overcome the disadvantages mentioned above of handmarking's object.
Three-dimensional Tracing Registration technology based on hardware device：Sender unit and sensing device are mainly utilized, is obtained
Related data calculates the required position of three-dimensional registration and posture information.There are commonly electromagnetic type tracks of device, optical profile types to track
The hardware devices such as device, ultrasonic type tracks of device, GPS positioning device, inertial navigation, electronic compass.Electromagnetic type tracks of device
It is to utilize coil signal transmitter, the coupling interactive relationship between signal and magnetic strength induction signal is emitted according to magnetic to determine real field
The relative position and posture information of target object in scape.Optical profile type tracks of device is by picture pick-up device or photosensitive component, root
According to the light that the light source information or reflection sphere of reception are sent out, pass through the three-dimensional space meta position of the image of acquisition, light source information and sensor
Confidence ceases to determine the six-degree-of-freedom information of target object.Ultrasonic type tracks of device is the ultrasonic wave sent out according to different sound sources
Time difference, phase difference and acoustic pressure caused by the specific target object of reality scene are reached to carry out three-dimensional registration.It is fixed by GPS
The hardware devices such as position, inertial navigation, electronic compass come determine reality scene target object relative position information be usually used in be based on position
Set the augmented reality information server of service.
Hybrid three-dimensional Tracing Registration technology：In certain specific applications, in summary a variety of three-dimensional Tracing Registration methods
To determine location information of the virtual objects relative to real scene, the three-dimensional Tracing Registration function of realization device.
In the embodiment of the present invention, being superimposed for ICH and reality scene is realized using three-dimensional Tracing Registration technology：Pass through video
Coordinate information in image carries out between world coordinate system, camera coordinate system, imaging plane coordinate system and pixel coordinate system
Conversion calculates, and realizes that ICH digitized contents object is precisely superimposed with reality scene.To realize the complete of virtual objects and reality scene
U.S. merges and is registrated, and MAR devices need to detect and calculate the position and direction of mobile terminal camera in real time, according to video camera
External parameter calculates the mapping relations between ICH digitized contents and reality scene in real time, to realize cultural digitized content
Object accurately " is placed " on the correct position of the reality scene video image where target object；In addition, MAR devices also need
It will be by being carried out to the ICH digitized content objects such as digital three-dimensional model, digital cartoon, Active-Movie, sound, picture, text
Real-time rendering renders, and mapping relations of the virtual objects obtained in real time according to MAR devices in reality scene, these are calculated
The virtual image that machine generates is merged with reality scene video image, realizes the enhancing effect to reality scene information, i.e., in reality
The video image of enhancing ICH digital culture information is obtained in scene video image basis.
Specifically, in the embodiment of the present invention, device captures actual environment video figure by the camera on mobile terminal
As sequence frame, identifies the target object in actual environment, further determine that intelligent terminal video camera relative in actual environment
The position orientation relation of target object, device is according to the pose of camera data information of acquisition and the location data obtained from real scene
Information determines virtual objects (the digitized digital three-dimensional model of ICH i.e. corresponding with cultural label, digital cartoon, video, sound
Frequently, one or more digital culture contents such as figure, digital text) accurate location in actual environment, finally in real ring
Virtual objects are merged display on mobile terminals, shape by real-time rendering and the generation that virtual objects are completed in border with actual environment
At the new scene of virtual reality fusion, the process of three-dimensional Tracing Registration is completed, to reach the mesh enhanced actual environment cultural information
's.
In this operational process of MAR devices, on the one hand, the posture information of mobile terminal camera is in dynamic change
State, device must real-time and accurately obtain location information of the video camera relative to target object in true environment, could be complete
At subsequently accurately three-dimensional registered task, another aspect, device must be able to detect in real time, identify, track in actual environment
Cultural label information, could rapidly obtain the pose data information of video camera, to target object (culture under three-dimensional space environment
Label) it is real-time detection, identification, tracking and in real time completion actual situation scene match.Three-dimensional Tracing Registration based on computer vision
Technology is device in the sequence of video images frame of reality scene, using the picture frame comprising target object as positioning datum, is passed through
To obtain video camera and real ring in real time to the method for the characteristic point detection of target object picture frame, identification matching and real-time tracking
The position orientation relation in border, and the coordinate transformation relation of target object in virtual objects to actual environment is updated in real time, and then to void
The scene merged in fact is updated in real time, completes the task of three-dimensional registration.Three-dimensional Tracing Registration mistake based on computer vision
Journey includes mainly image characteristic point detection, identification matching, the real-time tracking of target object and virtual reality fusion four processes.
In MAR devices, three-dimensional Tracing Registration be to ensure that virtual objects be accurately superimposed, the key merged in actual environment
Property technology, during this, device is the reality scene video image that is captured by camera to obtain the data of real scene
Information, the data of three-dimensional Tracing Registration are directed to the image information of video camera capture, if the inner parameter of video camera is not
Accurately, it will seriously affect three-dimensional registration precision, even result in registration failure.Therefore, augmented reality device is imaged
Machine demarcates (Camera Calibration) to determine that video camera relevant parameter, camera parameters include that inner parameter is joined with external
Number, inner parameter refer to the geometry of video camera itself, the relevant parameter of optical characteristics, external parameter refer to video camera relative to
Three-dimensional space position in a certain world coordinate system and direction, the process that MAR devices carry out camera calibration are just to determine camera shooting
The process of the inside and outside portion's parameter of machine.Augmented reality device three-dimensional Tracing Registration process is as shown in Figure 3.In addition, in three-dimensional Tracing Registration
The essence of coordinate transform three-dimensional Tracing Registration process be related to world coordinate system, camera coordinate system, imaging plane coordinate system
Transformational relation between pixel coordinate system, by the determination of the transition matrix between this four coordinate systems, MAR devices can incite somebody to action
It includes mainly camera calibration, in real time that virtual objects, which are accurately superimposed upon among the scene of actual environment three-dimensional Tracing Registration process,
Track the main contents drawn with three-dimensional scenic and merge three aspects.The purpose of camera calibration is that aid-device determines camera shooting
Machine inner parameter and external parameter obtain real world coordinates system, camera coordinate system, imaging plane coordinate system and pixel coordinate
Transformational relation between system is accurately superimposed upon in reality scene for subsequent virtual objects and provides data information.Real-time tracking mistake
Journey include to reality scene target object it is real-time detection and tracking, by reality scene target object it is real-time detect,
Identification matching and tracking obtain position and direction of the video camera relative to real world coordinates system, to determine real world coordinates
Transition matrix between system and camera coordinate system.Three-dimensional scenic draw fusion mainly by device obtain world coordinate system,
Transformational relation between camera coordinate system, imaging plane coordinate system and pixel coordinate system, is drawn using computer graphic image
Generation technique among virtual objects are superimposed upon the targeted object region of reality scene, forms the new scene of virtual reality fusion.
It should be noted that the case where for museum exhibits, i.e., when the material and culture carrier is museum exhibits, and
When cultural label information is museum interior exhibit information, processing module 23 is additionally operable to：Identification database is built, according to the mark
Know database, dynamic marks switching identification matching is carried out to described image；And obtain posture in the mobile terminal acquisition image
The elements of a fix carry out the showpiece matching detection；Determine the posture position information of the mobile terminal, the showpiece is corresponding
ICH digitized contents carry out virtual reality fusion with the showpiece image, can not only realize the reconstruct and reproduction of historical relic, can also realize
ICH and historical place are perfectly combined.
The display module 25, for showing the image merged after being superimposed.
There are mainly two types of patterns for the development and application of mobile augmented reality MAR, and one is based on location-based service LBS
The MAR devices of (Location Based Service, LBS), mainly pass through the GPS positioning of mobile intelligent terminal, electronic compass
Position and the posture that intelligent terminal is determined with equipment such as gravitational accelerometers are superimposed ring around user in the intelligent terminal of user
The relevant information of border point of interest POI (Point of Interest, POI), such as to the hotel, navigation, main public around user
The markup information of the progress such as facility.Another kind is the mobile increasing of the computer vision Tracing Registration method based on natural image feature
Strong real device application mainly identifies the feature of user's surrounding objects object to determine intelligence by mobile intelligent terminal camera
Position and posture of the terminal relative to target object, superposition and the relevant information of target object in the intelligent terminal of user.
In both application models of current MAR, the former mainly marks the POI information around user within the scope of certain distance, generally
The information of superposition belongs to the information such as two-dimensional word, picture, unsuitable to pass through the more rich digitlizations such as tangibility, situation
Information superposition is annotated and is shown to the detailed of target object to realize.And the embodiment of the present invention creatively proposes one kind remote
The scheme combined with AR technologies based on wireless sensor technology under scene, in the case where AR is identified and failed, by wirelessly passing
Sense module receives wireless network node and the cultural label within the scope of current region is sent to receiving module, and is forwarded to processing mould
Block, processing module, will be in the corresponding ICH digitlizations of the culture label information according to the image identified and cultural label information
Appearance is superimposed upon the image specific location, realizes the superposition of AR actual situations.It, can not only be more using scheme provided in an embodiment of the present invention
The discrimination for improving AR, can also be achieved commercial application, to realize commercial success.
It should be understood that in the various embodiments of the application, the size of the serial number of each process is not meant to execution sequence
Successively, the execution sequence of each process should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present application
Constitute any restriction.
Those of ordinary skill in the art may realize that moulds described in conjunction with the examples disclosed in the embodiments of the present disclosure
Block and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, depends on the specific application and design constraint of technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description,
The specific work process of device and module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
The various pieces of this specification are all made of progressive mode and are described, identical similar portion between each embodiment
Point just to refer each other, and what each embodiment introduced is and other embodiment difference.Especially for device and dress
For setting embodiment, since it is substantially similar to the method embodiment, so description is fairly simple, related place is referring to method reality
Apply the explanation of example part.
Finally, it should be noted that：The foregoing is merely the preferred embodiments of technical scheme, are not intended to
Limit the protection domain of the application.Obviously, those skilled in the art can carry out the application various modification and variations without de-
From scope of the present application.If these modifications and variations of the application belong to the range of the application claim and its equivalent technologies
Within, then any modification, equivalent replacement, improvement and so on, should be included within the protection domain of the application.
Claims (10)
1. carrying out the method that augmented reality AR digital culture contents are shown under a kind of remote scene, which is characterized in that the side
Method includes：
Mobile terminal acquires the image of material and culture carrier, and described image is sent to Cloud Server；
Described image is identified in the Cloud Server, obtains the material and culture carrier profiles in described image；
When the material and culture carrier profiles occupied area is less than predetermined threshold value, what acquisition for mobile terminal wireless sensor was sent
Cultural label, and the cultural label information is sent to the cloud processor；
The Cloud Server obtains non-material cultural heritage ICH digital culture contents corresponding with the culture label information, will
The ICH digitized contents fusion is superimposed on the image of the material and culture carrier, and sends the figure after the fusion superposition
As to mobile terminal；
The mobile terminal shows the image after the fusion superposition.
2. according to the method described in claim 1, it is characterized in that, described image is identified in the Cloud Server, obtain
Material and culture carrier profiles in described image, including：
The material and culture carrier image is subjected to binary conversion treatment, geometrical morphological analysis and clustering processing, identifies institute
Material and culture carrier profiles are stated, and calculate the occupied area ratio of the material and culture carrier profiles and whole image.
3. according to the method described in claim 1, it is characterized in that, the Cloud Server will be believed with the signal chinesization label
Corresponding ICH digitized contents fusion is ceased to be superimposed in described image, including：
Virtual combat processing is carried out to the ICH digitized contents and the acquisition image using three-dimensional Tracing Registration technology；
The ICH digitized contents are subjected to real-time rendering rendering, and are digitized according to the ICH after virtual combat processing
The ICH digitized contents and the material and culture carrier image are overlapped by mapping relations of the content in reality scene
Fusion,
Wherein, the ICH digitized contents include ICH digital three-dimensional models and ICH digital cartoons, ICH Active-Movie, ICH
The combination of the one or more of which of digital audio, ICH digital pictures and ICH digital texts.
4. according to the method described in claim 1, it is characterized in that, the material and culture carrier includes cultural creative product, wins
Object shop exhibit or cultural landscape, then the cultural label information includes the cultural label information of cultural creative product, museum
The combination of the cultural label information of internal showpiece or the one or more of which of cultural landscape culture label information.
5. according to the method described in claim 4, it is characterized in that, the method further includes：
When the material and culture carrier is museum exhibits, and cultural label information is museum interior exhibit information, structure
Identification database carries out dynamic marks switching identification matching according to the identification database to described image；
Attitude orientation coordinate in the mobile terminal acquisition image is obtained, the showpiece matching detection is carried out；
The posture position information for determining the mobile terminal, by the corresponding ICH digitized contents of the showpiece and the showpiece figure
As carrying out virtual reality fusion.
6. the mobile augmented reality MAR devices that augmented reality AR digital culture contents are shown are carried out under a kind of remote scene,
It is characterized in that, the MAR devices include：
Described image is sent to processing module by image capture module, the image for acquiring material and culture carrier；
The processing module obtains the material and culture carrier profiles in described image for described image to be identified；
Acquisition module, for when the material and culture carrier profiles occupied area is less than predetermined threshold value, obtaining wireless sensor
The cultural label of transmission, and the cultural label information is sent to the processing module；
The processing module is additionally operable to obtain non-material cultural heritage ICH digital cultures corresponding with the culture label information
ICH digitized contents fusion is superimposed on the image of the material and culture carrier by content, and sends the fusion superposition
Image afterwards is to display module；
The display module, for showing the image merged after being superimposed.
7. device according to claim 6, which is characterized in that described image is identified in the processing module, obtains
Material and culture carrier profiles in described image, including：
The material and culture carrier image is subjected to binary conversion treatment, geometrical morphological analysis and clustering processing, identifies institute
Material and culture carrier profiles are stated, and calculate the occupied area ratio of the material and culture carrier profiles and whole image.
8. device according to claim 6, which is characterized in that the processing module will be believed with the signal chinesization label
Corresponding ICH digitized contents fusion is ceased to be superimposed in described image, including：
Virtual combat processing is carried out to the ICH digitized contents and the acquisition image using three-dimensional Tracing Registration technology；
The ICH digitized contents are subjected to real-time rendering rendering, and are digitized according to the ICH after virtual combat processing
The ICH digitized contents and the material and culture carrier image are overlapped by mapping relations of the content in reality scene
Fusion,
Wherein, the ICH digitized contents include ICH digital three-dimensional models and ICH digital cartoons, ICH Active-Movie, ICH
The combination of the one or more of which of digital audio, ICH digital pictures and ICH digital texts.
9. device according to claim 6, which is characterized in that the material and culture carrier includes cultural creative product, wins
Object shop exhibit or cultural landscape, then the cultural label information includes the cultural label information of cultural creative product, museum
The combination of the cultural label information of internal showpiece or the one or more of which of cultural landscape culture label information.
10. device according to claim 9, which is characterized in that the processing module is additionally operable to：
When the material and culture carrier is museum exhibits, and cultural label information is museum interior exhibit information, structure
Identification database carries out dynamic marks switching identification matching according to the identification database to described image；
Attitude orientation coordinate in the mobile terminal acquisition image is obtained, the showpiece matching detection is carried out；
The posture position information for determining the mobile terminal, by the corresponding ICH digitized contents of the showpiece and the showpiece figure
As carrying out virtual reality fusion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810251806.6A CN108564662A (en) | 2018-03-26 | 2018-03-26 | The method and device that augmented reality digital culture content is shown is carried out under a kind of remote scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810251806.6A CN108564662A (en) | 2018-03-26 | 2018-03-26 | The method and device that augmented reality digital culture content is shown is carried out under a kind of remote scene |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108564662A true CN108564662A (en) | 2018-09-21 |
Family
ID=63533265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810251806.6A Pending CN108564662A (en) | 2018-03-26 | 2018-03-26 | The method and device that augmented reality digital culture content is shown is carried out under a kind of remote scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108564662A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109147627A (en) * | 2018-10-31 | 2019-01-04 | 天津天创数字科技有限公司 | Digital museum AR explains method |
| CN109584378A (en) * | 2018-12-29 | 2019-04-05 | 广州欧科信息技术股份有限公司 | History culture ancient building object based on AR leads reward method, apparatus and system |
| CN110008425A (en) * | 2019-03-12 | 2019-07-12 | 重庆三峡学院 | A kind of comprehensive public service platform of the cultural industry intention based on cloud service |
| CN110349504A (en) * | 2019-07-03 | 2019-10-18 | 武汉子序科技股份有限公司 | A kind of museum guiding system based on AR |
| CN111316333A (en) * | 2018-09-30 | 2020-06-19 | 华为技术有限公司 | Information prompting method and electronic equipment |
| CN111638792A (en) * | 2020-06-04 | 2020-09-08 | 浙江商汤科技开发有限公司 | AR effect presentation method and device, computer equipment and storage medium |
| CN113362448A (en) * | 2021-05-28 | 2021-09-07 | 青岛酒店管理职业技术学院 | Digital museum 3D image acquisition and presentation method |
| CN116206087A (en) * | 2023-04-28 | 2023-06-02 | 深圳市其域创新科技有限公司 | Beyond-the-horizon enhanced display system and method |
| CN109765555B (en) * | 2018-12-28 | 2023-06-20 | 通鼎互联信息股份有限公司 | Method and device for realizing WSN node positioning by constructing virtual SAR image |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101023437A (en) * | 2004-07-27 | 2007-08-22 | 卡勒兹普麦迪亚公司 | Hybrid tag interface system and method using the hybrid tag interface |
| CN104778654A (en) * | 2015-03-10 | 2015-07-15 | 湖北大学 | Intangible cultural heritage digital display system and method thereof |
-
2018
- 2018-03-26 CN CN201810251806.6A patent/CN108564662A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101023437A (en) * | 2004-07-27 | 2007-08-22 | 卡勒兹普麦迪亚公司 | Hybrid tag interface system and method using the hybrid tag interface |
| CN104778654A (en) * | 2015-03-10 | 2015-07-15 | 湖北大学 | Intangible cultural heritage digital display system and method thereof |
Non-Patent Citations (3)
| Title |
|---|
| 余日季: "基于AR技术的非物质文化遗产数字化开发研究", 《中国博士学位论文全文数据库 信息科技辑》 * |
| 余日季等: "基于移动终端和AR技术的博物馆文化教育体验系统的设计与应用研究", 《中国电化教育》 * |
| 吕淘沙等: "增强现实中的目标远距离识别方法研究", 《软件工程师》 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111316333A (en) * | 2018-09-30 | 2020-06-19 | 华为技术有限公司 | Information prompting method and electronic equipment |
| CN111316333B (en) * | 2018-09-30 | 2023-03-24 | 华为技术有限公司 | Information prompting method and electronic equipment |
| US11892299B2 (en) | 2018-09-30 | 2024-02-06 | Huawei Technologies Co., Ltd. | Information prompt method and electronic device |
| CN109147627A (en) * | 2018-10-31 | 2019-01-04 | 天津天创数字科技有限公司 | Digital museum AR explains method |
| CN109765555B (en) * | 2018-12-28 | 2023-06-20 | 通鼎互联信息股份有限公司 | Method and device for realizing WSN node positioning by constructing virtual SAR image |
| CN109584378A (en) * | 2018-12-29 | 2019-04-05 | 广州欧科信息技术股份有限公司 | History culture ancient building object based on AR leads reward method, apparatus and system |
| CN110008425A (en) * | 2019-03-12 | 2019-07-12 | 重庆三峡学院 | A kind of comprehensive public service platform of the cultural industry intention based on cloud service |
| CN110349504A (en) * | 2019-07-03 | 2019-10-18 | 武汉子序科技股份有限公司 | A kind of museum guiding system based on AR |
| CN111638792A (en) * | 2020-06-04 | 2020-09-08 | 浙江商汤科技开发有限公司 | AR effect presentation method and device, computer equipment and storage medium |
| CN113362448A (en) * | 2021-05-28 | 2021-09-07 | 青岛酒店管理职业技术学院 | Digital museum 3D image acquisition and presentation method |
| CN116206087A (en) * | 2023-04-28 | 2023-06-02 | 深圳市其域创新科技有限公司 | Beyond-the-horizon enhanced display system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108564662A (en) | The method and device that augmented reality digital culture content is shown is carried out under a kind of remote scene | |
| CN108540542B (en) | Mobile augmented reality system and display method | |
| US11887312B2 (en) | Fiducial marker patterns, their automatic detection in images, and applications thereof | |
| CN110017841A (en) | Vision positioning method and its air navigation aid | |
| Amin et al. | Comparative study of augmented reality SDKs | |
| US20200334913A1 (en) | In situ creation of planar natural feature targets | |
| CN105143907B (en) | Alignment system and method | |
| CN106462322A (en) | Device-provided tracking data for augmented reality | |
| CN109724603A (en) | A kind of Indoor Robot air navigation aid based on environmental characteristic detection | |
| Bostanci et al. | User tracking methods for augmented reality | |
| CN102741797A (en) | Method and apparatus for transforming three-dimensional map objects to present navigation information | |
| JP2003256876A (en) | Device and method for displaying composite sense of reality, recording medium and computer program | |
| CN109887003A (en) | A kind of method and apparatus initialized for carrying out three-dimensional tracking | |
| CN104781849A (en) | Fast initialization for monocular visual simultaneous localization and mapping (SLAM) | |
| WO2020020102A1 (en) | Method for generating virtual content, terminal device, and storage medium | |
| CN110478892A (en) | A kind of method and system of three-dimension interaction | |
| CN103839277A (en) | Mobile augmented reality registration method of outdoor wide-range natural scene | |
| CN110908504B (en) | Augmented reality museum collaborative interaction method and system | |
| CN109997364A (en) | Method, equipment and the stream of the instruction of the mapping of omni-directional image are provided | |
| KR20230079177A (en) | Procedurally generated augmented reality content creators | |
| CN104537705A (en) | Augmented reality based mobile platform three-dimensional biomolecule display system and method | |
| CN108615260A (en) | The method and device that shows of augmented reality digital culture content is carried out under a kind of exception actual environment | |
| CN103955889B (en) | Drawing-type-work reviewing method based on augmented reality technology | |
| CN113936085A (en) | Three-dimensional reconstruction method and device | |
| Yu et al. | Key technology and application research on mobile augmented reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180921 |
|
| RJ01 | Rejection of invention patent application after publication |