KR20150077607A - Dinosaur Heritage Experience Service System Using Augmented Reality and Method therefor - Google Patents

Abstract

The present invention relates to a historic site experience service using augmented reality and a method thereof and, more specifically, to a historic site experience service using augmented reality and a method thereof, which uses data acquired in a GPS sensor and a terrestrial magnetism sensor and matches an image stored in the server with an image an experienced person transmitted by comparing the images, which makes it possible to accurately recognize a location and an object and reduces errors in the location and posture.

Description

[0001] The present invention relates to a Dinosaur Heritage Experience Service System using Augmented Reality,

The present invention relates to a system and a method for providing a dinosaur site experience service using an augmented reality, and more particularly, to a system and method for providing a dinosaur site experience service using an augmented reality, The present invention relates to a system and method for providing a service for experiencing dinosaur sites using an augmented reality capable of recognizing accurate places and objects and reducing errors in position and attitude.

Recently, various contents using new technology have been developed through development and popularization of personal portable communication terminal devices such as smart phones. As these contents lead to the increase of the technical demand for the interaction between human and computer in terms of efficiency and convenience, augmented reality, which is a field of HCI (Human Computer Interaction), has attracted great attention, Mobile Augmented Reality) is growing.

Augmented reality is a kind of mixed reality that is the real world and the virtual world. It is also called 'extended reality' in terms of expanding the human senses and perception of objects by combining 'virtual information' with real world information and 'enhancing' information of objects and images.

Virtual reality is defined as a technique of completely immersing a user into a virtually created three-dimensional space. Therefore, the user can not interact with the actual environment around him, but the augmented reality is implemented in a form in which the additional information provided to the user is matched to the real world. Therefore, it is a technology to complement the information of virtual reality in the real world. The augmented reality conveys the feeling that the information provided to the user is perfectly combined in the real image to exist in the real world. Such augmented reality is applied to various fields such as broadcasting, shopping, medical, education, military, game, architecture, shipbuilding, and manufacturing industries because it provides improved immersion and realism to users.

Most of the experiential contents using such augmented reality are utilized indoors, and development of content that can be experienced in a wide outdoor environment like a dinosaur site is insignificant. Korean Patent Laid-Open No. 10-2011-0107691 'Space Augmented Reality Based Interactive Display Method' and Korean Patent Laid-Open No. 10-2012-0116564 'Display System using Augmented Reality' To a system for providing experiential contents.

In the case of a system for providing contents using an augmented reality with respect to an indoor exhibit as described above, the size of the exhibit is relatively small, and the location where the exhibit is displayed and the direction of viewing the exhibit are not so large, This is easy.

However, in case of providing experiential contents using augmented reality in a wide area such as a dinosaur site, there is an error between the GPS sensor and the geomagnetic sensor of a terminal such as a smart phone, and the viewing area is wide, And the 3D model can not be matched in the correct place and direction.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems and it is an object of the present invention to provide a GPS receiver and a geomagnetic sensor, And to provide a method and system for providing a service for experiencing dinosaur sites using an augmented reality capable of reducing errors in position and attitude.

In order to achieve the above object, a system for providing a dinosaur site experience service using an augmented reality according to the present invention includes a system for providing a dinosaur site experiencing service using an augmented reality to provide dinosaur site contents to a dinosaur site user using an augmented reality The location data of the place where the dinosaur ruins are viewed and the attitude data of the viewing direction and the minutia point data of the dinosaur site image corresponding to the specific location and attitude data are stored and the minutia data of the dinosaur site corresponding to the specific location, A content management server for storing the site information; An experience terminal for measuring location data and attitude data of a place where a dinosaur site is viewed, photographing a relic site image of the dinosaur site in the location and posture, and displaying the received relic site contents on a screen, The experiential terminal transmits measured position data and attitude data and a photographed historical image to the content management server, and the content management server compares position data and attitude data received from the experiential terminal with stored position data and attitude data The location data corresponding to the closest location data and the attitude data is extracted and the minutia data of the extracted location image is compared with the minutia point data of the location image received from the experiencer terminal to determine whether or not to match. Historical sites And transmits the location data, the attitude data, and the location information corresponding to the location image received from the experience user terminal to the experience user terminal when it is determined that the user matches the location information, And the content is displayed on the screen.

The present invention also provides a method for providing a dinosaur site experiencing service using an augmented reality to provide dinosaur site contents to a dinosaur site using an augmented reality, The location data of the place to be visited, the posture data of the viewing direction, and the minutia data of the dinosaur site corresponding to the specific location and attitude data are stored in the content management server, and the location data corresponding to the specific location, A location registering step of registering the location of the dinosaur site in the content management server, a location registering step of registering the location of the dinosaur site in the content management server, To the server, A content request step of requesting content of the destination of the transmitted location data, the attitude data, and the destination location image; and the content management server compares the location data and the attitude data received from the experiential terminal with the stored location data and attitude data, The location data and the posture data are extracted and the minutia data of the extracted location image is compared with the minutia data of the location image received from the experience terminal so as to determine whether the location data and the location information match each other. And transmits the location data, the attitude data, and the location information corresponding to the image of the place of interest received from the experience person terminal to the experience person terminal when it is determined that they match each other, In that it comprises a recognition sites and the content providing method comprising: displaying the received content on the display from the sites characterized.

The system and method for providing dinosaur sites experience service using the augmented reality according to the present invention using the augmented reality data according to the present invention not only utilizes the data acquired from the GPS sensor and geomagnetic sensor but also compares the images stored in the server with the images transmitted by the experient, So that it is possible to recognize an accurate place and object, and it is possible to reduce errors in position and attitude.

1 is a block diagram illustrating a dinosaur site experiencing service providing system using an augmented reality according to an embodiment of the present invention;
2 is a conceptual diagram illustrating a method for providing a dinosaur site experience service using an augmented reality according to an embodiment of the present invention
3A and 3B are diagrams showing photographs of the images of the places of relics photographed by the experiential terminal and the images of the states where the minutiae are extracted from the images of the relic sites

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

FIG. 1 is a block diagram illustrating a dinosaur site experiencing service providing system using an augmented reality according to an embodiment of the present invention. Referring to FIG.

Referring to the drawings, a system for providing a dinosaur site experience service using an augmented reality according to an embodiment of the present invention is provided for providing dinosaur site contents to a dinosaur site using an augmented reality, and includes a content management server 10, (20).

The contents management server 10 stores the contents of the site of interest and transmits the location data, the attitude data, and the location location image to the experience user terminal 20, The location information corresponding to the data, the attitude data, and the location location image to the experiencer terminal 20.

That is, in the content management server 10, positional data of a place to observe the dinosaur heritage site and posture data of a direction to view the dinosaur heritage site to be managed and minutiae points of the dinosaur site image corresponding to the specific position and attitude data Data is stored. In addition, the content management server 10 stores the specific location, the attitude data, and the location information corresponding to the location image.

Also, the content management server 10 compares the position data and the attitude data received from the experiencer terminal 20 with the stored position data and attitude data, and extracts the images of the places corresponding to the closest position data and attitude data. The content management server 10 compares the minutia data of the extracted location image with the minutia point data of the location image received from the experiencer terminal 20 to determine whether they match or not, The location data corresponding to the location data, the attitude data, and the location information corresponding to the location location image received from the experience terminal are transmitted to the experience terminal.

The experiential terminal 20 is a portable terminal carried by an experiencer experiencing dinosaur sites, and is a smart phone widely used today.

The experiential terminal 20 measures positional data and attitude data of the place when the experimenter approaches a place where the dinosaur relic site is viewed, and when the experient photographs the image of the relic site about the dinosauric relic in the position and posture, The location data, the attitude data, and the photographed location image to the content management server 10, and requests the corresponding location content. In addition, the experiencer terminal 20 displays the contents of the historical site received from the contents management server 10 on a screen, so that the experient can view the sites together with the contents.

Meanwhile, the dinosaur site experiencing service providing system using the augmented reality according to the present invention is specifically realized by a method of providing a dinosaur site experiencing service using an augmented reality described below.

FIG. 2 is a conceptual diagram illustrating a method of providing a dinosaur site experience service using an augmented reality according to an embodiment of the present invention. The method for providing a dinosaur site experiencing service using an augmented reality according to the present invention includes: A request step, a landmark recognition and a content providing step.

In the relic location and content registration step, the viewing location data of the dinosaur site, the posture data at the location, and the location image corresponding to the location and posture of the dinosaur site are stored in the content management server 10, And registering the contents of the historical sites corresponding to the images.

That is, in the location and content registration step, the location data of the place where the dinosaur site is viewed, the attitude data of the viewing direction, and the minutia data of the dinosaur site image corresponding to the specific location and attitude data, And stores the location information corresponding to each of the specific location and attitude data and the location image in the content management server 10 for registration.

In more detail, the location and posture of the site visit to the location where visitors can observe the site, and the location and the posture of the site are detected by a GPS sensor and a geomagnetic sensor To collect data (Latitude, Logitute, Altitude, Declination). In addition, the panorama image is photographed by the camera from the position and the posture to the left or right or up and down with respect to the center of the historical site to obtain the historical site image, and minutiae points of the obtained historical site image are extracted to generate minutia data. The generated data is stored in the content management server 10, and the stored location and posture and the historical location image are registered corresponding to the historical place contents to be provided correspondingly.

The content requesting step is a step of requesting the contents to the contents management server 20 by accessing the places of interest and measuring and photographing the viewing places and attitudes and the images of the places of relocation with the experiencing person's terminal 20 and transmitting them to the contents management server 20, And requesting the site contents.

That is, in the content request step, location data and attitude data of a place where a dinosaur site is visited are measured by an experiential terminal, such as a smart phone, Photographing an image of a relic site and transferring the image to the content management server 10, and requesting the relic content of the transmitted location data, the attitude data, and the relic site image.

In the present invention, a smartphone may be used as the experiential terminal 20, and in general, a smart phone may include not only a GPS sensor for measuring position data but also a gyro sensor capable of measuring a posture of a smartphone, And a camera module capable of capturing an image of a historical site. In addition, there is provided a communication module capable of transmitting the measured data to the content management server 10 and receiving the content of the site from the content management server 10.

The location recognition and content providing step may search for the location information corresponding to both the location data and the posture data transmitted from the experience user terminal 20 and the corresponding location image, and transmit the location information to the experience user terminal 20 .

The content management server 10 compares the position data and attitude data received from the experiencer terminal 20 with the stored position data and attitude data, and determines whether the position data and attitude data correspond to the closest position data and attitude data The image of the historical site is taken out. It is preferable that the adjacent position is calculated from the latitude and longitude data as a normal Euclidean distance.

The genitals content management server 10 compares the minutia point data on the image of the relic site extracted as described above with the minutia data of the relic site image received from the experiencer terminal to determine whether or not to match. 3A and 3B are photographs showing an image of a state where a minus point is extracted from an image of a place where a photograph is taken by an experiencing person's terminal and an image of the location of the object, respectively, and the content management server 10 stores the stored minutia point data, And compares the minutia data extracted from the images of the historical sites transmitted from the experient terminal 20 with each other to determine whether the minutia data is matched. When the content management server 10 judges that the images of the images of the places of interest are matched with each other, the content management server 10 stores the location data, the posture data, and the location information corresponding to the image of the location information received from the experiencing person's terminal 20, To the experient terminal (20), and the experient terminal (20) displays the historical site contents received from the content management server (10) on the screen.

As described above, the system and method for providing a dinosaur site experience service using the augmented reality according to the present invention can utilize the data acquired from the GPS sensor and the geomagnetic sensor, as well as by comparing the images stored in the server with the images transmitted by the experient, It is possible to recognize the place and the object, and the error in the position and attitude can be reduced.

The present invention is not limited to the above-described embodiments and can be embodied in other forms. Like reference numerals designate like elements throughout the specification.

10: Content management server
20: Experiential terminal

Claims (2)

A system for providing a dinosaur site experience service using an augmented reality for providing dinosaur site contents to a dinosaur site using an augmented reality,
The location data of the place where the dinosaur site is viewed, the attitude data of the viewing direction, and the minutia point data of the dinosaur site image corresponding to the specific location and attitude data are stored, and the location data corresponding to the specific location, the attitude data, A content management server for storing the content; An experience terminal for measuring location data and attitude data of a place where a dinosaur site is viewed, photographing a relic site image of the dinosaur site in the location and posture, and displaying the received relic site contents on a screen,
The experiential terminal transmits the measured location data and attitude data and the captured location image to the content management server,
The content management server compares position data and attitude data received from the experiencer terminal with stored position data and attitude data to extract the position image data corresponding to the closest position data and attitude data, The location data and the attitude data received from the experiencer terminal to the experiencer terminal when it is determined that the two images match each other, The location information corresponding to the image of the historical site is transmitted to the experiential terminal,
Wherein the experiential terminal displays the relic content received from the content management server on the screen.
A method for providing a dinosaur site experience service using an augmented reality for providing dinosaur site contents to a dinosaur site using an augmented reality,
Posture data of a place where a dinosaur site is viewed and posture data of a direction of viewing and minutia data of a dinosaur site image corresponding to specific location and posture data are stored in a content management server and stored in a specific location, A location and content registration step of storing the corresponding place content in a content management server,
The location data and the attitude data of the place where the dinosaur site is viewed are measured and the image of the relic site about the dinosaur site in the position and the posture is photographed and transmitted to the content management server, A content request step of requesting the content of the site of interest,
The content management server compares position data and attitude data received from the experiencer terminal with stored position data and attitude data to extract a position image corresponding to the closest position data and attitude data, The location data and the attitude data received from the experiencer terminal to the experiencer terminal when it is determined that the two images match each other, And transmitting the location information corresponding to the location information to the user terminal, wherein the user terminal includes a location information recognition and content providing step of displaying the location information received from the content management server on the screen How dinosaurs historic experience with augmented reality service to the gong.

Images