KR101798891B1 - Method for providing ausmented reality by using 4d database and system - Google Patents

Abstract

The present invention relates to a system and method for providing an augmented reality of a ferry sailing on the sea. More specifically, the augmented reality providing method includes: obtaining GPS information, obtaining the roll, pitch, yaw, and camera angle information; calculating the ship position and ship view-angle based on the obtained information; obtaining 3D coordinates by predicting the images captured by the ship from a database based on the computed information; predicting images to be captured by the current ship from the database to obtain feature image points; obtaining actual images from the camera unit; analyzing the feature image points from the obtained images; comparing the feature image points obtained in advance by prediction and the analyzed feature image points; obtaining an image difference between the compared feature image points; obtaining a T-factor and analyzing the difference to correct information in the database based thereon; extracting electronic and touristic chart information from the corrected information in the database; and displaying the electronic and touristic charts to overlap the recorded images. The present invention can provide accurate augmented reality information by correcting the images and taking the offshore situation changing in accordance with the time into account.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and system for providing augmented reality in a passenger ship using a four-dimensional database,

The present invention relates to a method and system for providing an augmented reality within a passenger ship. And more particularly, to a method and system for constructing a database in four dimensions to provide an augmented reality and providing an augmented reality at sea using the same.

2. Description of the Related Art In recent years, portable terminals such as mobile phones, PDAs, and UMPCs have become commonplace, and portable terminals having various additional services and functions have been developed. Among these additional services and functions, a position information providing technique for measuring the position of the portable terminal and providing it is developed, and the technology for measuring the position of the portable terminal can be used in combination with other services, It is a field that is becoming.

Augmented reality technology is being studied as one of these location information providing technologies. Augmented reality technology is a technology derived from virtual reality technology, which means a technology that improves awareness of the real world. Unlike virtual reality technology, which excludes interaction with the real world and processes only interactions within a pre-built virtual space, the augmented reality technology is based on real-time processing and real- Is displayed on the image of the real world in a superimposed manner and is provided with an interaction with the real world so that the observer can make a quick and convenient situation judgment on the real world observation area.

On the other hand, the sightseeing using a passenger ship has been introduced to various TV pros and has become popular with many people in recent years to be used by hundreds of thousands of tourists every year. However, there are no special sightseeing facilities inside the passenger ship, so most tourists spend their time sleeping while traveling on a passenger ship.

Providing tourist contents using augmented reality on a passenger ship will make many people enjoy using it.

In order to apply the augmented reality, information on the database is superimposed on the photographed image in association with the database constructed in advance, based on the image captured in real time. However, since the passenger ship is located in a special environment called the sea, there is a problem that the actual photographed image changes every time due to the difference in the tide.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems, and more particularly, to provide a method and system for providing an augmented reality in a passenger ship by analyzing a real-time captured image based on a four-dimensional database.

As a solution to the problem to be solved, a system for providing an augmented reality in a passenger ship on the sea includes a GPS for confirming the position of the passenger ship, a sensor for measuring the state of the passenger ship, a camera for photographing the scenery outside the passenger ship, A database including augmented reality information such as 3D coordinates, image feature points, and tide, an airstream, and a temperature according to a time change, and corrects the information of the database.

According to another aspect of the present invention, there is provided a method of providing an augmented reality in a passenger ship using a four-dimensional database, comprising the steps of acquiring GPS information, acquiring angle information of Roll, Pitch, Yaw and camera unit, Calculating a posture and a state in which the boat is looking at, obtaining 3D coordinates by predicting an image taken by the boat from the database based on the calculated information, estimating an image to be photographed on the current boat from the database, Obtaining an actual image from the camera section, analyzing image feature points from the obtained image, comparing the analyzed image feature points with the image feature points obtained by the prediction, Obtaining a difference of an image, acquiring a T-factor, analyzing the difference, Extracting the electronic chart and the sightseeing chart information of the database from the corrected information, and displaying the electronic chart and the tourist chart in a superimposed manner on the photographed image, characterized by comprising the steps of: do.

A method for providing an augmented reality in a passenger ship as another solution includes acquiring GPS information; Acquiring angle information of a position of the passenger ship, roll, pitch, yaw, and camera unit; Calculating a position, a posture and a state in which the passenger ship is looking at the ship based on the obtained information; Acquiring three-dimensional coordinates by predicting an image taken from a database based on the calculated information; Predicting an image to be photographed on a current ship from a database to obtain image feature points; Obtaining an actual image from the camera unit; Analyzing image feature points from the acquired image; Comparing the analyzed image feature points with the predicted image feature points and analyzing the differences; Correcting the compared image feature points using information of a time database including difference, tidal current, and wave height information of the tidal trough varying with time; Extracting the electronic chart and the tournament chart information of the database from the corrected image feature points; And superimposing the electronic chart and the sightseeing chart on the photographed image; The time database and the database are interlocked to form a four-dimensional database, and the four-dimensional database is used.

The present invention is advantageous in that an accurate augmented reality can be provided in a passenger ship by correcting based on change information over time even if there is a change in the height of the sea level or a change in the sea current with time.

Fig. 1 Augmented Reality Example shown in a Passenger Ship
Fig. 2 is an explanatory diagram of the difference in the photographed image due to the difference in the tide interval
Fig.
Fig.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. It is to be understood that the term "comprises" or "having" in the present application does not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification .

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, a method and system for providing an augmented reality in a passenger ship using a four-dimensional database according to the present invention will be described in detail with reference to the accompanying drawings.

Fig. 1 is an embodiment of a screen in which augmented reality information is overlaid on an image photographed in a passenger ship. Tourist information about the passenger ship can be displayed, and the time information until the passenger ship arrives can be displayed.

In addition, it can display information such as fish, can link fish information with smart phone, can play the information that can play fishing game together, It can also provide services that can be provided.

However, the photographed image as shown in Fig. 1 is not constant at all times due to differences in tides, currents, and digging. It is not easy to superimpose and display the augmented reality information on a non-constant image, and there is a problem that it is not accurate even if it is displayed. (Fig. 2)

3 is a system block diagram showing augmented reality information on a passenger ship on the sea.

The augmented reality providing system 100 includes a GPS 110 for confirming a position of a ship, a roll 120, a pitch, a yaw of the ship, a sensor unit 120 for sensing angle information of the camera unit 130, A display unit 140 that overlaps and displays the images photographed by the camera unit 130 and the augmented reality information, the GPS 110, the sensor unit 120, and the camera unit 130 A communication unit 160 for communicating with an external device such as a smart phone, a communication unit 160 for inputting information on an augmented reality screen, And a four-dimensional database 180. The input unit 170 includes a four-

The GPS 110 functions to inform the position of the boat.

When the position of the ship is confirmed, the sensor unit 120 senses information as to which direction the ship is looking at, how much it is inclined, and which position the camera unit is shooting, and provides the sensor unit 120 with the information .

Based on the data provided to the control unit, the control unit acquires three-dimensional coordinates through calculation and acquires three-dimensional coordinates from the corresponding database.

Acquiring feature points of an image to be photographed on a passenger ship based on the three-dimensional coordinates, capturing an image through the camera unit, analyzing and extracting feature points of the photographed image, comparing the feature points of the acquired image / Contrast, and analyze the difference of feature points.

Further, information such as differences, tides, and troughs of tidal tides, that is, T-factors, which are time-varying marine information, is extracted and / or sensed, and the minutia information acquired in the database is corrected using the information . After this calibration process, the difference in feature points can be eliminated.

When the difference between the minutiae points is eliminated, the minutiae points of the photographed image and the minutiae points stored in the database coincide with each other, and the electronic chart and the touring chart information are superimposed on the photographed image.

This series of processes is a database of T-factors which is a change over time, and it is linked with existing three-dimensional database, and one dimension of time is added to implement a four-dimensional database. Accurate augmented reality information can be provided.

110 GPS
120 sensor unit
130 Camera section
140 display unit
150 control unit
160 communication section
170 input unit
180 databases
S110 Step of acquiring GPS information
S120 Obtaining the angle information of Roll, Pitch, Yaw, and Camera
S130 Calculate the position, posture,
S140 Obtaining the 3D coordinates by predicting the image taken by the boat from the database
S150 Obtaining image feature points by predicting the images photographed in the current ship from the database
S210 The step of acquiring the actual image from the camera unit
S220 analyzing the image feature point from the obtained image
S310: comparing the analyzed image feature point with the obtained image feature point
S320 obtaining the difference of the image from the compared feature points
Acquiring the S330 T-factor, and correcting the image feature point difference using the 4D database information
S340 extracting the electronic chart and the tournament chart information of the database from the corrected information
S400 Step of displaying the sperm whiteness and sightseeing chart superimposed on the photographed image

Claims (2)

delete In a method for providing an augmented reality in a passenger ship,
Obtaining GPS information;
Acquiring angle information of a position of the passenger ship, roll, pitch, yaw, and camera unit;
Calculating a position, a posture and a state in which the passenger ship is looking at the ship based on the obtained information;
Acquiring three-dimensional coordinates by predicting an image taken from a database based on the calculated information;
Predicting an image to be photographed on a current ship from a database to obtain image feature points;
Obtaining an actual image from the camera unit;
Analyzing image feature points from the acquired image;
Comparing the analyzed image feature points with the predicted image feature points and analyzing the differences;
Correcting the compared image feature points using information of a time database including difference, tidal current, and wave height information of the tidal trough varying with time;
Extracting the electronic chart and the tournament chart information of the database from the corrected image feature points;
And superimposing the electronic chart and the sightseeing chart on the photographed image;
Wherein the time database and the database are interlocked to form a four-dimensional database, and the four-dimensional database is used.

Images