KR20190073715A - Buoy monitoring terminal and method based on augmented reality - Google Patents

Abstract

The present invention provides a method for conveniently and quickly grasping a location of a buoy with augmented reality, and a terminal thereof. According to an embodiment of the present invention, the monitoring method of a buoy using augmented reality comprises the steps of: detecting location information of a terminal; reading metadata previously stored in the terminal based on the location information of the terminal; detecting the location information of a buoy matched with a buoy detection region in the read metadata; and displaying a buoy image and state information of the buoy corresponding to the location information of the buoy with a photograph image from the terminal.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a buoy monitoring method and a terminal using an augmented reality,

The present invention relates to a method for monitoring a sub-table and a terminal, and more particularly, to a method and a terminal for monitoring a state of a sub-table using augmented reality.

The first lighthouse in Korea was installed in 1903 in Palmi Island, Incheon, and the buoy was installed in 1908 in the Yalu River. Over the next 100 years, modernization of industry has been carried out, and a number of lighthouses and lighthouses have been installed and operated in trade ports, and more than 4,000 locations are operated according to the recent statistics of the Ministry of Maritime Affairs and Fisheries. In particular, about 1,776 buoys, including state and editorials, are operating in the area. (Etc.) The types of buoys have been diversified and 18 standard types have been established and managed. The installation usage has also diversified, and large induction light buoys (LANBY) and spa boats are installed and operated in major ports.

Of course, in order to manage such buoys, we have to maintain 400 to 500 ton buoy maintenance lines and maintain and manage buoys systematically in the East-West and South Sea regions. The management of the traffic sign facilities is being carried out. However, real-time monitoring of marine marking facilities (lighthouses, signposts, light buoy signs, etc.), which have a lot of difficulties on site inspection due to the effects of marine bad weather, is not easy and coastal waters in Korea are very long, , It is difficult to manage the marine marking facilities because the difference between the tide and the tide is large and there is a lot of shorelines. In addition, due to frequent seaways, marine marking facilities are not well recognized, which is a serious impediment to safe operation of ships. Recently, there has been developed a technology that displays status information on a marine marking facility on a terminal, but there is a limit in that marine marking facilities can not be accurately and conveniently detected on a terminal due to waves and winds.

In addition, technologies for receiving status information of marine labeling facilities from marine labeling facilities by installing various electronic devices and communication devices in marine labeling facilities have been developed, but the number of marine labeling facilities is so large that devices are applied to all marine labeling facilities There is an economical problem in that there is a problem that the maintenance of the marine labeling facility is weakened due to frequent breakdown or failure of the device due to environmental factors such as aging of the device in the marine labeling facility and marine environment .

Korean Registered Patent No. 10-1677039 B1

SUMMARY OF THE INVENTION It is an object of the present invention to provide a buoy monitoring method and terminal using an augmented reality capable of monitoring the state of a buoy in real time.

It is also an object of the present invention to provide a method and terminal capable of easily and quickly grasping the position of a buoy with an augmented reality.

It is also an object of the present invention to provide a method and a terminal which can conveniently and accurately monitor floating buoys in an environment where the flow is severe due to waves or winds like a ship.

It is another object of the present invention to provide a monitoring method of a buoy which can enhance the sustainability of buoy maintenance and economical efficiency by registering position information and status information of the buoy in advance without using a separate electronic device in the buoy, Terminal.

It is also an object of the present invention to provide a method and terminal capable of quickly ascertaining the position of a buoy and monitoring status information at a long distance without requiring the user to check it close to the buoy.

According to an embodiment of the present invention, Reading metadata previously stored in the terminal based on the location information of the terminal; Detecting positional information of a sub-tag matched with the sub-area detection area on the read meta data; And displaying the state information of the buoy image and the buoy corresponding to the position information of the buoy with the photographed image from the terminal.

In another aspect, the step of detecting the position information of the terminal comprises the steps of: detecting the position coordinates of the terminal; Determining whether the terminal is located at a reference angle; Guiding the terminal to be located at a reference angle; And detecting rotation angle and altitude information of the terminal. The method of monitoring a buoy using the augmented reality may also be provided.

In another aspect, the rotation angle includes a first rotation angle and a second rotation angle, and the step of detecting the position information of the terminal further comprises: detecting altitude information of the terminal, Wherein the angle and the first rotation angle are rotation angles of the terminal about a first axis perpendicular to the sea level and the second rotation angle is a rotation angle of the terminal about the second axis, It is also possible to provide a method of monitoring a buoy using an augmented reality which is a rotation angle.

In another aspect, the status information of the buoy is a monitoring method of the buoy using the augmented reality including the position information of the buoy, the installation date of the buoy, the type of the buoy, the coloring information of the buoy, .

According to another aspect of the present invention, there is provided a method of monitoring a buoy using an augmented reality, wherein the terminal is located on a vessel.

In another aspect, the method includes determining whether a second change in rotation angle or altitude of the terminal is detected within a predetermined range; And fixing the buoy detection area when the change amount is detected. The monitoring method of the buoy using the augmented reality may further comprise:

In yet another aspect, at least one memory for storing instructions; And at least one processor, wherein the instructions are executable by the processor to cause the processor to perform operations, the operations comprising: detecting location information of the terminal; Read metadata stored in advance in the terminal based on the location information of the terminal; Detecting positional information of a sub-table matching the sub-table detection area on the read meta data; Display state information of the buoy image and the buoy corresponding to the positional information of the buoy with the photographed image from the terminal; And a monitoring terminal of the buoy using the augmented reality.

The embodiment of the present invention enables the user to monitor the marine marking facility in the image photographed by the terminal and to check the marine marking facility in real time merely by changing the photographing area to provide a more convenient and efficient marine marking facility Maintenance and management.

In addition, the embodiment of the present invention is capable of real-time monitoring of the position of the marine labeling facility in real time regardless of various environmental factors such as seawater and wave height and the marine labeling facility being located far from the user's current position And to monitor status information of marine label facilities.

In addition, embodiments of the present invention can instantly reflect a user's area of interest and monitor marine labeling facilities within the area of interest.

In addition, the embodiment of the present invention makes it possible to precisely define a region of interest that is required to be monitored using the position coordinates of the terminal, not the position coordinates of the ship itself.

In addition, embodiments of the present invention allow a user to quickly identify whether a marine labeling facility is lost or not.

In addition, the embodiment of the present invention can accurately and quickly monitor the marine marking facility by eliminating environmental factors even if the photographing area continuously changes according to marine environmental factors.

1 is a schematic diagram of a buoy monitoring system using an augmented reality according to an embodiment of the present invention.
2 is an exemplary block diagram of a terminal.
3 is a flowchart illustrating a method of monitoring a buoy using an augmented reality according to an embodiment of the present invention.
4 is a schematic diagram of a method for setting a reference angle by matching a current line to a photographed image and a reference line on a display device.
5 is an exemplary view showing a photographing range according to a second rotation angle of the terminal.
FIG. 6 is an exemplary view of a front image displayed according to the photographing range of FIG. 5; FIG.
7 is an exemplary view showing state information of a buoy image and a buoy displayed on a photographed image.
8 is a flowchart illustrating a method of monitoring a buoy using an augmented reality according to another embodiment of the present invention.
Fig. 9 is an example of a case where a ship continuously flows due to a sea wave or the like.
10 is an exemplary view of a buoy detection area including position coordinates of a plurality of buoys on the meta data.
11 is an exemplary view of a buoy detection area including position coordinates of a plurality of buoys in accordance with a change in altitude rise or second rotation angle.
12 is an exemplary view of a buoy detection area including position coordinates of a plurality of buoys according to a change of a second descent angle or a second rotation angle;

BRIEF DESCRIPTION OF THE DRAWINGS The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. The effects and features of the present invention and methods of achieving them will be apparent with reference to the embodiments described in detail below with reference to the drawings. However, the present invention is not limited to the embodiments described below, but may be implemented in various forms. In the following embodiments, the terms first, second, and the like are used for the purpose of distinguishing one element from another element, not the limitative meaning. Also, the singular expressions include plural expressions unless the context clearly dictates otherwise. Also, the terms include, including, etc. mean that there is a feature, or element, recited in the specification and does not preclude the possibility that one or more other features or components may be added. Also, in the drawings, for convenience of explanation, the components may be exaggerated or reduced in size. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of explanation, and thus the present invention is not necessarily limited to those shown in the drawings.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or corresponding components throughout the drawings, and a duplicate description thereof will be omitted .

1 is a schematic diagram of a buoy monitoring system using an augmented reality according to an embodiment of the present invention. And Figure 2 is an exemplary block diagram of a buoy monitoring terminal using an augmented reality.

1 shows a marine vessel 1 and a marine vessel 2 and a user 3 aboard a marine vessel 2. The user 3 has a terminal 100. Also, the terminal 100 can detect its own location information using a Global Navigation Satellite System (GNSS) system.

The GNSS system is a satellite positioning system and can provide the position information of the terminal 100 using the GNSS satellite 4 which is orbiting the space orbit.

At least one buoy 200 may be installed in the sea 1. The buoy (200) is a navigation sign facility. Generally, a vessel (2) passing through a route for entry into a port of the port or a vessel (2) passing through a channel of a special watershed with a low depth must be sailing along a narrow and winding road or channel, , Especially at night, the risk becomes greater because the identification of routes and waterways becomes more difficult. Moreover, due to the urbanization of the port, dazzling lights such as neon signs can disturb seafarers' visibility, which can impede the identification of routes and waterways. In order to prevent such a risk, navigation marking facilities 200 arranged at regular intervals along routes or waterways are used to facilitate safe navigation of the ship 2 by facilitating the identification of the marine route and the waterway at night. The buoy 200 is a representative example of a lighted buoy, but not limited thereto.

The buoy 200 includes a lighting device, a position information sensing device for measuring the position through GPS, an operation state sensing device for sensing the operation state of the lighting device, a solar power generating device for generating electric power through solar cell power generation, But is not limited thereto.

In addition, the operation state detecting device of the buoy 200 periodically detects the state of the buoy 200 and / or periodically detects its own positional information and transmits the detected information to the terminal 100 and / To the facility management server.

1, the buoy 200 is provided around the ship 2, but this is merely an example. Depending on the position of the ship 2, the buoy 200 is connected to the ship 2, The buoy 200 may not be identified in the field of view of the user 3 aboard the vessel 2 and the buoy 200 may or may not be visible depending on the height of the wave .

1 is an axis parallel to the sea surface of the sea (1), and the Y axis is an axis perpendicular to the x axis. And the Z axis is an axis perpendicular to the X and Y axes, which is another axis parallel to the sea surface.

2, a terminal 100 may include one or more memories and one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) Or may be configured in various forms, such as separate logic circuits, software, hardware, firmware, or any combination thereof.

The memory includes instructions (e.g., executable instructions) such as computer readable instructions or processor readable instructions. The instructions may include one or more instructions executable by the computer, such as by each of the one or more processors.

For example, the one or more instructions may be used by one or more processors to perform operations, including processing location information of the terminal and processing the augmented reality video processing, etc., Lt; / RTI >

In addition, the terminal 100 is one or more computers or other electronic devices used by the user 3 to execute applications that perform various tasks. For example, a computer, a laptop computer, a smart phone, a mobile phone, a PDA, a tablet PC, or any other device operable to communicate with a web server. But not limited to, the terminal 100 includes processing logic that executes on various machines and interprets and executes instructions stored in the plurality of memories, and includes instructions for a graphical user interface (GUI) on an external input / And various other elements such as processes for displaying graphical information. In addition, the terminal 100 may be connected to an input device (e.g., a mouse, a keyboard, a touch sensitive surface, etc.) and an output device (e.g., a monitor, a screen, etc.).

More specifically, the terminal 100 may include a processor 110, a memory 120, a display device 130, a photographing device 140, a communication device 150, and a sensing device 160.

The display device 130 may be a liquid crystal display (LCD), a field emission display (FED), a plasma display panel (PDP), an electroluminescence device ) Method, an electrophoretic display method, and an organic light emitting diode display method, but the present invention is not limited thereto. In addition, the display device 130 may include a touch screen.

The communication device 150 may be any one or more of the following: technical standards or communication standards for wireless mobile communication (e.g., Global System for Mobile communications (GSM), Code Division Multi Access (CDMA), High Speed Downlink Packet Access (HSDPA) And can transmit and receive wireless signals to each other on a mobile communication network constructed according to a high speed uplink packet access (LTE), a long term evolution (LTE), a long term evolution (LTE)

In addition, the communication device 150 may be a wireless LAN (WLAN), a wireless fidelity (Wi-Fi), a wireless fidelity (WiFi), a digital living network (DLNA), a wireless broadband (WiBro) for Microwave Access), and LoRa communication, for example.

In addition, the communication device 150 can transmit and receive wireless signals using a short-range wireless communication method. For example, the communication unit may be a Bluetooth (registered trademark), an RFID (Radio Frequency Identification), an Infrared Data Association (IrDA), an Ultra Wideband (UWB), a ZigBee, a Near Field Communication -Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology.

In addition, the sensor device 160 may include at least one of an acceleration sensor, a gyro sensor, an altitude sensor, a pressure sensor, a temperature sensor, a compass sensor, a gravity sensor, and an angular velocity sensor.

3 is a flowchart illustrating a method of monitoring a buoy using an augmented reality according to an embodiment of the present invention. And FIG. 4 is a schematic diagram of a method of setting a reference angle by matching a current line to a photographed image and a reference line on a display device. And FIG. 5 is an exemplary view showing a photographing range according to the second rotation angle of the terminal. FIG. 6 is an exemplary view of a forward image displayed according to the shooting range of FIG. 5, and FIG. 7 is an exemplary view of a buoy image and a state information of a buoy displayed on the captured image.

Referring to FIG. 3, a method for monitoring a buoy using an augmented reality according to an exemplary embodiment of the present invention includes detecting terminal position information (S110), determining whether the terminal is located at a reference angle (S120) (S140) of detecting a first rotation angle of the terminal (S140), detecting altitude information and a second rotation angle of the terminal (S150) Detecting the position information (S160), and displaying the state information of the buoy image and the buoy in the shot image (S170).

The communication device 150 of the terminal 100 communicates with the GNSS satellite 4 to receive the location information of the GNSS satellite 4 in the terminal location information detection step S110 and the processor 110 transmits the location information of the terminal 100, Can be detected.

The terminal 100 drives the photographing apparatus 140 to display the image photographed from the photographing apparatus 140 on the display device 130 and judges whether the photographing is performed It is possible to display the preset reference line 9 in the image. The terminal 100 detects the first rotation angle information of the terminal 100 based on the sensing information of the sensing device 160 and displays the first rotation angle on the display device 130 in the form of the current line 8 can do.

Here, the first rotation angle indicates the rotation angle of the terminal about the Y axis in Fig. The preset reference line may be set as an angle formed by the virtual normal 7 on the X axis or the Z axis of the front surface of the display device 130 of the terminal 100 around the Y axis.

If the position of the current line 8 and the position of the reference line 9 do not match on the basis of the sensing information from the sensing device 160 in step S130 of deriving the reference angle position, An image in the form of an arrow indicating the movement of the line 8 can be displayed on the display device 130. [

The user can rotate the terminal 100 about the Y axis so that the position of the current line 8 is positioned on the reference line 9 and the position of the current line 8 and the position of the reference line 9 The terminal 100 is positioned at the reference angle. If the positions of the current line 8 and the reference line 9 coincide with each other, the processor 110 may display a message on the display device 130 indicating that the reference angle of the terminal has been set.

In step S140 of detecting the first rotation angle of the terminal, the user confirms the message of the completion of the reference angle setting displayed on the terminal 100, and then displays a message indicating that the terminal 100 To change the region to be photographed from the photographing apparatus 140. [0064]

In this case, the processor 110 may detect the first rotation angle information of the terminal 100 based on the continuous sensing information of the sensing device 160.

The processor 110 detects the altitude information and the second rotation angle information of the terminal 100 based on the continuous sensing information of the sensing device 160 in step S150 of detecting the altitude information and the second rotation angle of the terminal can do.

Here, the second rotation angle means an angle of rotation of the terminal about the X axis in FIG. 1, and an angle formed by a virtual normal line on the front surface of the display device of the terminal with the Y axis or the Z axis.

The processor 110 may read the metadata stored in the memory 120 in step S160 of detecting the positional information of the sub-table matching the sub-table detection area on the meta data.

The metadata may be map information having position coordinate information of the sub-pixels within the predetermined range of the range around the reference coordinates.

The processor 110 may read metadata matched with an area photographed on the photographing apparatus 140 based on the first and second rotation angle information and the altitude information among the metadata stored in the memory 120. [

The processor 110 transmits the position information of the terminal 100, the first and second rotation angle information, and the altitude information to the external server through the communication device 150, Metadata matching the information may also be received.

More specifically, referring to FIG. 5, the photographing range of the photographing apparatus 140 is changed according to the second rotation angle of the terminal 100. In addition, the photographing range of the photographing apparatus 140 varies depending on the first rotation angle and altitude information of the terminal 100.

The photographed image displayed on the display device 130 may be changed according to the photographing range shown in FIG. 5 as shown in FIG.

Therefore, the processor 110 detects the photographing area of the photographing apparatus 140 based on the first rotation angle, the second rotation angle, and the altitude information of the terminal 100. [ The processor 110 reads the metadata including the map of the area corresponding to the photographing area of the photographing apparatus 140 on the memory 120 and stores position coordinate information of at least one predetermined set of buoys on the read meta data .

Referring to FIG. 7 in step S170 of displaying the state information of the buoy image and the buoy in the photographed image, the processor 110 generates a virtual buoy in the currently displayed photographed image based on the position coordinate information detected on the meta data An image 201 (two-dimensional or three-dimensional form) can be displayed. The processor 110 may adjust the size of the buoy image 201 displayed according to the distance from the terminal 100 to display the buoy image 201. For example, a buoy image located at a remote location from the terminal 100 may be relatively small, and a buoy image located at a short distance may be relatively large.

In addition, the processor 110 may display the status information 202 of the corresponding buoy with the buoy image. However, the present invention is not limited thereto. When the user selects a buoy image (through touch detection or the like), the buoy status information corresponding to the selected buoy image may be displayed.

Here, the state information of the buoy may include position information of the buoy, date of installation of the buoy, type of buoy, coloring information of the buoy, information on the blinking method of the illumination device of the buoy, and the like.

In this way, the user can confirm the photographed image displayed on the terminal 100 to quickly change or confirm the region of interest, and the user can simply change the photographed region photographed through the photographing apparatus 140, It is possible to confirm and maintain the marine marking facilities in the real time.

In addition, depending on various environmental factors of the sea such as sea level and wave height, it is difficult to visually recognize a marine labeling facility such as the buoy 200, or even if the marine labeling facility is located remotely from the user's current location, The location of the marine labeling facility can be checked in real time and the status information of the marine labeling facility can be monitored.

It is also possible to determine whether to monitor the status information of all marine marking facilities on all omnidirectional areas of the terminal 100 or all the marine marking facilities within the omnidirectional area within a predetermined range by only the location coordinates of the terminal 100 It is difficult to display the marine labeling facility irrespective of the direction of the ship 2 or the user's area of interest, which is complicated and hinders the user from promptly monitoring the marine labeling facility. However, according to the embodiment of the present invention, not only the position coordinate information of the terminal 100 but also the rotation angle information and the altitude information of the terminal 100 are limited to the marine marking facilities in the photographing area, It is possible to monitor the marine labeling facility located in the user's area of interest conveniently and in real time.

When the terminal 100 receives the positional information of the ship 2 using the communication device of the ship 2 on which the terminal 100 is located, the shape and size of the ship 2 and the communication device The accurate position of the terminal 100 is not detected depending on the position of the terminal 100, and the shooting region is not accurately defined. Therefore, there may arise a problem that the marine labeling facility is monitored for the non-interest area, which is not the area to be monitored by the user. Therefore, the terminal 100 according to the embodiment detects the location information of the user through communication with the GNSS satellite, thereby enabling accurate definition of the photographing area, thereby enabling monitoring of the marine marking facility for the user's area of interest.

In addition, the embodiment can detect not only the first and second rotation angles of the terminal 100 but also the altitude information, so that the change in the photographing area according to the elevation of the terminal 100 can be reflected immediately. In the case of a very wide area such as the ocean, the monitoring area is greatly changed depending on where the shooting area is located, so that the embodiment can accurately and accurately reflect environmental factors to enable accurate definition and detection of the monitoring area.

In addition, the user can confirm the image captured through the display device 130 and the image of the buoy in the form of an augmented reality. Also, when the image of the actual buoy is included in the photographed image, the actual buoy image and the image of the augmented reality type buoy can be displayed as the overlapped image. Therefore, according to the embodiment of the present invention, when the buoy is lost due to various reasons, the user immediately recognizes that the image of the buoy not overlapped with the actual image of the buoy among the images of the buoy adjacent to the position of the terminal 100 is displayed . This allows the user to quickly determine that the actual buoy corresponding to the image of the buoy is missing.

8 is a flowchart illustrating a method of monitoring a buoy using an augmented reality according to another embodiment of the present invention. And Fig. 9 is an example of a case where the ship continuously flows due to a sea wave or the like. 10 is an exemplary view of a buoy detection area including position coordinates of a plurality of buoys on the meta data, and Fig. 11 is a diagram showing an example of a buoy detection area including position coordinates of a plurality of buoys FIG. 12 is an exemplary view of a buoy detection area including position coordinates of a plurality of buoys according to a change of the second descent angle or the second rotation angle.

Referring to FIG. 8, a method of monitoring a buoy using an augmented reality according to another embodiment of the present invention includes detecting terminal position information (S210), determining whether the terminal is located at a reference angle (S220) A step S230 of detecting a first rotation angle of the terminal, a step S250 of detecting the altitude information and a second rotation angle of the terminal, A step S260 of detecting whether a continuous change amount is detected within the sub region of the meta data, a step S270 of fixing the sub region detection region on the meta data, a step S280 of detecting position information of the sub- And displaying status information of the buoy image and the buoy in the video (S290).

More specifically, in the terminal position information detection step S210, the processor 110 may detect the position information of the terminal 100 using the sensing information of the sensing device 160 and the GNSS satellite 4. [

In the step S220 of determining whether the terminal is located at the reference angle, the processor 110 may determine whether the terminal 100 is located at the reference angle.

If the terminal is not located at the reference angle, the processor 110 determines whether the reference line according to the reference angle and the current line according to the second rotation angle of the current terminal 100 Each of these lines is displayed in the current captured image displayed on the display device 130 and an arrow image for movement of the current line is displayed to induce the user to change the first rotation angle of the terminal 100 .

In addition, the processor 110 may display on the display device 130 a reference angle setting completion message that the first rotation angle matches the reference angle when the first rotation angle of the terminal 100 coincides with the reference angle . Then, the user can photograph the corresponding area with the photographing apparatus 140 toward an area where the augmented reality with respect to the buoy, which is one of marine marking facilities, is desired to appear.

In this case, the first rotation angle of the terminal 100 may vary depending on the area the user wants to monitor. In step S240, the processor 110 may detect the first rotation angle of the terminal 110 again. In step S250, the processor 110 determines whether the altitude information of the terminal 110 and the altitude information of the terminal 110 based on the sensing information of the sensing device 160 of the terminal 110, 2 rotation angle information can be detected.

The processor 110 determines whether or not the altitude or the second rotation angle of the terminal 100 is higher or lower based on the sensing information of the sensing device 160 It can be determined whether or not the second rotation angle continuously changes within the preset range.

More specifically, referring to FIG. 9, when the ship 2 is continuously guided due to a wave or the like, for example, when the ship 2 repeatedly ascends and descends in the arrow direction, i.e., the Y axis direction, The terminal 100 held by the user who boarded the terminal 2 can also be repeatedly raised and lowered. In addition, when the ship 2 flows due to a wave or the like, such a flow is not very irregular but rather it repeatedly ascends and descends within a certain range and periodically raises and lowers with a certain error. Accordingly, the processor 110 can sense the upward and downward movement of the terminal 100 according to the movement of the ship 2 within the preset range based on the sensing information of the sensing device 160. [

In addition, in step S270 of fixing the buoy detection area on the meta data, the processor 110 determines whether or not the buoy detection area on the meta data has been changed based on the continuous change amount of the altitude or the second rotation angle of the terminal 100 in accordance with the up and down movement of the ship 2. [ The tag detection area 6 on the meta data can be fixed.

For example, referring to FIG. 10, position coordinates of a plurality of buoys may be detected on a map of meta data corresponding to a shooting region. When the photographing area rises in accordance with the elevation of the elevation or the change of the second rotation angle as shown in Fig. 11, part 6a of the position coordinates of the buoy shown in the photographing area of Fig. 10 is not detected. As shown in Fig. 12, when the photographing area is lowered in accordance with the descent of the altitude or the second rotation angle, not only part 6a of the position coordinates of the buoy shown in the photographing area of Fig. 10 is detected, The position coordinates of the unexamined buoy may be detected (6b).

In this case, the processor 110 calculates an average value in the amount of variation in the Y axis of the photographing area, and fixes the bucket detection area on the meta data corresponding to the photographing area (for example, the photographing area in Fig. 10) can do.

In step S280, the processor 110 detects the positional information of the sub-board matching the fixed sub-block detection area and detects the sub-image in the captured image and the sub- In step S290, the processor 110 may display the state information of the buoy image and the buoy in the current captured image.

According to another embodiment of the present invention, the terminal 100 detects the continuous change amount of the altitude or the second rotation angle, and fixes the photographing area with the average value of the change amount. This is because, as the shooting area continuously changes in response to the continuous change of the altitude or the second rotation angle, the phenomenon in which the marine marking facility is continuously changed within the shooting area is not a phenomenon desired by the user but is caused by environmental factors such as waves and wind. It is a phenomenon that users do not want due to flow. Accordingly, in order to prevent such a phenomenon, the present invention allows the user to monitor the marine marking facility in the photographing area by fixing the photographing area, thereby making it possible to accurately and quickly monitor the marine marking facility out of the environmental factors of the marine environment.

The method for monitoring a buoy using the augmented reality according to another embodiment of the present invention may further include a message display step for a buoy positioned within a predetermined range from a current position.

In step S160, the processor 110 determines, in the metadata read from the memory 120, the coordinate information of the buoys within the predetermined distance from the current position coordinates of the terminal 100, It is possible to detect the coordinate information of the buoys and display the proximity message information of the buoy for the buoys on the display device 130. [

Even if the buoy is close to the vessel, the buoy adjacent to the vessel may not be recognized depending on the sea level, the shape of the vessel, and the surrounding area of the area where the user is currently located. Accordingly, the embodiment of the present invention detects the position information of the sub-board close to the ship even in the metadata read by the processor 110 and displays the proximity message information so that the user can quickly grasp information on the sub-board close to the ship.

The embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be those specifically designed and configured for the present invention or may be those known and used by those skilled in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROM and DVD, magneto-optical media such as floptical disks, medium, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code, such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be modified into one or more software modules for performing the processing according to the present invention, and vice versa.

The specific acts described in the present invention are, by way of example, not intended to limit the scope of the invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of such systems may be omitted. Also, the connections or connecting members of the lines between the components shown in the figures are illustrative of functional connections and / or physical or circuit connections, which may be replaced or additionally provided by a variety of functional connections, physical Connection, or circuit connections. Also, unless explicitly mentioned, such as " essential ", " importantly ", etc., it may not be a necessary component for application of the present invention.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

Claims (7)

Detecting location information of the terminal;
Reading metadata previously stored in the terminal based on the location information of the terminal;
Detecting positional information of a sub-tag matched with the sub-area detection area on the read meta data; And
And displaying the state information of the buoy image and the buoy corresponding to the position information of the buoy with the photographed image from the terminal
A Monitoring Method of Buoys Using Augmented Reality. The method according to claim 1,
The step of detecting location information of the terminal comprises:
Detecting position coordinates of the terminal;
Determining whether the terminal is located at a reference angle;
Guiding the terminal to be located at a reference angle; And
And detecting rotation angle and altitude information of the terminal
A Monitoring Method of Buoys Using Augmented Reality. 3. The method of claim 2,
Wherein the rotation angle includes a first rotation angle and a second rotation angle,
Wherein the step of detecting the location information of the terminal comprises:
Detecting altitude information of the terminal,
Wherein the reference angle and the first rotation angle are rotation angles of the terminal about a first axis perpendicular to the sea surface,
Wherein the second rotation angle is a rotation angle of the terminal about a second axis that is horizontal to the sea level and perpendicular to the first axis
A Monitoring Method of Buoys Using Augmented Reality. The method according to claim 1,
The status information of the buoy includes information on the position of the buoy, the installation date of the buoy, the type of the buoy, the coloring information of the buoy,
A Monitoring Method of Buoys Using Augmented Reality. The method according to claim 1,
Characterized in that the terminal is located on a ship
A Monitoring Method of Buoys Using Augmented Reality. The method of claim 3,
Determining whether a second rotation angle or altitude of the terminal is continuously detected within a preset range; And
And fixing the buoy detection area when the amount of change is detected
A Monitoring Method of Buoys Using Augmented Reality. At least one memory for storing instructions; And
11. A terminal comprising: at least one processor,
The instructions being executable by the processor to cause the processor to perform operations,
The operations include:
Detecting location information of the terminal;
Read metadata stored in advance in the terminal based on the location information of the terminal;
Detecting positional information of a sub-table matching the sub-table detection area on the read meta data;
Display state information of the buoy image and the buoy corresponding to the positional information of the buoy with the photographed image from the terminal; Containing
Monitoring terminal of buoy using augmented reality.

Images