KR101153127B1 - Apparatus of displaying geographic information in smart phone - Google Patents

Abstract

The present invention relates to a geographic information display apparatus of a smart phone, the wireless communication adapter for wireless communication network connection; A GPS module for obtaining coordinate values; A compass module for sensing azimuth and tilt; A camera module for capturing an image; A display module for displaying graphical data; And connecting to a server by a wireless communication method, transmitting coordinate values obtained by the GPS module to the server, receiving map data and additional data of a region corresponding to a predetermined range from the coordinate values, and enabling the camera module to be available. When the image displayed by the camera module is displayed in real time through the display module, the map data of the bearing obtained through the compass module is extracted based on the coordinate values obtained through the GPS module from the received map data. And a control unit for displaying in the background and overlaying additional information corresponding to a structure included in the map data displayed on the background in real time on an image displayed on the display module.

Description

Geographic information display device of smartphone {APPARATUS OF DISPLAYING GEOGRAPHIC INFORMATION IN SMART PHONE}

The present invention relates to an apparatus for overlaying and displaying additional information on a real feature displayed on a screen through a camera embedded in a smartphone.

The virtual reality technology that combines the real world that the user sees with the virtual world with additional information in one image has been studied since the 1960s.

This technique provides better realism mainly by mixing the real environment and virtual objects, but it is true that it is mainly used in areas such as remote medical diagnosis and broadcasting.

On the other hand, as smartphones have recently gained explosive popularity and have become widespread in a short time, there have been attempts to combine such smartphone platforms with conventional virtual reality technologies.

However, smartphones generally have only a small screen size of about 2 inches, which is a considerable limitation in the production of application applications.

Therefore, it was necessary to develop a new service that made full use of the characteristic hardware structure of the smartphone and focused on the fact that users always carry the smartphone.

The present invention has been made to solve the problems of the prior art, the smart phone that overcomes the small size of the smart phone by providing additional information in real time on the image reflected through the camera of the smart phone to provide a more realistic reality to the user The purpose of the present invention is to provide a geographic information display device.

The present invention for achieving the above object is a wireless communication adapter for wireless communication network connection; A GPS module for obtaining coordinate values; A compass module for sensing azimuth and tilt; A camera module for capturing an image; A display module for displaying graphical data; And connecting to a server by a wireless communication method, transmitting coordinate values obtained by the GPS module to the server, receiving map data and additional data of a region corresponding to a predetermined range from the coordinate values, and enabling the camera module to be available. When the image displayed by the camera module is displayed in real time through the display module, the map data of the bearing obtained through the compass module is extracted based on the coordinate values obtained through the GPS module from the received map data. And a control unit for displaying in the background and overlaying additional information corresponding to a structure included in the map data displayed on the background in real time on an image displayed on the display module.

According to the present invention as described above, while the features visible to the user is displayed on the screen at the same time, the additional information is displayed on the screen at the same time, the user is connected to the Internet using a smart phone to search for additional information It has the effect of being resolved.

In addition, by simply turning on the camera to illuminate the feature, you can intuitively know the location and direction of the feature you are looking for, such as a convenience store or restaurant, eliminating the hassle of running a map application with a smartphone. It works.

In addition, the netizens' evaluation of various features can be understood intuitively, and it is possible to immediately determine whether to use them when using various service providers offline.

Furthermore, by showing such additional information through a character, it is possible to obtain a realistic feeling such as directly listening to information from other netizens.

1 is a network diagram illustrating a structure in which a geographic information display device of a smart phone according to the present invention is connected to a server;
2 is a functional block diagram showing the configuration of a geographic information display apparatus for a smartphone according to the present invention;
3 is a reference diagram conceptually illustrating a process of displaying image and additional information displayed through a camera module in the foreground and map data in the background.
4 is an exemplary screen illustrating a state in which a character is overlaid and displayed on an image projected through a camera module.
5 is an exemplary screen illustrating a state in which a character is manipulated using a finger.
6 is an exemplary screen illustrating a state in which additional information is displayed through a character.

Hereinafter, a configuration of a geographic information display device of a smart phone according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a network diagram illustrating a structure in which a geographic information display device of a smart phone according to the present invention is connected to a server, and FIG. 2 is a functional block diagram illustrating a configuration of the geographic information display device of a smart phone according to the present invention.

The geographic information display device of the smart phone according to the present invention may be preferably implemented by combining a hardware component of the smart phone 100 as shown in FIG. 1, an operating system (OS) and applications.

In this case, the smart phone refers to a product that combines a function implemented in a conventional PDA (Personal Data Assistant) or the like with a mobile phone in accordance with the recent convergence trend, and generally refers to Windows Mobile or Windows Mobile. , Mobile phone with Android OS or iPhone OS.

The main features of these smartphones are firstly equipped with a GPS chipset to receive coordinate values directly from satellites or to calculate coordinate values through distance from a base station using a-GPS (Applied GPS) method. It is equipped with hardware components for the current location of the system. This is why the LBS (Location Based Service) using a smartphone is widely developed.

Second, it is possible to shoot still images or videos with a lens and a photosensitive sensor. The first reason for mounting the camera module is to make a video call using a 3G network.

Third, it is equipped with a wireless communication adapter of Wi-Fi, Bluetooth or CDMA. Basically, it is natural that a CDMA module is mounted to function as a mobile phone, but in addition, a Wi-Fi adapter is generally provided to reduce bandwidth and cost of communication.

On the other hand, the geographic information display device 100 of the smart phone of the present invention as shown in Figure 1 is a wireless communication adapter 110 for communicating by a general feature of the smart phone according to the prior art, that is, a wireless communication method, The GPS module 120 for acquiring the coordinates and the camera module 140 for capturing the image are provided.

The wireless communication adapter 110 allows the server 1 to be connected by any one or more of Wi-Fi, Bluetooth, or CDMA.

The GPS module 120 may receive coordinate values directly from the satellite, but may acquire its current coordinates by a conventionally known method such as a-GPS.

The camera module 140 is for photographing a still image or a video, and may be used as it is according to the prior art.

Meanwhile, as shown in FIG. 2, the geographic information display apparatus 100 of the smart phone of the present invention further includes a compass module 130, a display module 150, a controller 160, and a data storage unit 170. .

Compass module 130 is a sensor for detecting the orientation and tilt of the smartphone 100, may be implemented in combination of one or more conventional sensors.

The display module 150 is a device for visually displaying data such as organic light emitting diodes (OLEDs) or liquid crystal displays (LCDs), and is provided on the front of the smartphone 100 as shown in FIG. 1.

On the other hand, when the smart phone geographic information display device 100 of the present invention is connected to the server 1 by a wireless communication method through the wireless communication adapter 110, as shown in Figure 1, the GPS module 120 Transmit the current coordinate value obtained through the server (1).

The server 1 stores the map data and additional information corresponding to the structures included in the map data, and then maps the map data and the additional information adjacent to the received coordinate value to the wireless communication adapter 110 of the smart phone 100. To provide.

In this case, the map data is data representing the location of a feature such as a road, a building, a river, or a mountain on the earth's surface, and means that a location corresponding to a GPS coordinate value can be specified within the corresponding map data. It is not different from the one used on the site.

The side information is information related to various features included in the map data. For example, evaluations of netizens about food sold in a particular restaurant, menus and prices handled by a particular coffee shop, whether a particular building can be parked, There are no restrictions on the form of the mountain's cultural assets or attractions.

The structure refers to a feature in which the additional information may exist, such as a restaurant, a coffee shop, a building, and a mountain.

To this end, the server 1 must collect and store various additional information regarding structures belonging to the map data as well as map data according to the prior art.

Meanwhile, in the example of FIG. 1, the smartphone 100 transmits the GPS coordinate value to the server 1 by the wireless communication method, and indicates that the GPS coordinate value is received from the server 1 and received map data and additional information. However, the server 1 may not be a single server.

That is, since there is a service according to the related art that can receive map data on the Internet, the smart phone 100 is connected to the Internet network by a wireless communication method to receive map data, and is connected to a separate server 1 from this. It is also possible to receive and collect additional information corresponding to the GPS coordinate value.

On the other hand, the server 1 provides map data and additional information adjacent to the GPS coordinate value, wherein "nearby" corresponds to a certain range from the coordinate value, such as within a certain distance from the coordinate value or a certain area to which the coordinate value belongs. It refers to additional information of map data of a region and features belonging to the map data.

Meanwhile, when the camera module 140 becomes available, the smartphone geographic information display apparatus 100 of the present invention displays an image projected through the camera module 140 on the screen in real time through the display module 150.

That is, the image displayed through the camera module 140 is displayed on the screen as it is.

In addition, a feature that is visible in the field of view is extracted from the received map data based on the current GPS coordinates, and corresponds to the direction that the current camera module 140 is facing by using the azimuth value obtained through the compass module 130. Extract the map data again.

Extracting features visible in the field of view means selecting features that are connected by a straight line without being obscured by other features based on GPS coordinates from the map data, and can be processed by an algorithm for obtaining Z-order. .

And, this is displayed as a background on the screen, and if there are additional features included in the background displayed in the background, the additional information is overlaid and displayed in the foreground.

FIG. 3 conceptually illustrates this process. According to FIG. 3, an image projected through the camera module 140 is first displayed in the foreground, and the map data extracted through the above two steps is displayed as the background. (Ie, calculate and process the position on the screen to display the feature, but is not actually displayed on the screen), but only the additional information is displayed on the screen is overlaid on the position.

As a result, when the user holds the smartphone 100 and turns on the camera function to view various features that he sees with his eyes through the display screen, as shown in FIGS. 3 and 4, additional information about the features is displayed. You can experience what is shown in real time.

On the other hand, Figure 3 assumes that the angle formed by the camera module 140 from the ground is vertical, the user will be able to see the smartphone 100 tilted up or down. In this case, the smartphone 100 is a map displayed in the background when the angle formed by the camera module 140 from the ground is not vertical using the vertical tilt value of the smartphone 100 obtained through the compass module 130. The data is processed by moving up or down the display module by a corresponding angle.

Accordingly, even when the camera module 140 is inclined downward or upward at a predetermined angle, the image of the actual feature displayed on the screen and the location of the additional information corresponding to the feature may be displayed accurately.

On the other hand, the control unit 160 performs the above-described functions as a whole, such a function can be implemented by the organic combination of the chipset and operating system provided in the hardware of the smartphone 100, and the applications running on the operating system Therefore, the entity of the controller 160 will also be made of a combination of chipset, operating system, and application.

Meanwhile, in this embodiment of the present invention, the controller 160 analyzes an image obtained through the camera module 140 to further specify the features included in the image, as described in the above embodiment.

To this end, the apparatus further includes a data storage unit 170 for storing image data of a plurality of signboards, image data of a logo, or name text data. That is, the data storage unit 170 stores a sign of a restaurant or a coffee shop as image data, or stores a name of a building as text.

The controller 160 extracts a still image from the image obtained through the camera module 140, and the extracted still image includes the same image as the image stored in the data storage unit 170 or OCR (from the still image). It is possible to specify the feature included in the image by determining whether the same text as the text obtained by the Optical Character Recognition) is stored.

This is to compensate for inconsistencies when using map data that has not been updated.

Meanwhile, the third embodiment of the present invention animate and displays a character on the screen. FIG. 4 illustrates animating and displaying a character on a screen in addition to the above description.

To this end, it further includes a data storage unit 170 for storing the character animation data. The character animation data refers to graphic data for animating and displaying a character on a screen.

The controller 150 displays the image input through the camera module 140 in real time through the display module 150, and displays the character animation with additional information by overlaying it.

FIG. 5 illustrates an example of a screen for manipulating a character using a finger. According to FIG. 5, the camera module 140 is located at the rear of the display module 150, and a user moves his / her finger in front of the camera module 140. You can see that I'm putting it in.

In this case, as shown in FIG. 5, the user's finger is displayed on the screen, and the controller 160 analyzes the image and judges the user's finger when a long-colored long object appears near the focal length within 2-30 cm. can do. The focal length is very different from the background, and since the moving speed on the screen is much faster than the background when the frame is analyzed, it can be easily determined.

Meanwhile, when a finger touches a character displayed on the screen, the controller 150 processes an animation in which the character is pushed or bounced by the finger.

This is to create a simulation effect by allowing the character to move instead of moving the user directly between the features of the reality that the user actually sees, and at the same time, to make the character feel as if they are in reality and to have fun.

Four embodiments of the present invention visually convey additional information about the feature using such a character.

6 is an exemplary screen illustrating a state in which additional information is displayed through a character. As shown in FIG. 6, the controller 160 displays a character on the screen, further displays a speech bubble on the character and displays evaluations of netizens of the restaurant inside the speech bubble.

According to the prior art, it was possible to check the ratings of the netizens of the restaurant via the Internet, which allows the user to convey the ratings of the netizens in real time with respect to the actual features shown in FIG. 6. It will help you make decisions about features.

Meanwhile, the data storage unit 170 may further store character animation data, and may divide the animation data into categories.

For example, the character animation data may be stored by dividing it into a satisfied facial expression, a disappointed facial expression, a normal facial expression, and the like, and the controller 160 may determine which category among the additional information on a specific feature corresponds to satisfaction, disappointment, or normal. After the determination, the corresponding animation data can be extracted and displayed on the screen.

This has the effect that it is possible to deliver more intuitive information than the display of the netizens long on the screen on the small size smartphone 100.

While the present invention has been described with reference to several embodiments, these embodiments have been disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. This is to be construed as not departing from the scope of the following claims.

1: server
100: smart phone
110: wireless communication adapter 120: GPS module
130: compass module 140: camera module
150: display module 160: control unit
170: data storage unit

Claims (7)

A wireless communication adapter for wireless network connection;
A GPS module for obtaining coordinate values;
A compass module for sensing azimuth and tilt;
A camera module for capturing an image;
A display module for displaying graphical data; And
When connected to a server by a wireless communication method, the coordinate values acquired by the GPS module are transmitted to the server to receive map data and additional data of a region corresponding to a predetermined range from the coordinate values, and when the camera module is available. The image reflected by the camera module is displayed in real time through the display module, and the map data of the bearing obtained through the compass module is extracted based on the coordinate values obtained through the GPS module from the received map data. And a controller which displays in the background and overlays additional information corresponding to the structure included in the map data displayed on the background in real time on an image displayed on the display module.
The data storage unit stores the character animation data,
The controller overlays the character on an image displayed in real time through the display module using the character animation data, and analyzes the image reflected by the camera module to extend horizontally or vertically at a short distance within a predetermined distance. And analyzing the direction of movement of the object when the object is captured, and animate and display the overlaid character corresponding to the direction to display the geographic information display device of the smart phone.
delete delete delete delete The method of claim 1,
The control unit further displays a speech balloon shape on the character displayed by overlaying, and further displays additional information displayed through the display module inside or outside the speech balloon shape.
The method according to claim 6,
The controller determines whether the content of the additional information corresponds to any one of a plurality of preset categories, and displays the character by processing the animation to correspond to the determined category.

Images