KR101259147B1 - Augmented reality mobile application showing past and future images by the location-based information - Google Patents

Abstract

The present invention relates to an augmented reality mobile application device showing a past and future image based on the location information, the use location confirmation unit 10 for confirming the use location of the mobile application; A service-specific execution unit 20 for providing a selected service to a mobile application user; It is composed of a service database 30 for each point of time for providing the corresponding data to the service execution unit 20, the existing national record image, historical information integration system, Korean history DB, blueprint DB, etc. By combining with the user's current location information, it shows the image of the past and the appearance of the completed building or area of the future, and makes it possible to keep the place specified by the current user as a memory for the future, By combining an app that provides an easy-to-use user interface experience with tourism and history education, the service market can be expanded by improving its usability and related DB that is already built based on the current location information of the app user. Multiple uses by combining the past and the future in the form of augmented reality It is possible to build a successful business model as a killer app, to provide realistic tourism information while providing realistic tourism information in the tourism industry, and to increase marketing effects for building investors. It is a useful invention.

Description

Augmented reality mobile application showing past and future images by the location-based information}

The present invention relates to a mobile application device, and more particularly, to the past based on location information showing the past and the future in the form of augmented reality by combining a related database that is built on the basis of the current location information of the app user. And it relates to an augmented reality mobile application device showing a future image.

Recently, the number of smartphone users in Korea is increasing rapidly, and the number and types of mobile applications are also growing quantitatively. Existing mobile applications developed at home and abroad are classified into education, language, life, games, and location, and have different purposes and characteristics. Among them, in case of location information application, a service is provided based on augmented reality, and the key to the provided service depends on how quickly and effectively providing the latest information in real time.

Accordingly, a variety of mobile applications have been developed for the purpose of providing convenience to users, including companies, public institutions, and individuals, and are currently under development. However, existing mobile applications are simply focused on providing interesting, single educational, or real-time information.

For example, educational and language-related applications provide content based on stored databases. Life and existing location-related applications also remain locating and guiding with GPS. This can be seen that existing applications provide functionality in limited circumstances.

In addition, some applications related to providing tourism and historical information in the ubiquitous environment have been released, but there are no mobile applications that can effectively combine tourism and history education based on augmented reality.

The present invention was invented to project the past and future images in augmented reality in view of the above situation, the purpose of which is the existing national record image, historical information integrated system, Korean history DB, blueprint DB of the planned building By combining with the user's current location information, such as the past image and video of the past and the appearance of the completed building or area of the future, to make the current user specified place as a memory for the future. It is to provide an augmented reality mobile application device showing the past and future images based on the location information.

Another object of the present invention is to show the past and future images based on location information that can expand the service market by improving the usability by combining the app that provides an easy-to-use user interface environment with tourism and history education. It is to provide augmented reality mobile applications.

Another object of the present invention is to build a successful business model as a killer app by securing a large number of users by showing the past and future appearance in the form of augmented reality by combining the relevant DB that is already built on the basis of the current location information of the app user Augmented reality showing past and future images based on location information that enables real time, and provides realistic tourism information while providing tourism information in the tourism industry, while also providing realistic historical education. It is to provide a mobile application device.

Augmented reality mobile application device showing a past and future image based on the present invention location information for achieving the above object comprises a use location confirmation unit 10 for confirming the use location of the mobile application; A service-specific execution unit 20 for providing a selected service to a mobile application user; Characterized in that the service database 30 for each unit of time providing the data to the execution unit 20 for each service.

The present invention utilizes the existing national record image, historical information integration system, Korean history DB, blueprint DB of the building to be built, etc. by combining with the current location information of the user and the completed building of the future or By combining apps with tourism and history education, apps that showcase the region, make it a place to keep memories of the places you specify, as memories for the future, and provide an easy-to-use user interface experience In addition to expanding the service market, the killer app can be secured by acquiring a large number of users by showing the past and future in augmented reality form by combining related DBs that have been built based on the current location information of the app users. To build a successful business model, While it can provide realistic tourism information, it can be combined with realistic history education, and has a particular advantage to increase the marketing effect for building investors.

1 is a block diagram of an augmented reality mobile application device showing a past and future image based on the present invention location information,
2 is a flow chart for each service provided by the augmented reality mobile application device showing a past and future image based on the present invention location information,
3 is an application execution screen according to the present invention;
4 is a login execution screen according to the present invention;
5 is a screen for attempting to access the main screen according to the present invention;
6 is a screen for outputting configuration error notification window according to the present invention;
7 is a main screen of an application according to the present invention;
8 is a driving screen according to the present invention;
9 is a viewpoint conversion screen according to the present invention;
10 is a location search implementation screen according to the present invention;
11 is a viewpoint implementation screen according to the present invention;
12 is an image conversion screen according to the present invention;
13 is a video conversion screen according to the present invention,
14 is a driving screen into history (past time) according to the present invention,
15A and 15B illustrate a future viewpoint conversion screen according to the present invention.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the augmented reality mobile application showing the past and future images based on the present invention location information.

1 is a block diagram of augmented reality mobile application device showing a past and future image based on the present invention location information, Figure 2 is a service providing augmented reality mobile application device showing a past and future image based on the present invention location information 3 is an application execution screen according to the present invention, FIG. 4 is a login execution screen according to the present invention, FIG. 5 is a screen for attempting to access the main screen according to the present invention, and FIG. 6 is an environment setting according to the present invention. Error notification window output screen, Figure 7 is the main screen of the application device according to the present invention, Figure 8 is a drive screen according to the present invention, Figure 9 is a viewpoint conversion screen according to the present invention, Figure 10 is a location search implementation according to the present invention Screen, FIG. 11 is a viewpoint implementation screen according to the present invention, FIG. 12 is a video conversion screen according to the present invention, FIG. 13 is a video conversion screen according to the present invention, 14 is a driving screen into the history (past view) according to the present invention, Figures 15a and 15b is a future viewpoint conversion screen according to the present invention, augmented reality mobile application showing the past and future images based on the present invention location information A use position checking unit 10 for checking a use position of the mobile application; A service-specific execution unit 20 for providing a selected service to a mobile application user; It is composed of a service database 30 for each unit of time providing the data to the execution unit 20 for each service.

The use position checking unit 10 and the automatic login unit 11 for the user to log in; ID / PW confirmation unit 12 for checking the user ID (ID) and password (PW); A network setting checking unit 13 for checking GPS and checking Wi or 3G; A location search unit 14 for searching a location by matching latitude and longitude address values; It is comprised by the positioning part 15 which confirms a position acceptance.

The service execution unit 20 may include a service providing area notification unit 21 informing of a service providing area; A main menu providing unit 22 for providing a main menu; A detailed menu providing unit 23 for providing a detailed menu; An inference engine operating unit (24, 24 ') for operating the inference engine in accordance with the detailed menu selected by the detailed menu providing unit (23); An associated database linking unit (25) for importing corresponding data from the service database (30) for each unit of time; A function execution unit 26 for executing a function according to the operation of the inference engine operation unit 24, 24 ′ and the associated database linkage unit 25; A function-specific output unit 27 for outputting a function executed by the function execution unit 26; It is composed of an output result storage unit 28 for storing the output of the function-specific output unit 27.

In addition, the service database 30 for each unit of time includes a database 31 of a past time; A database 32 at the present time; It consists of the database 33 of a future viewpoint.

Next, the operation of the augmented reality mobile application device showing the past and the future image based on the location information of the present invention configured as described above will be described in detail with reference to the flowchart for each service provided in FIG. 2.

Menus and functions of the augmented reality mobile application showing the past and future images based on the location information of the present invention as shown in Figures 1 and 2 largely "in history," "making memories", "into the future" Consists of. "Into History" is a function of converting to the past point of view, which can be seen in the form of augmented reality in the form of the historical buildings and streets and historical buildings and streets at the current user's location. "Create Memories" is a function that provides the current point of time, the user can save the memory for the future for the region and place specified by the user as the future for future output. "Into the Future" is a transformation to the future, providing the ability to preview the completed building or city at a certain distance from the user's location using the blueprints in the building database.

Execution of the augmented reality mobile application device showing the past and future images based on the location information of the present invention is the mobile application execution screen shown in Figure 3 when the application is first executed in step S1, the update of step S2 is automatically executed server Simultaneously update and update the database. At this time, if the patch is to output a separate notification text, the user login in the login screen shown in Figure 4 of step S3 and S4 to confirm the ID and password (PW). Then, as shown in FIG. 5 in steps S5 and S6, an attempt is made to access the main screen, and the search for the location of the user is terminated after the connection.

If there is an error in network connection and GPS setting in steps S5 and S6, an environment setting error notification window as shown in FIG. 6 is output.

Subsequently, when the menu required from the "in history", "make memories", "into the future" menus is selected on the application main screen shown in FIG. 7 of step S7, the selected menu is executed.

Into history (In the past)

In history, you can run Show Photo (DB: Historical Information Integrated System, Korean History Database) and Show Movie (DB: National Recorded Video, Historical Information Integrated System). Will be selected and executed.

Show Photo shows a street or a specific building on the screen to show the past (photo) of the time and point. The past is a black and white photograph from the 70's before the 70's, which is stored in the historical information integration system in the service database 30 and the Korean history database 31 per unit time point. Can be seen.

And Show Movie shows the past image of the time and point when the street or a specific building (ruins, cultural assets, buildings, etc.) is illuminated. The past video is a video of historical events of the time stored in the national record video and historical information integration system database 31 in the service database 30 for each point in time, and specific cultural properties are detailed video descriptions of the cultural property. Can be seen. Using the location of the cultural property registered on the server and your current location is sent a notification of the video download when less than a certain distance.

Create memories (current time)

Creating memories can be performed by Capture Movie and Show Movie. The menu can be selected by selecting the corresponding menu from the driving screen shown in FIG.

Capture Movie captures the area and events that user wants to keep as a photo or video and saves it in the main server for permanent storage. This function is implemented as a function to create memories for the future.

Show Movie is designed to allow you to see the memories you have forgotten in time and place again. The ability to view photos and videos is implemented in the same way as the Show Photo and Show Movie features of "Into History."

Into the future (future point)

By executing Show Photo (DB utilization: blueprint (development plan) of a specific area or building), the menu is selected from the operation screen shown in FIG.

Show Photo provides a function of previewing a completed building or city at a distance from a user's location by using a blueprint stored in the architectural database 33. At this time, by manipulating the blueprints in the architectural database can be converted to 3D pictures to experience a more realistic image.

In the driving screen of FIG. 8, [LIVE] is to drive a corresponding image when the view or image where the viewpoint can be converted is located, [CHANGE] is to convert a viewpoint to the past, present, and future, and [SAVE] is a server. It is to save the temporarily downloaded data in the mobile phone, and [MENU] is to set the environment such as location display.

In addition, the user recognizes that the image data of the past can be viewed with bright light in the [CHANGE] portion of the driving screen of FIG. 8.

In the viewpoint conversion screen illustrated in FIG. 9, the color screen on the upper left side shows a reduced view of the actual screen before the viewpoint conversion.

FIG. 10 is a screen for implementing a location search, in which a notification is received at [CHANGE] of the lower part of the screen when the specified location and the current location of the user who have the viewpoint conversion data are entered to each other within a specific range of distance. It is not operated when the user runs the app.

FIG. 11 is a view of a viewpoint implementation, in which a photo downloaded from a server is driven to a size larger than that of a conventional mobile phone, not adjusted to the size of a mobile phone. In other words, the picture is overlaid and output on the driven camera function.

FIG. 12 is an image conversion screen, and a corresponding function is driven by adjusting an angle of a camera in the viewpoint implementation screen of FIG. 11.

13 is a video conversion screen, the video playback is not a streaming video playback after connecting to the server provided in general, it is possible to significantly reduce the loading time of the user by directly connecting to the server homepage to play the video from the server. Will be.

14 is a driving screen into the history (past time), since the pictures downloaded from the server are temporarily opened and can be set to download them directly to the smartphone, thereby greatly reducing the loading time when the application is executed.

15A and 15B are screens for converting the future view, and a bright light comes into the [CHANGE] portion of the menu selection section at the bottom, so that the user exists at a position where the future information can be viewed in the corresponding area. The user can view the screen in augmented reality form when a specific building in the area is completed in the future. At this time, the small screen on the upper left shows the current real-time screen.

While the present invention has been described as a preferred embodiment, the present invention is not limited thereto, and various modifications can be made without departing from the gist of the invention.

10: use location check unit 11: automatic login unit
12: ID / PW check unit 13: network setting check unit
14: location search unit 15: location check unit
20: execution unit for each service 21: service provision area notification unit
22: main menu provider 23: detailed menu provider
24, 24 ': inference engine operation unit 25: related database interlocking unit
26: function execution unit 27: output unit for each function
28: output result storage unit 30: service database for each unit time
31: Database of past time 32: Database of current time
33: database of the future

Claims (4)

A use position checking unit 10 for checking a use position of the mobile application; A service-specific execution unit 20 for providing a selected service to a mobile application user; In the augmented reality mobile application device for showing the past and future images based on the location information consisting of the service database for each point of time providing the data to the execution unit 20 for each service;
The use position checking unit 10 and the automatic login unit 11 for the user to log in; ID / PW confirmation unit 12 for checking the user ID (ID) and password (PW); A network setting checking unit 13 for checking GPS and checking Wi or 3G; A location search unit 14 for searching a location by matching latitude and longitude address values; It consists of a positioning unit 15 for confirming the position permission;
The service execution unit 20 may include a service providing area notification unit 21 informing of a service providing area; A main menu providing unit 22 for providing a main menu; A detailed menu providing unit 23 for providing a detailed menu; An inference engine operating unit (24, 24 ') for operating the inference engine in accordance with the detailed menu selected by the detailed menu providing unit (23); An associated database linking unit (25) for importing corresponding data from the service database (30) for each unit of time; A function execution unit 26 for executing a function according to the operation of the inference engine operation unit 24, 24 ′ and the associated database linkage unit 25; A function-specific output unit 27 for outputting a function executed by the function execution unit 26; An output result storage unit 28 for storing the output of the function-specific output unit 27;
The unit time point service database 30 includes a database 31 of a past time point; A database 32 at the present time; Augmented reality mobile application device showing the past and future images based on the location information, characterized in that the database of the future view 33. delete delete delete

Images