KR102536983B1 - Method and system for providing AR-based advertising platform using GPS and barometric pressure - Google Patents

Abstract

The present invention relates to an AR-based advertising platform using location/altitude and atmospheric pressure, and more specifically, to a method and system for providing the AR-based advertising platform service using GPS and atmospheric pressure, wherein users can enter a specific building such as a store, shop, shopping mall, exhibition hall, etc. and check information about the place to visit using virtual 3D objects rather than general text-based information, and if detailed information is desired, a subscriber's location in the building is determined without requiring a location sensor (beacon) installed in the building, and then a virtual 3D object-type customized advertisement or promotional service corresponding to the location is provided. The present invention relates to technology for providing information to visitors, and more specifically, to the provision of a platform that introduces products (exhibits) of virtual 3D objects based on AR through promotional exhibits including menus of stores or restaurants, and allows ordering, payment, and reservations.

Description

Method and system for providing AR-based advertising platform using GPS and barometric pressure}

The present invention relates to an AR-based advertising platform using location/altitude and atmospheric pressure, and more particularly, when a user enters a specific building such as a store, store, shopping mall, or exhibition hall, information about a visited place is displayed rather than general text-oriented information. It can be checked using a virtual 3D object, and if detailed information is desired, a virtual 3D object-type customized advertisement or publicity service suitable for the location after figuring out the subscriber's location in the building without a location sensor (beacon) provided in the building It relates to a method and system for providing services of an AR-based advertising platform using GPS and barometric pressure. The present invention relates to a technology for providing information to visitors, and more particularly, to introduce products (exhibitions) of virtual 3D objects based on AR on promotional exhibits including menus of shops or restaurants, ordering and payment, reservations, etc. It's about providing a platform that makes this possible.

Recently, as mobile terminals and related technologies develop, types of services that can be provided by mobile terminals are also diversifying. That is, short message service (SMS) and wireless Internet service are provided in addition to voice call service, and each service is further subdivided according to a content providing method.

However, in the conventional location-based advertising service as described above, in a shopping mall or complex building composed of multiple stores in a large space with multiple floors, a special sensor (beacon) is used when a visitor is adjacent to the shopping mall or complex building and enters the building. If there is no, a problem arises that information cannot be provided.

In addition, until now, a system for paying for products provided by shopping malls or complex buildings using an internal pad or kiosk has been provided, but a service that allows direct reservation and payment of products while viewing AR information, a 3D object, is available within the building. Due to the nature of GPS, it was difficult to accurately determine the location of visitors.

Therefore, in order to determine the exact location of a visitor located in a building, it is necessary to develop a technology that can accurately determine the location information of a mobile terminal for each floor in a complex building without a separate device such as a beacon.

In addition, looking at the conventional location-based AR service in detail, most outdoor locations compare virtual data (3D models, etc.) In a building, when a location detector (beacon) using low-power Bluetooth communication is connected to a mobile terminal (smartphone), virtual data is retrieved and displayed from the server, but it is impossible to install beacons in all rooms in reality.

In addition, app-based AR (Augmented Virtuality) technology uses SDK (Software Development Kit) such as ARCore (Google), ARKit (Apple), and ARFoundation (Unity) for smartphones to show virtual 3D objects, but AR on the Web In order to implement, WebGL (Web Graphics Library) must be managed directly with JavaScript, so development is complicated and it is difficult to use unless you are a special expert. Numerous advertising platforms (blogs, SNS, apps, etc.) in use are common technologies, and have the disadvantage of lacking advertising differentiation for individual publicity agencies.

In addition, location information can be known by acquiring the latitude/longitude values of the smartphone's GPS, but if the publicity center is located on a different floor than the first floor, the accuracy of the location of the store is low, and the JavaScript required to implement AR when searching for image tracking is required. NFT (Natural Feature Tracking), which is an open source image tracking method of three.js, had a problem with a slow image search speed.

Republic of Korea Patent Publication No. 10-2020-0127563 Republic of Korea Patent Publication No. 10-2006-0029794

The present invention is to solve the above problems, and was invented to obtain accurate height and floor information without a location sensor (beacon) in a large complex building. Visitors looking for a multi-story complex building can more conveniently determine the location of the visitor's mobile terminal based on AR based on the description of the promotional materials (3D menu, 3D food, video, 3D exhibits, etc.) It is an object of the present invention to provide a method and system for realizing a platform that allows visitors to confirm and make reservations, orders, and payments by receiving information on virtual 3D object publicity or advertisements for a plurality of internal stores.

In addition, in general, 3D editors such as Unity and Blender should be used to create virtual data (3D models), but in the present invention, 3D models made in professional editors can be read and re-edited simply, and the edited information can be saved and By providing a viewer for viewing on the web and mobile, it is characterized by providing a WebAR editor that allows the general public to easily view virtual data and easily edit virtual 3D objects that the publicity agency wants to show.

A method and system for implementing a platform capable of promoting and advertising AR-based virtual 3D objects according to the present invention for achieving the above object is to edit content, which is an AR 3D object for promotion using a WebAR editor, and store it in a server step; Connecting content that is an AR 3D object for promotion with images, markers, QR codes, and world tracking; Compressing AR 3D object content size for promotion; accelerating (accelerating) the loading speed of AR 3D object content for promotion; Grasping the latitude/longitude and air pressure of the visitor's mobile terminal; calculating the number of floors in the visitor's building from the identified visitor's latitude/longitude and barometric pressure; It is to provide an AR-based advertising platform using GPS and air pressure, characterized in that it consists of; transmitting a 3D object advertisement of a publicity agency located on the calculated floor to a visitor's mobile terminal.

In addition, the platform system capable of publicizing and advertising a virtual 3D object of the present invention includes a PC in which a public relations manager edits a 3D object to provide publicity and advertisement of the 3D object; a calculation unit that calculates the number of floors of the visitor using latitude/longitude and air pressure values; The calculated number of floors and the number of floors closest to the system are compared to find the 3D object registered in the system, and the image/marker/QR code scanned with the camera of the mobile terminal and the image/marker/QR code registered in the server are tracked a comparison unit that compares information to identify customers; A processor that performs deep learning to improve the speed of finding image/marker tracking; a storage unit for storing information such as tracking, 3D objects, and analysis data; a processing unit that proceeds with an order/reservation/payment in conjunction with the storage unit; An analysis unit that analyzes the information of the processing unit; and an output unit that outputs a 3D object by editing, processing, and converting the 3D object provided by the PC; AR-based advertising platform using GPS and atmospheric pressure. As a system, the public relations manager directly edits AR into the web and provides 3D publicity objects as a web-based viewer to visitors using mobile terminals, so that various analyzes including logs through the web can be provided directly to the public relations manager. .

As described above, according to the method and system for providing a platform for advertising and publicity services based on AR using location/altitude and air pressure according to the present inventors, latitude/longitude, altitude and air pressure information may be utilized, WIFI SSID, image tracking Or, by accurately grasping location information using QR codes, visitors can receive virtual 3D object advertisements or publicity services for publicity centers near visitors without devices such as beacons according to changes in the indoor location of buildings such as large shopping malls and complex buildings. You can check the desired product, food, and exhibits in advance and make a reservation, order, or payment once the selection is complete, which has the effect of allowing visitors to quickly conduct transactions at the PR center.

In addition, by providing advertisement services selected according to the public relations department based on the information provided by the public relations department, there is an effect of providing only advertisement services for products and exhibits that the public relations department wants to introduce.

As described above, according to the embodiments of the present invention, by determining the location of the user's mobile terminal and providing information on advertisements or publicity materials at the location based on 3D AR, users can more conveniently move within a complex building. Descriptions of advertisements or promotions for individual spaces can be provided as virtual 3D objects.

In addition, in the present invention, without being close to the individual space (publicity office) of the complex building, it is possible to check the publicity center in the building and be introduced to the product of the publicity center as needed, and after checking the product, make a reservation, order, payment, and delivery (delivery of the product) Since it is possible to provide services up to, there is an effect that convenient product transactions are possible.

1 is a simplified diagram of the system of the present invention
2 is a service diagram of the present invention
3 is the editing screen of the WebAR editor
4 is an explanatory diagram of information that can be obtained from V-World's open API.
5 is a screen displayed on a visitor's mobile terminal for the edited AR object of the present invention
6 is a WIFI SSID information processing screen of the present invention
7 is a QR code processing screen of the present invention
8 is an image tracking processing screen of the present invention
9 is a flowchart for improving image search speed of the deep learning technique of the present invention
10 is a service flow chart of the present invention
11 is a service flow chart utilizing the QR code/image/marker of the present invention
12 is a flow chart for creating a 3D object of the present invention
13 is a system flow diagram of the present invention

Hereinafter, a method and system for providing an AR-based advertisement platform using latitude/longitude and atmospheric pressure according to an embodiment of the present invention will be described with reference to the accompanying drawings and preferred embodiments. As far as possible, the same reference numerals have been used for the same or similar components in the drawings.

First, in the present invention, in order to provide an AR-based advertising platform using latitude/longitude and air pressure, shops/stores, agencies, and individuals in large complex buildings can easily create and edit 3D objects for AR services. The WebAR editor that edits AR on the Web to provide AR service on the Web can be serviced only when the Graphic Library is developed in JavaScript on the Web in order to provide AR services on the Web. AR service is provided by providing connectivity with virtual 3D objects, images, markers, QR codes, and world tracking on the screen, and a function to convert 3D objects into html for service on the web is provided, so AR services are also provided on the homepage. 3D models, videos, images (photos), voices, etc., which are advertising contents, are provided to public relations departments using the WebAR editor to enable mobile terminals (smartphones, PCs, laptops, pads, glasses, goggles, etc.) ), it is output and displayed, and the content is provided so that the publicity agency can easily edit it in the desired direction so that AR object publicity is possible.

When the necessary promotional content is created using the WebAR editor, it is stored on the supply server, and when a visitor runs the app on a mobile terminal, the latitude/longitude is obtained using GPS using the API (Application Programming Interface) provided by the app, or on a laptop or pad. When the latitude/longitude of the visitor is obtained by obtaining the latitude/longitude with the API (Application Programming Interface) provided by the browser when the web browser is executed, the height and number of floors of the building within the complex building where the nearest visitor wants to enter V-World It is judged by the spatial information open API provided by For example, if the height of a building is 50 m and the number of floors in the building is 5, the height of each floor is 50/5 = 10 m, and the height of one floor may be calculated as 10 m. As described above, when the location of the visitor and the height of the complex building are identified using the latitude/longitude of the visitor mobile terminal and the open API, the height according to the absolute altitude is estimated from the air pressure value of the visitor mobile terminal, and then the nearest public relations office registered in the system ( Reservations, orders, and payments can be made by selectively checking AR-based promotional materials for each store included in the number of floors of the building).

If there is no barometric pressure value, you can check the PR center by using the latitude/longitude value and the WIFI SSID value. When you enter the PR center space in the world tracking method, the welcome greeting registered by the PR center (welcome song and virtual 3D fireworks display, etc.) and It is also possible to produce and edit various contents such as 3D objects and transmit them to AR viewers (app/web, etc.) to deliver to visitors. Even through the scanned QR code, the publicity department transmits the 3D object registered in the system so that it can be checked on the mobile terminal of the visitor. At this time, when scanning with a camera in a visitor's mobile terminal in various ways such as QR code/pattern/marker tracking, virtual 3D publicity and advertising objects can be transmitted to the user's terminal.

In addition, according to the image tracking method, when a menu or exhibition image is projected onto a camera, a 3D object for publicity registered in the system may be transmitted to a visitor's mobile terminal.

The specific method of calculating the indoor location of the public relations office and the visitor in the building above is to estimate the height according to the absolute altitude from the barometric pressure value of the visitor's mobile terminal. The absolute altitude calculation formula uses the pressure altitude ( ) function and the measured pressure P (mb ) and the pressure at the baseline (p0(mb)), the measured pressure (p) in hectopascals (hPa) and the pressure at sea level (p0) are calculated as absolute altitudes in meters using the formula of the international barometer can be calculated. (Calculate the sea pressure value for each nearby area as P0 with the Korea Meteorological Administration open API)

Therefore, it can be seen that the pressure change of Δp = 1 hPa corresponds to 8.43 m from the sea level. (When the atmospheric pressure changes by 1 hectopascal (hPa), the absolute altitude increases by 8.43 m)

The definition of words used in the above absolute altitude calculation formula is
P: Measured pressure (atmospheric pressure value of the mobile terminal)
P0: Ocean pressure by region (nearby sea level pressure, provided by Korea Meteorological Administration)
Absolute altitude: Value calculated from the above formula
Absolute topographic altitude: altitude above sea level at the location (provided by V World (Ministry of Land, Infrastructure and Transport)),
Total number of floors in the building (provided by V World (Ministry of Land, Infrastructure and Transport)),
Building relative height: Total building height (provided by V World (Ministry of Land, Infrastructure and Transport),
Actual number of floors of visitors = (absolute height - absolute terrain height) / (relative height of building / total number of floors)

More specifically, the relative altitude of the entire building, the absolute altitude, the absolute altitude of the terrain, and the total number of floors of the building are checked from the open API of V-World, the altitude of the building is identified as latitude/longitude, and the atmospheric pressure value is used to After obtaining the height according to the absolute height calculation formula of , by dividing the height of each floor by subtracting the absolute height of the topography, the exact number of floors where the visitor is located can be confirmed. You can check the exact location in the mobile terminal app by proceeding with the procedure for accurately confirming the location.

For example, if the air pressure of the user's mobile terminal is 1012.5 hPa, if the atmospheric pressure (p0) of the nearby sea level of the Korea Meteorological Administration is 1006.8 hPa (based on Incheon) and the measured air pressure (p) is 997.8 hPa, the absolute altitude measured according to the above formula is 79.9 m. = 44330*(1-(997.3/1006.8)^1/5.255),

If the terrain absolute altitude is 61.66m, the actual measured absolute altitude is 18.24m = (79.9 - 61.66).

At this time, the total number of floors of the building, which is the information obtained from V-World, is 15 floors, the relative altitude of the facility is 62.32m and the height of one floor is 4.15m, and the visitor can determine that he is on the 4th floor from the measured absolute altitude value of 18.24m. .

If the visitor's mobile terminal is not provided with the barometric pressure value as described above, as shown in FIGS. The user's location can be additionally confirmed by comparison, and even if the above WIFI SSID value and barometric pressure value cannot be obtained, the location can be confirmed by scanning the QR code provided by the publicity center or the image/marker registered in the system by the publicity center using the camera. It is possible and through this, a virtual 3D object can be provided to the visitor.

In the present invention, providing a WebAR editor for AR editing is to enable non-professional individuals, shop owners, and agencies to easily create and edit the content they want to promote on their own. ), voice, etc., from mobile terminals (smartphones, laptops, tablets, etc.) inside and outside buildings, easily connect virtual 3D objects, images, markers, QR codes, and world tracking methods, which cannot be done in the existing Blender editor. AR app viewer for smartphones so that AR services can be easily provided without a developer by providing a function to provide AR services and a function to convert 3D objects to html so that they can be serviced on the web, as well as to view virtual 3D objects on all types of mobile terminals. and a web viewer that can be viewed in a browser are provided in the present invention so that non-professionals can easily view AR-based promotional materials.

In addition, to compensate for the slow speed of Three.js' NFT (Natural Feature Tracking) image finding method, the OpenCV library was used to increase the image finding speed based on the CNN algorithm, an existing deep learning model. When viewing (items and exhibits to be promoted), various data are collected and analyzed, such as research on preferred products and whether or not preferred products are ordered, behavior patterns, potential customers, and demographics required for advertising/promotion/marketing based on the analyzed data Various analysis data, including marketing analysis related to public relations, such as , click-through rate and order rate, can be provided to visitors.

In addition, public relations agencies (individuals, shop owners, agencies, etc.) who want to promote can edit/save shop promotion and food/products/exhibits with WebAR editor, and then trade the stored virtual data online. Through such transactions, it was also intended to contribute to the vitalization and expansion of the domestic virtual content market in which virtual data such as AR and 3D models can be produced, distributed, consumed, and reproduced.

In addition, by utilizing the produced promotional content, more sophisticated targeting and analysis such as the number of active users and demographics as well as cross analysis between advertisements, advertising media analysis, and order conversion rate are utilized to determine the exact effect of advertising and promotion. It includes a function to analyze and display the analyzed performance so that it can be used for marketing by public relations agencies.

The above analysis data was differentiated from existing technologies by linking with existing portal companies such as Google, Naver, and Facebook to broaden their utilization and provide flexible I/F (Interface) such as API linkage.

In the present invention, individuals (students, beginners, etc.) who are interested in AR as curious customers can create virtual AR objects using the WebAR editor and share images and videos on SNS, and as personal promotional customers, their business cards It can be promoted by linking an introductory video or 3D modeling to the back, and as an educational customer, teachers or housewives can create AR content for education and use it for education. Not only can it provide a platform to customers to generate revenue, but as a one-person creator, individuals can use it for events and games, such as treasure hunt games, to create and share content to generate revenue, or as an individual editor, use the WebAR editor. Individual customers who perform editing agency, etc. or who want to generate revenue through AR platforms and individuals who want to generate revenue through AR platforms, etc., individually perform AR-based advertising content according to the customer's eye level. may also provide.

In particular, we provide a variety of functions that can be used for free for individual customers, or give a free usage period to use for online promotion and marketing (CPC, etc.) such as Naver (Power Link) and Google (Analytics) in the stabilization phase after the demonstration test. In addition, it provides compensation according to the inflow rate of contents created by individuals such as YouTube or Instagram, or SNS connection and friend recommendation function, so that it can be used for marketing. Promotion/marketing, using AR for products, providing videos or 3D AR manuals, or grafting AR on business cards to serve as sales assistants using media such as video, image, and 3D objects for sales materials It can also be used as a tool. The specific usage is described below.

1. Architecture/Interior: When scanned with a camera, the interior layout and changed appearance are provided.

2. Retail: Scan the QRCode or trademark to see product advantages and detailed explanations (including video, etc.)

3. Healthcare: Provision of medical information AR, etc.

4. Education: AR Lab, etc.

5. Fashion clothing: AR interlocking with T-shirt designs, etc.

6. Travel: Cyber guide AR interlocking with travel sites, etc.

7. Games: National treasure hunt, picture matching, AR hiding, etc.

8. E-Commerce: Introduction of AR products, etc.

9. Food: Link AR to menu, food price, introduction, etc.

Hereinafter, the present invention will be described in more detail with reference to the flowchart of the drawings.

In the service flow chart of FIG. 10, when a customer opens an app/web browser on a mobile terminal, latitude/longitude is collected from the location information providing server through an API from the app or web browser, and the location of the building is identified by latitude/longitude from the spatial information providing server. It obtains the number of floors and the height of the building, calculates the number of floors of the visitor with the barometric pressure and latitude/longitude of the visitor's smartphone from the WebAR system (server), finds the nearest latitude/longitude/floor number in the system, and selects an AR object of the world tracking method. By sending a virtual 3D object to the visitor's mobile terminal app/web browser, the promotional 3D object is provided on the screen, and then orders, reservations, and payments are made, and the order, reservation, and payment information is stored in the analysis log. do.

In addition, FIG. 11 shows a virtual publicity 3D object in the app and web browser of the visitor mobile terminal by scanning with the camera of the visitor mobile terminal using the image / marker / QR code tracking method provided by the public relations department when location information cannot be confirmed. After providing it on the screen, order, reservation, payment, etc. are proceeded. After saving the information such as order, reservation, payment, etc. in the analysis log, analyze publicity/advertisement, check the analysis result, and use the analysis result to promote The manager may modify the 3D object, and in FIGS. 10 and 11, various analyzes such as behavior patterns, potential customers, demographics, click-through rates, order rates, etc. may be provided, including Web logs that enable tracking of visitors to 3D promotional objects. .

Figure 9 shows that the PR manager selects the promotional object (3D model, logo, image, video, etc.) from the WebAR system (server) using the WebAR editor and selects the promotional object (3D model, logo, image, video, etc.) By selecting tracking methods such as marker, world, and QR code, and linking publicity objects and tracking from the AR rendering server of the WebAR system, the size of the virtual 3D publicity object is compressed, and the compressed information is stored in images and markers in the Deep Learning server of the WebAR system. It is possible to speed up the loading of virtual 3D promotional objects by processing artificial intelligence to improve the search speed of tracking.

Figure 12 describes the method of processing the above flow chart by using the system in terms of hardware. By using input devices such as keyboard, mouse, and pad for creating/editing 3D objects on the PC of the public relations manager of the public relations department, the public relations manager Increase speed through graphic control such as rendering (image generation), blending (object control), shading (illuminance control) and parallel processing of multiple 3D objects in the graphic processing unit of the PC, and promote operation control information such as vector/compression/decompression. The 3D objects in the stored memory are stored in the PC of the manager, and the 3D object information and tracking information converted through the graphic transmission conversion unit of the WebAR system are stored in the memory of the WebAR system through the network unit.

Figure 13 shows the above process as a whole.

In addition, in an embodiment of the present invention, in order to more conveniently provide information about various stores in a complex, a method for receiving information about products (promotional contents) of a desired store without being close to the store in the building is proposed. .

To this end, in an embodiment of the present invention, when a user enters a building, the user's location is determined, AR (Augmented Reality) objects associated with stores in the building are displayed on the visitor's mobile terminal, and AR for the product the visitor wants is displayed. Selecting an object provides a way to provide a description of that product.

1. AR-based promotional materials service system

2 is a schematic diagram of a service using 'AR-based latitude/longitude and barometric pressure values' according to an embodiment of the present invention.

As shown in FIG. 2, the product introduction system according to an embodiment of the present invention edits the contents of the public relations department's logo, image, 3D model, photo, video, QR code, etc. using the WebAR editor, and then sends the server The server secures the customer's location information entering the building, and the customer's smartphone, product (promotional content) guide app, and product guide server are connected and built to communicate with each other through a network.

The location information of the customer is the location information of the smartphone of the visitor who has visited the complex building, specifically, which store the visitor's smartphone is located in among the stores in the complex building. Afterwards, the product (promotional content) guidance app installed and executed on the visitor's smartphone works in conjunction with the product information server to provide the visitor with a description of the products related to the store where the visitor is currently located through the smartphone.

2. How to introduce each store's products

Hereinafter, a process of providing a description of products related to a store in a building will be described in detail through the service flows shown in FIGS. 2 and 11 .

In order to introduce products that the store in the building wants to promote, when a visitor enters the building, the latitude/longitude and atmospheric pressure of the visitor's smartphone are determined to introduce the store on each floor in the building where the customer is located. By displaying the products of each store on the phone, it is possible to selectively check the products to be promoted in the store.

If the latitude/longitude and barometric pressure information for the above complex building is not obtained, the store information of the customer's smartphone can be obtained by using the WIFI SSID information, logo, image, 3D model, photo, video, and QR code provided by the stores in the building. It is provided with accurate location information from the product guidance app that introduces, so that the customer can receive product-related content on their smartphone.

As an example of a publicity agency, one embodiment of the invention is described in detail through a restaurant as follows.

First, in order for the restaurant owner on the 3rd floor to edit a virtual 3D object with the WebAR editor, the restaurant owner first identifies the customer's movement and then creates a virtual 3D object using the WebAR editor according to the movement. First of all, when a customer enters the 1st floor of a complex building, they have to use an elevator or escalator to find a restaurant on the 3rd floor, so they provide directions through markers, images, and world tracking through latitude/longitude/barometric pressure so that they can find the elevator. When a 3D object with an arrow is registered in the editor, the direction is displayed according to the movement of the camera pointing at the customer, so that the customer can easily find the restaurant.

In addition, by utilizing QR code or image tracking, marker tracking, and world tracking function through latitude/longitude/barometric pressure at the entrance door and passage of the restaurant, the editor creates a colorful virtual 3D object according to the user's preference, Store owners can decorate virtual 3D objects with the WebAR editor so that they feel like they are entering an amusement park for children when they are decorated luxuriously or when there are many customers with their families.

Virtual 3D for customer welcome by combining world tracking through latitude/longitude/atmospheric pressure, image tracking, and marker tracking so that the storekeeper's welcome comment, video, and celebration burst when the entire hall is viewed through the camera of the mobile terminal upon entering the restaurant. By editing the object through the editor and showing it to customers, you can decorate it so that customers feel welcome when they enter the restaurant.

Register and edit introductory materials such as virtual 3D cooking objects and videos through the WebAR editor to provide vivid information about dishes when a dish in a restaurant menu is scanned with a mobile terminal based on image or QR code tracking method. 3D object is constructed by adding order and payment buttons to increase

All 3D objects, which are the strengths of the WebAR editor, are implemented in the web, so you can edit them to operate in the app or web browser by adding animation functions and buttons such as order, payment, and reservation.

Click through the virtual 3D object provided above through the AR viewer, the click rate, which is the number of times a customer clicks, and the payment rate based on how many orders are placed after clicking. Provide analysis tools.

In addition, promotion within the portal will be strengthened so that customers can better access the app to promote the restaurant and the AR viewer with web browser function.

In addition, customers who want to go to the restaurant to check the virtual 3D object through the AR viewer of the mobile terminal can download the AR viewer app from the restaurant promotion in the portal or obtain a URL to access the AR viewer web. Afterwards, when a customer opens the AR viewer on the mobile terminal's app/web browser within the building, a 3D object direction indicator arrow is displayed to help the customer find the restaurant. An arrow points in the direction towards the elevator to go up.

When you stand in the aisle or doorway of the restaurant and view it through the AR viewer, you can see luxuriously decorated virtual 3D objects around the restaurant entrance. Children enter the restaurant happily because they can see the object.

After entering the restaurant, through the AR viewer, you can see the restaurant's publicity, welcome, and 3D welcome objects such as fireworks that provide pleasure, allowing you to know the restaurant in more detail and provide joy with a pleasant welcome greeting.

When you scan a dish on a restaurant menu with a mobile terminal, you can see a vivid virtual 3D cooking object and video that steams enough to taste the dish by image or QR code tracking method, and press the order button to immediately order and pay. You can eat food by doing so, or you can eat pre-ordered or reserved food right away with your visit.

Claims (12)

delete In a platform system capable of promoting and advertising virtual 3D objects,
A PC including a WebAR editor capable of converting and displaying images, markers, QR codes, and world tracking methods of 3D objects edited by public relations managers into html to provide publicity and advertisement of 3D objects;
Absolute altitude calculation formula using latitude/longitude and barometric pressure

a calculation unit that calculates the actual number of floors of the visitor from information on the building's relative altitude, absolute altitude, terrain absolute altitude, and total number of floors in the building;
Compare the number of floors calculated above with the number of floors closest to the system to find 3D objects registered in the system or provide I/F (Interface) to portal companies including Google, Naver, and Facebook for publicity materials that are virtual 3D objects Comparison unit for checking the customer by comparing the scanned image / marker / QR code and the image / marker / QR code tracking information registered in the server to provide the analyzed data;
A processor that performs deep learning using the OpenCV library based on the CNN algorithm to improve the speed of finding images/marker tracking;
a storage unit for storing information such as tracking, 3D objects, and analysis data;
a processing unit that proceeds with an order/reservation/payment in conjunction with the storage unit;
An analysis unit that analyzes the information of the processing unit; and an output unit that outputs a 3D object by editing, processing, and converting the 3D object provided by the PC; AR-based advertising platform using GPS and atmospheric pressure. system.
delete delete delete delete delete delete delete According to claim 2,
The processing unit is an AR-based advertising platform system using GPS and air pressure, characterized in that online transactions are possible for content that is an AR 3D object for promotion.
delete According to claim 2,
The analysis unit utilizes GPS and air pressure to provide analysis on behavioral patterns, potential customers, demographics, click rates, and order rates, including web logs that can track visitors to 3D promotional objects in the public relations department. AR-based advertising platform system.

Images