KR102383284B1 - System for providing business fieldtrip service using metaverse - Google Patents

Abstract

Provided is a system for providing a business study trip service using metaverse. The system includes: a user terminal performing a trip tendency test and inputting a business profile, and then, receiving a character and a customized trip list corresponding to a trip tendency test result and the business profile, and selecting a desi red city and an itinerary from the customized trip list, and then, receiving a rule description and a tutorial video with a QR code, and guided through a trip with QR code recognition, AR interaction and quest fulfillment; and a study trip service providing server including a tendency storage part mapping and storing questions and answers in a trip tendency test for identifying at least one trip tendency, with the at least one trip tendency; a profile storage part mapping and storing a character and a customized trip list corresponding to the at least one trip tendency and a business profile, a setting part setting a process by storing at least one among at least one QR code, AR interaction, short-clip video, quest and AR visual novel, or at least one combination thereof in at least one city and the itinerary in accordance with a time-series sequence, and a control part controlling the user terminal such that the user terminal can be driven in accordance with the process when the user terminal selects the at least one city and the itinerary. Therefore, the present invention is capable of enabling users to share business ideas and make the ideas more plentiful.

Description

Business learning travel service providing system using metaverse {SYSTEM FOR PROVIDING BUSINESS FIELDTRIP SERVICE USING METAVERSE}

The present invention relates to a business learning travel service providing system using the metaverse, and provides a platform that can provide a customized travel itinerary for giving business insights based on the metaverse.

In the matter of choice, humans instinctively have a habit of prioritizing the minimization of investment costs and, conversely, maximization of the desired benefits. From the viewpoint of a travel destination and a travel guide, the satisfaction-seeking behavior, one of the instinctive habit of humans prioritizing profit in the selection behavior, novelty, historical and cultural characteristics, and interest of the travel destination can also be important variables, but the service provider travel The influence of the guide's attractiveness on tourism is likely to act as a variable as well. That is, when humans consider travel as a means of physical and psychological healing through escaping from daily life as part of their satisfaction-seeking behavior, satisfaction from the travel destination acts as an important variable, but also the role of the guide in visiting the destination is satisfactory. It can be predicted that the attractiveness of the guide will act as a variable of the travel destination. Because the tour guide is well aware of the local situation and has sufficient expertise in the destination, it is possible to be freed from worries about what to see at the destination by borrowing his expertise, and to minimize the risk and satisfaction of the choice. can increase the possibility of maximization of

At this time, a platform that provides a travel guide as a metaverse was researched and developed. March 21, 2016), receives travel information including the purpose of travel and travel destination from the user, identifies travel preferences through a survey, derives detailed travel destinations, creates virtual characters, and keeps track of travel progress According to the configuration, the character's appearance is transformed and displayed on the map based on AR, and travel information is provided as a quest to guide the trip in a game manner. Each configuration is disclosed to control so that it can be displayed on the user terminal.

However, in the former case of the above configuration, a real metaverse that can serve as a travel guide, selects a travel destination based on travel preferences, displays virtual characters on a map based on AR, and both real and unreal coexist. There are no possible interactions. Even in the latter case, if the action corresponding to the quest is performed, the game method of growing the character is transferred to the trip as it is, and there is no configuration to replace the travel guide. People who travel to awaken business insights often want a travel guide that will be helpful for their business, that is, their industry or career, but gathering itself as the gathering ban and social distancing are prolonged due to the recent corona virus. It is difficult for a tour guide to accompany you directly because the tour is prohibited or reluctant. Therefore, research and development of a platform that can enhance individual capabilities based on travel tendencies and business profiles or provide travel routes that can be helpful for business instead of travel guides based on metaverse is required.

An embodiment of the present invention defines a travel guide as a telecommunication company that plays the same role as a diplomatic mission in each country, provides a travel route that can be helpful according to the business profile in each telecommunication company terminal as content, and forms a database, and the user If you test your travel propensity and enter your business profile, you can receive a travel route that matches your travel propensity and broadens your business insights. By inputting, outputting and scanning the terminal, the route created by the travel guide can be given the same experience as the tour guide guides without a travel guide. It is possible to provide a method of providing a business learning travel service using metaverse that can be shared and enriched together. However, the technical task to be achieved by the present embodiment is not limited to the technical task as described above, and other technical tasks may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention receives a character and a customized travel list corresponding to the result of the travel orientation test and the business profile after performing a travel orientation test and inputting a business profile After selecting a desired city and itinerary from the customized travel list, a user terminal and at least one travel tendency receive a rule explanation and a tutorial video with a QR code, and receive a guide through QR code recognition, AR interaction, and quest execution A propensity storage unit for mapping and storing at least one travel propensity with questions and answers within the travel propensity test to determine , A setting unit that sets a process by storing at least one QR code, AR interaction, short clip image, quest, and a combination of at least one of a quest and an AR visual novel in at least one city and itinerary in time series order , It includes a learning travel service providing server including a control unit for controlling to be driven as a process when at least one city and the itinerary is selected in the user terminal.

According to any one of the above-described problem solving means of the present invention, a travel guide is defined as a communication company that plays the same role as a diplomatic mission of each country, and a travel route that can be helpful according to the business profile in each communication company terminal is provided as content When a user tests travel propensity and enters a business profile, he or she can be recommended a travel route that matches his or her travel propensity and can broaden business insights. , QR codes, etc. are input, output, and scanned with a user terminal, allowing the travel guide to provide the same experience as a travel guide guides without a travel guide as it is, and to share keywords in each attraction in the same industry. By allowing them to share their business ideas together, they can enrich it.

1 is a diagram for explaining a business learning travel service providing system using a metaverse according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a learning travel service providing server included in the system of FIG. 1 .
3 and 4 are diagrams for explaining an embodiment in which a business learning travel service using a metaverse according to an embodiment of the present invention is implemented.
5 is an operation flowchart illustrating a method of providing a business learning travel service using a metaverse according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement them. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated, and one or more other features However, it is to be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded in advance.

The terms "about", "substantially", etc. to the extent used throughout the specification are used in or close to the numerical value when manufacturing and material tolerances inherent in the stated meaning are presented, and are intended to enhance the understanding of the present invention. To help, precise or absolute figures are used to prevent unfair use by unconscionable infringers of the stated disclosure. As used throughout the specification of the present invention, the term "step of (to)" or "step of" does not mean "step for".

In this specification, a "part" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be implemented using two or more hardware, and two or more units may be implemented by one hardware. Meanwhile, '~ unit' is not limited to software or hardware, and '~ unit' may be configured to be in an addressable storage medium or to reproduce one or more processors. Thus, as an example, '~' denotes components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. The functions provided in the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, components and '~ units' may be implemented to play one or more CPUs in a device or secure multimedia card.

Some of the operations or functions described as being performed by the terminal, apparatus, or device in the present specification may be performed instead of by a server connected to the terminal, apparatus, or device. Similarly, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal means mapping or matching the terminal's unique number or personal identification information, which is the identification data of the terminal. can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining a business learning travel service providing system using a metaverse according to an embodiment of the present invention. Referring to FIG. 1 , the business learning travel service providing system 1 using the metaverse may include at least one user terminal 100 , a learning travel service providing server 300 , and at least one communication company terminal 400 . can However, since the business learning travel service providing system 1 using the metaverse of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1 .

At this time, each component of FIG. 1 is generally connected through a network (Network, 200). For example, as shown in FIG. 1 , at least one user terminal 100 may be connected to the learning travel service providing server 300 through the network 200 . In addition, the learning travel service providing server 300 may be connected to at least one user terminal 100 and at least one communication company terminal 400 through the network 200 . In addition, at least one communication company terminal 400 may be connected to the learning travel service providing server 300 through the network 200 .

Here, the network refers to a connection structure in which information exchange is possible between each node, such as a plurality of terminals and servers, and an example of such a network includes a local area network (LAN), a wide area network (WAN: Wide Area Network), the Internet (WWW: World Wide Web), wired and wireless data communication networks, telephone networks, wired and wireless television networks, and the like. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), 5th Generation Partnership Project (5GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi (Wi-Fi) , Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth (Bluetooth) network, NFC ( Near-Field Communication) networks, satellite broadcast networks, analog broadcast networks, Digital Multimedia Broadcasting (DMB) networks, and the like are included, but are not limited thereto.

In the following, the term at least one is defined as a term including the singular and the plural, and even if the at least one term does not exist, each element may exist in the singular or plural, and may mean the singular or plural. it will be self-evident In addition, that each component is provided in singular or plural may be changed according to embodiments.

The at least one user terminal 100 may be a terminal of a prospective traveler who wants to go on a business learning trip using a web page, an app page, a program or an application related to a business learning travel service using the metaverse. The user terminal 100 may be a terminal that performs a travel propensity test for travel and receives a matching travel list after inputting a business profile. The user terminal 100 outputs a tutorial and guide image when selecting any one travel country, city, etc. from the travel list, and outputs AR, VR, QR code, image, etc. in a preset order through output, input, scan, etc. It may be a terminal that proceeds the process according to the

Here, the at least one user terminal 100 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one user terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 100 is, for example, as a wireless communication device that guarantees portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

The learning travel service providing server 300 may be a server that provides a business learning travel service web page, an app page, a program, or an application using the metaverse. In addition, the learning travel service providing server 300 may be a server that registers a travel route and travel contents suitable for a business profile and travel tendency from at least one communication company terminal 400 and builds it as a database. In addition, the learning travel service providing server 300 may be a server that stores survey questions and answers for testing travel propensity to be mapped with each travel propensity, thereby deriving travel propensity according to the test result thereafter. And, the learning travel service providing server 300 analyzes the relationship between the business profile, the travel destination, and the travel route, and receives a feedback after the trip from the user terminal 100 to receive a travel destination or travel route from at least one communication company terminal 400 . It may be a server requesting change or maintenance of In addition, the learning travel service providing server 300 is a server that collects information such as travel destination introduction data or travel routes from at least one country, city, and institution in charge of attractions in order to enrich travel content corresponding to the business profile. can In addition, the learning travel service providing server 300 may be a server that stores information such as AR interaction for each branch or attraction, gives a quest through a QR code, or informs a rule, and turns it into a database. In addition, the learning travel service providing server 300 may be a server that sorts processes according to a time series order so that AR, VR, short-form images, etc. can be output according to each travel route.

Here, the learning travel service providing server 300 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop.

The at least one communication company terminal 400 may be a terminal of a travel guide using a web page, an app page, a program, or an application related to a business learning travel service using the metaverse. The communication company terminal 400 may be a terminal that collects information on business in each country and city, uploads it to the learning travel service providing server 300 , and generates travel content based on any one business profile keyword. For example, for those who work in a gallery or have a business profile of a gallery owner, in New York where there are many famous galleries and New School including Parsons, New York Museum of Modern Art->Metropolitan Museum of Art->Whitney Museum-> Guggenheim Museum -> Neue Gallery -> Brooklyn Museum -> Brown Enterprise in Soho -> Chelsea Gallery It may be a terminal that prepares a place to meet with or creates travel content to awaken business capabilities or give insight.

Here, the at least one communication company terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one communication company terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one carrier terminal 400, for example, as a wireless communication device that guarantees portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

2 is a block diagram illustrating a learning travel service providing server included in the system of FIG. 1, and FIGS. 3 and 4 are a business learning travel service implemented using a metaverse according to an embodiment of the present invention. It is a drawing for explaining an embodiment.

Referring to FIG. 2 , the learning travel service providing server 300 includes a propensity storage unit 310 , a profile storage unit 320 , a setting unit 330 , a control unit 340 , a floor recognition unit 350 , and association analysis. It may include a unit 360 , an insight extracting unit 370 , and a keyword providing unit 380 .

The learning travel service providing server 300 according to an embodiment of the present invention or another server (not shown) operating in conjunction with at least one user terminal 100 and at least one communication company terminal 400 uses the metaverse. When transmitting a business learning travel service application, program, app page, web page, etc., at least one user terminal 100 and at least one communication company terminal 400, the business learning travel service application, program, You can install or open app pages, web pages, and more. In addition, a service program may be driven in at least one user terminal 100 and at least one communication company terminal 400 by using a script executed in a web browser. Here, the web browser is a program that enables the use of a web (WWW: World Wide Web) service, and refers to a program that receives and displays hypertext written in HTML (Hyper Text Mark-up Language), for example, Netscape. , Explorer, Chrome, and the like. In addition, the application means an application on the terminal, for example, includes an app (App) executed in a mobile terminal (smartphone).

Referring to FIG. 2 , the propensity storage unit 310 may map and store at least one travel propensity with questions and answers in a travel propensity test for identifying at least one travel propensity.

The profile storage unit 320 may map and store a character and a customized travel list corresponding to at least one travel tendency and business profile. At this time, by using a mixture of collaborative filtering and content-based recommendation, [travel orientation-business profile-customized travel list] can be provided by supplementing the shortcomings of each technique. Collaborative filtering is a method of recommending items preferred by other users in the same set by classifying users into sets with similar tendencies based on the assumption that if they shared the same interests in the past, they will have similar tendencies in the future. In this method, the cold-start problem exists, in which the reliability of the recommendation of the initial user without information decreases because the performance improves as the user's evaluation information increases. However, it has the advantage that the diversity of recommendations is guaranteed. The content-based recommendation is a method of recommending items having properties similar to the user's preference properties, taking into account the correlation between products and products. This method can generate a recommendation result if only the item attribute information and the user's preference attribute information exist, but has a disadvantage in that the variety of recommendations is low.

Accordingly, in one embodiment of the present invention, two methods are mixed and used. In this case, Tour API public data can be used for content-based recommendation. After maintaining the Tour API travel destination information as a DB, the text of each travel destination description information can be converted into attribute information using the TF-IDF technique. Initial user preference attributes can be obtained by conducting a survey by presenting travel destinations by Tour API classification criteria at the time of initial membership registration, and recommendation results can be derived by calculating user attributes and travel destination attributes through cosine similarity. The next step is to construct collaborative filtering. When checking each travel destination information, the user evaluates the travel destination to obtain user evaluation information, and the degree of similarity between users can be derived by using the Pearson correlation coefficient. After that, similar users are clustered through the K-Nearest Neighbors (KNN) technique, and recommendation results can be derived using the similarity with users of the same set and the evaluation results of the current user.

Third, there is a mixture of results. For example, in content-based recommendation, high-ranking travel destinations with a similarity of X or higher are derived as a result, and in collaborative filtering, only trips whose evaluation information is expected to have a score of Y or higher can be derived as a result. Afterwards, by providing recommended travel destinations together at a certain rate, the Cold-Start Problem caused by no collaborative filtering recommendation results is supplemented by the content-based recommendation results, and the diversity of recommendations is supplemented by the collaborative filtering results to create complementary recommendation results. . The fourth is the derivation of travel routes. After obtaining a set of nearby destinations by clustering the derived recommended destinations through the K-Means Clustering technique based on the longitude and latitude coordinates of the destination and the total number of destinations, the travel route set is calculated by calculating the shortest route. can be obtained Clustered travel routes can be provided for the user to select, and DP (Dynamic Programming) technique and bit mask can be used to shorten the time when deriving the shortest route.

The setting unit 330 stores at least one QR code, AR interaction, short clip image, quest, and a combination of at least one among at least one city and itinerary in time series order. You can set the process. In this case, it may be developed like a process or a user scenario as shown in FIG. 3A, but it will of course be said that changes, additions, deletions, etc. are possible according to embodiments. At this time, a visual novel is a Japanese-style proto-English, and the story is arranged in text and pictures, the story diverges by choosing a middle option, and often contains a love element. It refers to a genre of games with these characteristics. In an embodiment of the present invention, the virtual character may be a visual novel. When a character suitable for the user is selected, it is output as an AR visual novel, and may serve as a guide to the user like a travel guide. In this case, each short clip image, travel route, AR effect, etc. may be continuously updated or changed together even when the content itself changes.

When at least one city and a journey are selected in the user terminal 100 , the controller 340 may control the user terminal 100 to operate according to a process. Accordingly, the user terminal 100 performs a travel orientation test and inputs a business profile, receives a travel orientation test result, a character corresponding to the business profile, and a customized travel list, and a desired city and journey among the customized travel list After selecting , you can receive rule explanations and tutorial videos with a QR code, and receive a travel guide through QR code recognition, AR interaction, and quest execution.

The floor recognition unit 350 may recognize the floor from the user terminal 100 before performing the AR interaction or AR visual novel to arrange AR content. At this time, a marker-based method that visualizes contents such as a 3D model, a single image, and an alpha image by tracing a predefined image or pattern, and a target image to track by extracting color, object or background features from the original image Although it can be divided into a markerless method used, since both methods have a common feature of tracking an object, so the term marker is used, the AR marker of the present invention is defined as including both methods.

Since AR markers directly affect the performance of object recognition and tracking, which are the main functions of AR, managing AR markers is an important factor in implementing and maintaining performance of AR systems. When using a natural image as an AR marker, AR marker recognition and tracking performance depending on when the distribution of objects in the image is concentrated in a specific area, when a repeating pattern such as texture is included, when a part of the image is lost due to lighting, etc. there may be a difference in Accordingly, in an embodiment of the present invention, a method of evaluating a marker by reflecting the distribution of objects (people, objects, nature, etc. included in the shooting screen) in the image and whether or not the repeating pattern is included through feature point analysis may be used. First, if an object is not evenly distributed over the entire image but concentrated in a part of the captured screen, it can become an AR marker that is vulnerable to occlusion. Available. In addition, the problem of finding a repeating pattern is that the distribution of the SIFT (Scale Invariant Feature Transform) descriptor of a general image can be approximated with a Gaussian distribution. It is possible to measure whether a repeating pattern is included.

First, feature points are detected using the SIFT technique. SIFT can extract feature points that are robust to changes in size, rotation, and lighting, etc. through processes such as scale space pole detection, feature point adjustment, direction information allocation, and feature point descriptor generation. The feature descriptor may divide 16×16 pixels around the feature point into 16 4×4 blocks, obtain a histogram in 8 directions for each block, and express it as a 128-dimensional vector. The more feature points with various descriptor vectors, the easier it is to track or recognize an object in an image, and since natural images usually include various feature points, excellent augmented reality performance can be exhibited when used as an AR marker. However, in an image having an object including an artificial and repeated pattern, such as a building, the descriptor vector representing the feature point represents the same or very similar value, so a misalignment problem occurs in the tracking or recognition process. Since an image including a large number of such descriptor vectors is inappropriate to be used as a marker, whether to use the descriptor vector may be determined based on the redundancy of the descriptor vector.

In addition, in the SIFT technique, it is possible to determine whether the feature points are evenly distributed throughout the image by obtaining the statistical characteristics of the position coordinates of the feature points that have undergone the feature point adjustment step, that is, variance. Objects are concentrated in some areas, so even a slight occlusion may lose most of the feature points, and augmented reality performance may deteriorate. Accordingly, a configuration for evaluating the marker according to the feature point distribution may be further executed. Among the statistical characteristics of the position coordinates of the feature points extracted by the SIFT technique, the effect of partial occlusion and noise of the marker image can be determined using variance and used as a marker evaluation factor. If objects are not evenly distributed throughout the image and are concentrated in some areas, the feature point coordinates have a low variance value, which means that many objects and feature points are highly likely to be lost due to occlusion in the x or y direction and are vulnerable to occlusion. It is an AR marker, so it is better not to select it. The reverse holds true as well.

If a repeating pattern exists, the feature points extracted by the SIFT technique, in particular, each component of the descriptor vector has overlapping or similar values. To check this, each descriptor vector needs to be compared, but the process of directly comparing 128-dimensional vectors is very inefficient. Accordingly, it is possible to obtain the effect of reducing the dimension by obtaining the average descriptor vector in the photographing screen and using the distance between each descriptor vector and the average descriptor vector. When looking at the histograms generated for various images including the repeating pattern image, it takes advantage of the fact that the general natural image shows a shape close to a Gaussian distribution, whereas the repetitive pattern image shows an unstructured shape. This is because the distance from the average descriptor vector shows a Gaussian distribution because the normal image has rich feature points composed of various elements, whereas in the repeating pattern image, many components of the descriptor vector are overlapped, so the distance from the average descriptor vector is dependent on a specific component. because it is focused. Accordingly, it is possible to evaluate the repeating pattern marker image by using the difference from the histogram distribution and the Gaussian distribution using the mean and variance as parameters.

When the AR marker is found in this way, it is possible to control the 3D subject and the 3D image to be output on the screen so as to be connected to the 2D subject and the 2D background screen. The floor recognition unit 350 must first determine the posture of the user terminal 100 , that is, at what angle the user is holding the mobile phone, and what is the distance from the subject included in the screen being photographed. To this end, the controller 330 may segment an object in an indoor space in three dimensions and estimate a three-dimensional posture. In this case, it is assumed that the indoor space projected on the screen consists of a plurality of flat structures. Based on this assumption, plane objects can be extracted from space using RANSAC (Random Sample Consensus)-based plane segmentation.

After the plane objects are extracted, the floor recognition unit 350 may obtain the plane model coefficient of the plane object constituting the indoor space, and the coordinates of the points constituting the plane. Assuming the relative arrangement environment of the camera and the indoor space in the extracted plane, the center point of the floor plane is located below the camera, and the angles of the camera's Up Vector and the normal vector of the floor plane are within the threshold range. , to find the floor plane. After finding the floor plane, the floor recognition unit 350 may classify the object area of the indoor space by using Euclidean clustering on a point cloud on the floor surface. Through this, an interaction between the real object and the virtual object is possible. In addition, a bounding box of a planar object may be extracted by using PCA (Principal Component Analysis) and MBR (Minimum Bounding Rectangle) for accurate three-dimensional posture estimation of a spatial structure, but is not limited thereto.

The association analysis unit 360 may analyze the degree of association between the at least one business profile and the at least one travel itinerary by using Association Rule Mining. The at least one communication company terminal 400 may generate and register at least one travel schedule corresponding to the at least one business profile. At this time, the association rule algorithm that performs association rule mining is one of the data mining analysis techniques. For example, it is an algorithm that reveals the correlation that a customer who bought product A is more likely to buy product B. It can be used when, and is to find the correlation rule between product A and product B. Using this, it is possible to know the probability that a person with a business profile of A will visit the city of B to improve their capabilities or to increase their business insights. In this case, the association analysis can be used to find the correlation of each item based on evaluation criteria such as support, reliability, and improvement. The support of the association rule evaluation means the ratio of purchasing A, B, and C together among all customers, and is defined as IF A & B THEN C = P(A∩B∩C). Confidence refers to the ratio of customers who purchased C among customers who purchased A and B, and is defined as IF A & B THEN C = P(A∩B∩C)/P(A∩B) . Lift is the value obtained by dividing the ratio of customers who purchased C out of customers who bought A and B by the ratio of customers who bought C out of all customers, IF A & B THEN C = P(C|A∩ It is defined as B)/P(C).

The insight extractor 370 may request to leave a keyword in a preset section while performing a process in the user terminal 100 and store the keyword as a log of the user terminal 100 for each travel itinerary. A lot of events happen quickly in travel, and if you come up with a flashy idea of where you were or what you did because of the accumulation of fatigue in your body, it is easy to let it go with your thoughts. Accordingly, by arranging the order in which keywords are written for each travel itinerary, the user does not miss the ideas or insights that he or she came up with in that country, city, or branch, so that he or she can bring them back to their home country and utilize them in their own business.

The keyword providing unit 380 may generate and output a word cloud after clustering at least one keyword written in the same travel destination in a plurality of user terminals 100 . In this case, the user terminal 100 may be a plurality of user terminals 100 belonging to different subjects. For example, if there are keywords D, E, and F indicating the results of user A, user B, and user C, who operate a hospital in Korea, visiting and experiencing hospitals in each country and city, it is defined as user A, B, and C. Keywords that are frequently used by many people are placed larger in the center, and keywords that are used less frequently can be placed smaller and farther from the center. At this time, you may be reluctant to share detailed know-how, but in the case of sharing keywords, you do not have to worry about your own know-how being disclosed because it is difficult to know the detailed know-how, but you can share your thoughts with others. You can get a glimpse of what people in the industry were thinking in each country, city, branch, etc., and you can get hints to get ideas.

Additionally, there may be cases where a human tour guide does not exist, and since the tour guide does not follow customers 24/7, the lack of information on each tourist can be provided using a chatbot. In the process, it provides fast and accurate information using an artificial intelligence chatbot, information sharing function between travelers, and information on nearby destinations for a specific designated area on the map, and can be configured so that users can use it usefully before and after the trip.

The chatbot may use an open domain chatbot or a close domain chatbot. First of all, in the case of open domain chatbots, most of the deep learning fields can be implemented by the end-to-end neural network machine translation method (Seq2Seq). Seq2Seq converts/translates one sentence into another. Just as the translator translates "I'm hungry" when the input "I'm hungry" is given, the chatbot Seq2Seq translates "I'm hungry" when the input is given, " Are you very hungry?" Translate as an answer, etc. If you look at a recently announced model such as Google's Meena, you can talk to a human at a close-to-human level by using a very large dataset and high-performance computing resources with just an end-to-end (Seq2Seq) model without a complex model architecture or learning framework. . A closed domain chatbot can be implemented in a slot filling method. Of course, there have been various attempts to implement the closed domain chatbot as an end to end like the open domain, but it is difficult to apply it to the field because it does not yield that level of performance when applied to other data sets (DSTC Dataset of Task6). Accordingly, in an embodiment of the present invention, it may be implemented by the existing slot filling method.

Hereinafter, an operation process according to the configuration of the learning travel service providing server of FIG. 2 will be described in detail with reference to FIGS. 3 and 4 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

3A illustrates a user scenario UI/UX according to an embodiment of the present invention. The corresponding screens are shown in FIGS. 4A to 4E . An embodiment of the present invention communicates with experts or consultants who have gone to learn advanced cultures of foreign countries or who have already lived in them, such as a communication company that served as a missionary to learn foreign cultures in the Joseon Dynasty, as shown in FIG. 3b. called sarah Referring to FIG. 3C , for example, if an associate professor at the University of Chicago who is famous for sociology is a Korean, this Korean may become a communication company in the field of sociology. Also, if there is a Korean who is building a school or a house in Africa, this person can become a news agency for people who want to do the Habitat project and is a person who can provide content. And if there is a doctor who does medical service in Syria, this doctor can become a news agency with skills in first aid during wartime. Also, if you run a restaurant in China or have a reporter covering the restaurant, this person can serve as a news agency for those who are going to enter China. In this way, when planning a trip by building a telecommunication company pool with people who have specialized fields in each country or who have knowledge and know-how in each country, and collect travel routes and contents from them, they conduct business while traveling. It can be of great help to those who want to start or You can get help even if you are doing business locally, and even if you bring it to Korea or change it, it has a competitive edge as a new item.

Accordingly, an embodiment of the present invention can achieve digital transformation by providing travel content using a mixed reality experience in a general learning trip where the number of people was limited as shown in FIG. 3D. In addition, as shown in FIG. 3E , it is a business learning trip that anyone with their own content in each country can lead, and a new alternative to the travel industry can be presented by using a big game that digitally connects reality and virtuality. Referring to FIG. 3F , an attempt may be made to transform from a package tour led by a certified travel guide to a business learning tour led by a telecommunication company with its own content. 3G is a view taken in the actual field.

Referring to Fig. 4a, when the application starts, sign up and log in, select a city while entering my travel orientation test (see Fig. 4f) and business profile, select a itinerary, view itinerary information and reviews, rules, etc. You will see a tutorial video to learn the . Referring to Figure 4b, when arriving at the place, the QR code is recognized to enter the main screen, and when arriving at the main place is confirmed, the QR code is recognized and AR interaction is performed as shown in Fig. 4c and the short clip image is viewed. After that, if you have completed the field mission, you will receive a quest completion stamp. In addition, as shown in FIG. 4D , keywords are left at a preset time point, place, or section for each country, city, and itinerary, and if the quest is completed, the main location is treated as completed. After moving to the sub-place, performing the mission as shown in FIG. 4E, and when the journey is completed, the person writes a feeling, concludes, and says goodbye.

The matters not described with respect to the method of providing the business learning travel service using the metaverse of FIGS. 2 to 4 are the same as or described above with respect to the method of providing the business learning travel service using the metaverse through FIG. 1 . Since it can be easily inferred from the contents, the following description will be omitted.

5 is a diagram illustrating a process in which data is transmitted/received between components included in the business learning travel service providing system using the metaverse of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process in which data is transmitted and received between each component will be described with reference to FIG. 5, but the present application is not limited to such an embodiment, and the example shown in FIG. 5 according to various embodiments described above will be described. It is apparent to those skilled in the art that the data transmission/reception process may be changed.

Referring to FIG. 5 , the learning travel service providing server maps and stores the questions and answers in the travel propensity test for understanding at least one travel propensity and at least one travel propensity (S5100), and at least one travel propensity and A character corresponding to the business profile and a customized travel list are mapped and stored (S5200).

The learning travel service providing server stores at least one QR code, AR interaction, short clip image, quest and AR visual novel, or a combination of at least one in time series order in at least one city and itinerary. A process is set (S5300), and when at least one city and itinerary is selected by the user terminal, the process is controlled to be driven (S5400).

The order between the above-described steps ( S5100 to S5400 ) is merely an example and is not limited thereto. That is, the order between the above-described steps ( S5100 to S5400 ) may be mutually changed, and some of these steps may be simultaneously executed or deleted.

The matters not described with respect to the method of providing the business learning travel service using the metaverse of FIG. 5 are the same as or described for the method of providing the business learning travel service using the metaverse through FIGS. 1 to 4 above. Since it can be easily inferred from the contents, the following description will be omitted.

The business learning travel service providing method using the metaverse according to the embodiment described with reference to FIG. 5 is also implemented in the form of a recording medium including instructions executable by a computer, such as an application or program module executed by a computer. can be Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The method of providing a business learning travel service using the metaverse according to an embodiment of the present invention described above is applied to an application basically installed in a terminal (which may include a program included in a platform or an operating system basically installed in the terminal). may be executed by the application store server, an application or an application (ie, a program) directly installed in the master terminal by a user through an application providing server such as a web server related to the application or the corresponding service. In this sense, the method for providing a business learning travel service using the metaverse according to an embodiment of the present invention described above is implemented as an application (ie, program) that is basically installed in a terminal or installed directly by a user, and is installed on a computer such as a terminal. It can be recorded on a readable recording medium.

The above description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be interpreted as being included in the scope of the present invention. do.

Claims (6)

After performing the travel propensity test and entering the business profile, receive the character and customized travel list corresponding to the travel propensity test result and business profile, select the desired city and itinerary from the customized travel list, and enter the rule ( Rule) A user terminal that receives explanations and tutorial videos, and guides travel through QR code recognition, AR interaction, and quest execution; and
A propensity storage unit for mapping and storing the at least one travel propensity with questions and answers in the travel propensity test for understanding at least one travel propensity, a character corresponding to the at least one travel propensity and business profile, and a customized travel list Profile storage unit for mapping and saving, at least one QR code, AR interaction, short clip image, quest, and AR visual novel (Visual Novel) or a combination of at least one stored in at least one city and itinerary in time series order a learning travel service providing server including a setting unit for setting a process by doing so, and a control unit for controlling to operate according to the process when at least one city and a journey are selected in the user terminal;
including,
The learning travel service providing server,
an insight extractor for requesting to leave a keyword in a preset section while performing the process in the user terminal, which is a plurality of user terminals belonging to different subjects, and storing the keyword as a log of the user terminal for each travel itinerary;
a keyword providing unit for generating and outputting a word cloud after clustering at least one keyword written in the same travel destination in the plurality of user terminals;
Business learning travel service providing system using metaverse, characterized in that it further comprises.
The method of claim 1,
The learning travel service providing server,
a floor recognition unit for recognizing a floor from the user terminal before performing the AR interaction or AR visual novel to arrange AR contents;
Business learning travel service providing system using metaverse, characterized in that it further comprises.
The method of claim 1,
The business learning travel service providing system using the metaverse,
at least one communication company terminal for generating and registering at least one travel schedule corresponding to at least one business profile;
Business learning travel service providing system using metaverse, characterized in that it further comprises.
4. The method of claim 3,
The learning travel service providing server,
an association analysis unit that analyzes the degree of association between the at least one business profile and the at least one travel itinerary by using Association Rule Mining;
Business learning travel service providing system using metaverse, characterized in that it further comprises.
delete delete

Images