KR102638351B1 - System for providing tour guide service using video call - Google Patents

Abstract

A travel guide service provision system using video calls is provided. When applying for a real-time guide, after selecting a country, region, and attraction, you receive a list of guides corresponding to the country, region, and attraction. Select a guide to request a guide, and if the request is accepted, register the user terminal to start the video call, countries, regions and attractions where the guide is available, register the available guide time, and then accept the request from the user terminal to the user terminal. A guide terminal connected to a video call, a guide register that registers guide experience, countries, regions, and attractions that can provide guidance from the guide terminal, a reception desk that receives applications for real-time guides from user terminals, and countries, regions, and attractions that apply for real-time guides on the user terminal. A transmission unit that extracts the list of registered guides and transmits them to the user terminal, a request unit that requests real-time guidance from the guide terminal of the guide selected by the user terminal, and if the guide terminal accepts the real-time guide, a video call is made between the user terminal and the guide terminal. It includes a guide service providing server including a connecting connection unit.

Description

Travel guide service provision system using video calls {SYSTEM FOR PROVIDING TOUR GUIDE SERVICE USING VIDEO CALL}

The present invention relates to a system for providing travel guide services using video calls, and provides a platform for connecting users who need real-time guides with guides who can provide real-time guidance through video calls.

In travel destination tourism, when you complete the entire travel itinerary on your own without anyone's help, you select a country and region, select flights and transportation to move between each region, hotels to stay in each region, and local attractions. Solving problems in the decision-making process, such as planning a tour itinerary, requires complex procedures, time, and effort. Despite these efforts and investments, it is not easy to access a sufficient and in-depth experience of the historicity or essential substance of the travel destination, and it is not easy to enjoy an experience that only appreciates the visible external parts and does not pass by storytelling. It's easy to take it away. Tourism without the help of a guide not only makes it difficult to gain meaningful access to the detailed hidden stories or history of a travel destination, but also falls short of gaining the substantive truth and deep value of the destination on your own.

At this time, a method of matching users and guides one-on-one or providing directions through video calls was researched and developed. In relation to this, the prior art, Korea Registered Patent No. 10-2110309 (announced on May 13, 2020) and Korea Patent No. Publication Patent No. 2019-0120122 (published on October 23, 2019) provides one-on-one matching between users and guides without going through a travel agency, and provides mutual evaluation as reviews between users and guides, and video calls during video calls. A configuration is disclosed in which location-based video data input on the screen is transmitted to the other terminal, and when instructional information for directions within the video data is received, the instructional information is transmitted to the user terminal for guidance.

However, in the former case, since it is a face-to-face guide, the work will be reduced for guides who are older and physically difficult to guide, and for guides who have idle time due to long waiting times, time will not be used efficiently. In the latter case, it only provides directions during a video call and does not provide a non-face-to-face travel guide. Accordingly, there is a need for research and development of a platform that provides a list of guides that can be connected in real time when the user needs it, and that can provide immediate guidance using video calls between the user and the guide when a guide that can be connected in real time exists.

In one embodiment of the present invention, when a guide is needed in real time on the user terminal, the country, region, and attraction where the user terminal is located is entered and a real-time guide is requested, and a list of guides that can guide the country, region, and attraction in real time is created. It is extracted and sent to the user terminal. If a guide is selected on the user terminal, the guide is requested from the guide terminal of the selected guide, and if the guide accepts it, the user can make a reservation by connecting between the guide terminal and the user terminal on the premise that payment has been completed. A travel guide service provision system using video calls that allows you to obtain a guide in real time without having to do anything, guides can use idle time effectively to increase sales, and can earn profits even when it is physically difficult to be a field guide. can be provided. However, the technical challenge that this embodiment aims to achieve is not limited to the technical challenges described above, and other technical challenges may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention provides, when applying for a real-time guide, selecting a country, region, and attraction, then receiving a guide list corresponding to the country, region, and attraction, and receiving a guide list corresponding to the country, region, and attraction. Request a guide by selecting a guide tagged with a guide available sign. If the request is accepted, the user terminal starts the video call, registers the countries, regions and attractions where the guide is available, registers the available guide time, and then requests the user terminal. If you accept, there is a guide terminal that connects to the user terminal through a video call, a guide register that registers guide experience, countries, regions, and attractions that can guide you from the guide terminal, a reception desk that receives applications for real-time guides from the user terminal, and a real-time guide that is sent to the user terminal. A transmission unit that extracts the list of guides with registered countries, regions, and attractions applied for and sends them to the user terminal; a request unit that requests real-time guidance to the guide terminal of the guide selected by the user terminal; and a user terminal when the guide terminal accepts the real-time guide. and a guide service providing server including a connection unit that connects the guide terminal through a video call.

According to one of the above-described means for solving the problem of the present invention, when a guide is needed in real time on the user terminal, the country, region, and attraction where the user terminal is located is inputted and a real-time guide is requested, and the country, region, and attraction are guided in real time. A list of available guides is extracted and sent to the user terminal. If a guide is selected on the user terminal, a guide is requested from the guide terminal of the selected guide, and if the guide accepts, a transaction is made between the guide terminal and the user terminal, assuming that payment has been completed. By connecting, users can get a guide in real time without making a reservation, and the guide can increase sales by making good use of idle time, and can make a profit even when it is physically difficult to be an on-site guide.

Figure 1 is a diagram for explaining a system for providing travel guide services using video calls according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a guide service providing server included in the system of FIG. 1.
Figures 3 and 4 are diagrams for explaining an embodiment of a travel guide service using a video call according to an embodiment of the present invention.
Figure 5 is an operation flowchart to explain a method of providing a travel guide service using a video call according to an embodiment of the present invention.

Below, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. However, the present invention may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, this does not mean excluding other components unless specifically stated to the contrary, but may further include other components, and one or more other features. It should be understood that it does not exclude in advance the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The terms "about", "substantially", etc. used throughout the specification are used to mean at or close to that value when manufacturing and material tolerances inherent in the stated meaning are presented, and are used to enhance the understanding of the present invention. Precise or absolute figures are used to assist in preventing unscrupulous infringers from taking unfair advantage of stated disclosures. The term “step of” or “step of” as used throughout the specification of the present invention does not mean “step for.”

In this specification, 'part' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Additionally, one unit may be realized using two or more pieces of hardware, and two or more units may be realized using one piece of hardware. Meanwhile, '~ part' is not limited to software or hardware, and '~ part' may be configured to reside in an addressable storage medium or may be configured to reproduce one or more processors. Therefore, as an example, '~ part' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and 'parts' may be combined into a smaller number of components and 'parts' or may be further separated into additional components and 'parts'. Additionally, components and 'parts' may be implemented to regenerate one or more CPUs within a device or a secure multimedia card.

In this specification, some of the operations or functions described as being performed by a terminal, apparatus, or device may instead be performed on a server connected to the terminal, apparatus, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal mean mapping or matching the terminal's unique number or personal identification information, which is identifying data of the terminal. It can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a diagram for explaining a system for providing travel guide services using video calls according to an embodiment of the present invention. Referring to FIG. 1, a travel guide service providing system 1 using a video call may include at least one user terminal 100, a guide service providing server 300, and at least one guide terminal 400. . However, since the travel guide service providing system 1 using video call shown in FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.

At this time, each component of FIG. 1 is generally connected through a network (Network, 200). For example, as shown in FIG. 1, at least one user terminal 100 may be connected to the guide service providing server 300 through the network 200. In addition, the guide service providing server 300 may be connected to at least one user terminal 100 and at least one guide terminal 400 through the network 200. Additionally, at least one guide terminal 400 may be connected to the guide service providing server 300 through the network 200.

Here, the network refers to a connection structure that allows information exchange between each node, such as a plurality of terminals and servers. Examples of such networks include a local area network (LAN) and a wide area network (WAN). Wide Area Network, Internet (WWW: World Wide Web), wired and wireless data communication network, telephone network, wired and wireless television communication network, etc. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), 5th Generation Partnership Project (5GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), and Wi-Fi. , Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth network, NFC ( It includes, but is not limited to, Near-Field Communication (Near-Field Communication) network, satellite broadcasting network, analog broadcasting network, and DMB (Digital Multimedia Broadcasting) network.

In the following, the term at least one is defined as a term including singular and plural, and even if the term at least one does not exist, each component may exist in singular or plural, and may mean singular or plural. This should be self-explanatory. In addition, whether each component is provided in singular or plural form may be changed depending on the embodiment.

At least one user terminal 100 requests a guide in real time using a web page, app page, program, or application related to a travel guide service using a video call, selects a guide, and when accepted, sends the guide terminal 400 and It may be a terminal of a user who is connected and making a video call.

Here, at least one user terminal 100 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one user terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 100 is, for example, a wireless communication device that guarantees portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

The guide service providing server 300 may be a server that provides a travel guide service web page, app page, program, or application using a video call. Additionally, the guide service providing server 300 may be a server that registers guide experience, country, region, and attractions from the guide terminal 400 to build a human resource pool. In addition, when the guide service providing server 300 requests a guide in real time from the user terminal 100, after registering the country, region, and attraction of the user terminal 100, the guide for the country, region, and attraction is provided. It may be a server that extracts possible guide terminals 400 and transmits them to the user terminal 100. And, when one guide terminal 400 is selected from the user terminal 100, the guide service providing server 300 requests real-time guidance from the selected guide terminal 400 and accepts the information from the guide terminal 400. In this case, it may be a server that connects the guide terminal 400 and the user terminal 100 through a video call in real time.

Here, the guide service providing server 300 may be implemented as a computer that can connect to a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc.

At least one guide terminal 400 may be a guide terminal that uses a web page, app page, program, or application related to a travel guide service using a video call. The guide terminal 400 registers guide experience, country, region, and attractions, and when a guide request is received from the guide service providing server 300, it communicates whether to accept it. If accepted, it makes a video call with the user terminal 100. It may be a terminal of a connected guide.

Here, at least one guide terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one guide terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one guide terminal 400 is, for example, a wireless communication device that ensures portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

Figure 2 is a block diagram for explaining the guide service providing server included in the system of Figure 1, and Figures 3 and 4 are an embodiment of a travel guide service using a video call according to an embodiment of the present invention. This is a drawing to explain.

Referring to Figure 2, the guide service providing server 300 includes a guide registration unit 310, a reception unit 320, a transmission unit 330, a request unit 340, a connection unit 350, a group guide unit 360, Payment management unit (370), location sharing unit (380), available resource check unit (390), guide linkage unit (391), AR guide unit (393), customized schedule (395), rejection unit (397), and mutual review It may include a management unit 399.

The guide service providing server 300 or another server (not shown) operating in conjunction with an embodiment of the present invention travels using a video call with at least one user terminal 100 and at least one guide terminal 400. When transmitting a guide service application, program, app page, web page, etc., at least one user terminal 100 and at least one guide terminal 400 are configured to transmit a travel guide service application, program, app page, etc. using a video call. You can install or open web pages, etc. Additionally, a service program may be run on at least one user terminal 100 and at least one guide terminal 400 using a script executed in a web browser. Here, a web browser is a program that allows the use of web (WWW: World Wide Web) services and refers to a program that receives and displays hypertext written in HTML (Hyper Text Mark-up Language), for example, Netscape. , Explorer, Chrome, etc. Additionally, an application refers to an application on a terminal and includes, for example, an app running on a mobile terminal (smartphone).

Referring to FIG. 2, the guide registration unit 310 can receive registration of guide experience, countries, regions, and attractions in which guides can be guided from the guide terminal 400. The guide terminal 400 can register countries, regions, and attractions that can be guided. For example, in order to explain the Uffizi Gallery in Florence, Italy, it must be a guide that can explain art history and art. Also, even in the same Florence area, guides explaining Ponte Vecchio, Florence Cathedral, Palazzo Vecchio, Piazza della Signoria, and Pitti Palace may be different. Accordingly, guides can register attractions that they can explain, even if they are not necessarily in the same region or country. For example, if Guide A majored in art history or art, in addition to [Italy-Florence-Uffizi Museum], [USA-New York-Metropolitan Museum], [USA-New York-Guggenheim Museum], [Spain-Madrid-Prado Museum], etc. You can register.

The reception unit 320 may receive a request for a real-time guide from the user terminal 100. For example, let's assume that a user wants to go to the Ephesus ruins in Selcuk, Turkey, but cannot book a tour in advance because there is no Korean-speaking guide, and the only tour available is an English guided tour. However, the Efes ruins in Selcuk are the largest ancient Roman ruins in Turkey, and as they are old, they are all worn out and collapsed, making it difficult to recognize their shape. A first-time visitor brought a travel book, but this stone looks like that stone, and he cannot tell which pile of stones is Greek or Roman. If you don't know whether this place is the Temple of Ephesus or the Church of the Virgin Mary, where the Aegean sea water entered, where the Agora market and square are, or which side of the port it is, then I can explain the Ephesus ruins right away. You may desperately need a guide. At this time, the user terminal 100 sets the country where it is currently located, Turkey (Turkiye), the region as Selcuk, and the attraction as Efes Ancient Roman Ruins to find a guide who can explain this place and is currently available as a guide. You can.

The transmission unit 330 may extract a guide list in which the country, region, and attraction for which the user terminal 100 applied for a real-time guide is registered and transmit it to the user terminal 100. When applying for a real-time guide, the user terminal 100 may select a country, region, and attraction and then receive a guide list corresponding to the country, region, and attraction.

The request unit 340 may request a real-time guide from the guide terminal 400 of the guide selected by the user terminal 100. If the guide terminal 400 registers the available guide time and then accepts the request from the user terminal 100, the guide terminal 400 may be connected to the user terminal 100 through a video call. The user terminal 100 selects a guide tagged with a guide available indication from the guide list and requests a guide, and if the request is accepted, a video call can be started. At this time, even if the guide is not available time, if the guide terminal 400 is connected to the platform of the present invention, it may be displayed as available time. However, since other schedules of the guide terminal 400 may exist, unavailable times rather than available times may be indicated. For example, assuming that a guide has a pre-booked schedule from 2 PM to 6 PM, he or she may register available schedules for 9 AM to 1 PM, 7 PM to 10 PM, etc.

The connection unit 350 may connect the user terminal 100 and the guide terminal 400 through a video call when the guide terminal 400 accepts the real-time guide. At this time, network information of the end of the user terminal 100 and the guide terminal 400 can be collected in real time, and the encoding rate can be set based on the network information. A typical Adaptive Bitrate Rate (ABR) streaming system provides real-time streaming by separating video into small time-unit files, encoding them at multiple resolutions, and allowing each user to transmit video according to changes in available network throughput, but ABR In order to prepare video in this format, the media server must transcode the video frames generated in real time, which inevitably causes a delay of several seconds or more, and the video is encoded at a predefined encoding rate without considering the user's network situation. Since it is encoded with a low latency, the quality has no choice but to be drastically lowered frequently.

Accordingly, in one embodiment of the present invention, a structure can be used in which the transmitter encodes real-time video at multiple encoding rates and transmits the encoded frames to the media server in segments (Group of Pictures, GoP). At this time, in order to be compatible with ABR streaming at the receiving end, the first frame of each segment is encoded as a key frame, and the media server stores the segment in the segment buffer and can deliver it upon request to the receiving end. If a segment is stored longer than the target delay time, the media server omits the previous segment for low-latency transmission. Through this structure, low-latency transmission without transcoding can be realized. In addition, the media server on the system can perform encoding and calculate an optimized encoding rate to maximize video quality. First, the media server estimates the available transmission amount collected from the receiving end, and clusters the estimated available transmission amount by the number of encoding rates through K-Means clustering. Finally, by determining the minimum value of the available transmission amount for each group as the encoding rate, it is possible to set an encoding rate that guarantees low-latency performance and optimized video quality.

Accordingly, a transmitter-based ABR encoding technique can be used to reduce the delay time caused by transcoding, and optimized video quality can be provided through encoding rate calculation that reflects the network situation of the receiver. As a result, the end-to-end delay time, which was several seconds, is guaranteed to be less than 500ms, which is essential for low-latency applications, while video quality can also be optimized in real time to suit the network conditions of multiple receivers. there is.

The group guide unit 360 is configured so that, when the user terminal 100 is a plurality of user terminals 100 belonging to a plurality of subjects, the image of the guide terminal 400 is transmitted to the plurality of user terminals 100. Communication may be provided, and an image of the user terminal 100 of a representative user selected as a representative among the plurality of user terminals 100 may be transmitted to the guide terminal 400. If you are not traveling alone, you will travel with your family or friends. If only User A's user terminal (100) is connected to the guide terminal (400), you will listen to the guide's voice coming from User A's user terminal (100). Because users B, C, D, and E, who went together, must put their ears to the speaker of user A's user terminal 100, they can only hear the guide explanation. Also, from the guide's point of view, explanations are only possible if you know where the user is and what they are looking at. However, if you receive the screens of all 5 users, it is not possible to determine where each user is looking, so you need to select only one user. A representative must be selected and provide an explanation based on the screen displayed on the user terminal 100 of the corresponding user.

Accordingly, when [guide-user] is connected [1:N], a channel is formed so that the guide's voice and video can be transmitted to all N users, and the user's video transmitted to the guide is transmitted to the representative user. You can create a channel so that only the video is delivered to the guide. At this time, if you are overseas and too much data usage is expected to be used for N Screen, you may be instructed in advance to have a hotspot, that is, a device such as a Wi-Fi Lunchbox or Wi-Fi Egg that can connect multiple people to the same network. In this case, when bundled into one network, communication for video calls is performed only between the user's user terminal 100 and the guide terminal 400, and between the representative user terminal 100 and other user terminals 100. You can also configure the network by sharing the screen to create an N screen. In this case, all tourists can listen to the guide at the same time, do not have to worry about data usage, and the guide does not have to receive all the videos provided by each tourist user, making non-face-to-face real-time guidance easier.

The payment management unit 370 may provide a guide amount when providing a guide list, and connect the user terminal 100 and the guide terminal 400 when payment is completed at the user terminal 100. At this time, if the guide requests payment in local currency, you can pay the guide fee using a credit card or overseas remittance service. However, in the case of overseas remittance services, even if a domestic bank does not charge a fee, the fee for going through an intermediate bank that connects overseas is at least $25, so the deposit can be deposited into the guide's Korean bank account. It is also possible to enable payment in local currency by allowing payment to be made on the platform of the present invention.

The location sharing unit 380 can receive the current location of the user terminal 100 using GPS, display the current location of the user terminal 100 on a map, and share the current location with the guide terminal 400 in real time. Since you need to know the current location of the user to know where you are, and because you need to know where you are to be able to explain, the location can be displayed on the map using information other than the video from the video call. Accordingly, the screen of the guide terminal 400 may display, for example, a real-time screen taken by the user on the right side and the user's location in 2D or 3D on the left side. Since the field of view of the screen captured by the user may be limited, like KT's Giga Eyes, a recent intelligent CCTV, it receives real-time screens of each tourist attraction or attraction and provides them as the guide's screen, allowing users to understand the current situation.

The available resource check unit 390 checks the remaining battery capacity and data remaining amount of the user terminal 100 before connecting to the guide terminal 400, and stops or connects the real-time guide if the remaining battery amount and data remaining amount are less than a preset reference value. Defects can be pointed out. Video calls cause significant battery consumption, and if the battery of the user terminal 100 is not sufficient for, for example, 2 hours of guidance or if the remaining data is not sufficient, guidance may be provided in advance. In the case of overseas when there is insufficient data remaining, only the speed is limited and no additional fees are paid, but in the case of domestic, excessive data usage is charged in proportion to the excess usage, so excessive charges may be incurred. The former may inform you that the speed will be slow, and the latter may inform you that you may be charged excessively.

The guide linkage unit 391 operates when the user terminal 100 is a plurality of user terminals 100 belonging to a plurality of entities and the remaining battery or data remaining amount of any one user terminal 100 is less than a preset reference value, Handover can be performed to connect a video call to another user terminal 100. At this time, handover means linking UE (User Equipment) so that it can be covered without interruption when linking UE (User Equipment) from each base station to another base station. However, in one embodiment of the present invention, when the remaining battery or data remaining is less than a preset reference value In this case, since the real-time guide linked through a video call may be disconnected, it is defined as linking the guide terminal 400 to another user terminal 100. For example, assume a situation where users A, B, C, D, and E exist and guide F is connected. It is assumed that guide F is watching the screen of user A as the representative user, and user A receives guide F's video (voice and video) and delivers it to users B, C, D, and E on screen N. At this time, when user A's battery begins to drop below 10%, the user terminal 100 with the maximum battery and data capacity among users B, C, D, and E is searched. At this time, if the user terminal 100 with the maximum available capacity is B, the screen of user B is delivered to guide F, and the image of guide F is received by user B and delivered to A, C, D, and E. Again, if user B's data capacity remains below 10%, the connection can be made in a rotating manner to find the user terminal 100 with the maximum data and battery capacity. At this time, users A, B, C, D, and E use data hotspots, such as Wi-Fi Lunchbox or Egg, to transmit data to users B, C, D, and E, but do not use data such as video calls. Assume. Of course, the data that user A transmits to users B, C, D, and E also requires data usage, so user A may transmit only voice to other users B, C, D, and E in order to minimize data usage.

The AR guide unit 393 provides a service that outputs AR guide content already built for the country, region, and attraction when there is no guide tagged with a guide available indicator after requesting a real-time guide from the user terminal 100. can do. At this time, even if the object is recognized through AR object recognition, in the case of the ancient Roman ruins mentioned above, there are many cases where there are no unique features to the point where it is difficult for a person to distinguish between each object, so it is difficult to distinguish between a blueberry muffin and a chihuahua. Artificial intelligence algorithms may be even more unable to distinguish. At this time, the guide terminal 400 associated with the user terminal 100 may add a method of discriminating in the form of a circle on the captured screen of the user terminal 100. In other words, objects that can be classified by artificial intelligence are displayed as AR content, and objects that cannot be distinguished can still be distinguished by drawing a picture on the user's capture screen at the guide terminal 400.

Here, while the user terminal 100 and the guide terminal 400 are connected, AR content is displayed on the screen of the user terminal 100. If image recognition is incorrect in the platform of the present invention, the AR content is displayed in the wrong place. However, by sharing this screen with the guide terminal 400, it is possible to check which part has an error. Initially, there may be a small number of areas where the guide points out errors, but over time, parts and objects where the guide commonly points out errors can be accumulated and extracted, and the errors pointed out by these guides are extracted and reflected in AR object recognition. The display accuracy of AR content can be improved.

When the user terminal 100 selects a country to travel to and requests a travel itinerary, the customized itinerary unit 395 transmits the travel itinerary to at least one guide terminal 400, and sends the travel itinerary and information from the at least one guide terminal 400. After receiving the quotation, the travel itinerary and quotation are delivered to the user terminal 100, and when one is selected, the user terminal 100 can be connected to the guide terminal 400 that created the selected travel itinerary and quotation. At this time, you can explain the quotation. For example, the price per person of travel agency A is higher than that of travel agency B. Is this because they use a 5-star hotel in the city center or because the seats on the plane are good seats, etc. This can explain the reasons for these differences and their differences. In addition, even if you go to the same tourist attraction B, a local guide will pick you up and explain the transportation to tourist attraction B and then drop you off, so you can also provide information on whether the price is higher or not.

Additionally, the custom schedule unit 395 can build an auction model using ABM (Agent Based Model) to simulate a competitive bidding market. At this time, the actor is the guide, that is, the bidder. ABM is a system modeling approach comprised of autonomous and interacting actors. Actors are established as constituents with key properties and behavioral rules in the system and are simulated to interact in a given environment. Within the auction system, economic entities make choices to maximize profits by considering the actions of competitors and their own attributes, and the results derived from these choices in turn affect the profits of each entity. Since direct interaction of actors in an auction system is a form of collusion, it is limited to situations where the results of other actors indirectly affect the winning bid result.

<Set bidder and bid price>

The price determination method for competitive bidding is a differential price method, which can be set so that the bid prices of bidders become the winning price. Therefore, it is reasonable for bidders to bid by adding a margin to their bid price. However, if you add too much margin, the probability of winning the bid will decrease, so you must consider an appropriate bid price.

Equation 1 uses an optimization algorithm to find the bid price that maximizes the expected profit by calculating the successful bidder's own expected profit. The successful bidder's expected profit π is calculated by multiplying the probability of winning the bid by the profit upon winning the bid. The probability of winning a bid is calculated using ordinal statistics. Assuming that the number of competitors excluding oneself in the auction is n-1 and the number of successful bidders is ns, the competitor with the ns lowest bid price among the n-1 competitors has his own bid price. It must be higher than b. The cumulative distribution function F is a bidder's assumption of the distribution of competitors' bids, and represents the probability that the competitor's bid price bj is lower than the bidder's bid price b. Therefore, 1-F(b) represents the probability that one's bid price is lower than that of competitors. The profit upon winning the bid is calculated by subtracting your business cost c from your bid price b. Using this, the guide can set his own bidding price and transmit the top N quotations that were successful in competitive bidding among the guide's quotations to the user terminal 100.

For users who find it difficult or burdensome to request a quote right away, the customized itinerary 395 may provide a method of allowing the user to directly select a Point of Interest (POI) and then automatically create a travel plan. If a detailed travel plan is needed after looking at the mechanically calculated travel plan, it can be used as a means to encourage the user to request a customized schedule (395) of the present invention, and the guide can also provide POIs to indicate which places the user already wants to go. Since we have figured it out through the travel plan and feedback from the travel plan described later, we can provide a more accurate and satisfactory travel itinerary and quotation.

<Travel planning based on user preference>

Based on user evaluations and users' preferences, a travel plan that fits the user's schedule can be modeled using a genetic algorithm. Genetic algorithm is a global optimization method that finds an optimized solution by imitating the principles of evolution in the natural world. The genetic algorithm first creates an initialized population of individuals with random values. In other words, a group of entities is formed by selecting N random points within the entire search space. The suitability of the population group created in this way to the problem is evaluated using a fitness function. The generation of the next generation is achieved through crossbreeding and mutation by stochastically selecting the evaluated population. The population of the next generation is evaluated again, and the next generation is repeatedly generated until the termination condition is reached, that is, the target fitness level is reached or the predetermined maximum number of evolutions is exceeded.

The Roulette Wheel Selection method is the most frequently used selection method. The overall roulette creates a roulette with a size equal to the sum of the fitness of each entity. Each chromosome is allocated a space on the roulette equal to its fitness. At this time, the object in the area selected by the pointer is selected, and the higher the fitness, the higher the probability of being selected as the parent solution. Elite Preserving Selection is a genetic algorithm selection method that passes the best years to the next generation. It is used to prevent excellent individuals from being lost when individuals are selected based on probability. It is usually used in conjunction with other selection methods. Uniform crossover is one of the crossover methods, and the combination of schemas appears more diverse than other crossover methods. Set the critical probability k, generate a random number r with the same domain as the length of the chromosome, and if r is greater than k, the gene of parent 1 is copied. Otherwise, the gene of parent 2 is copied. Non-Uniform Mutation is a method of mutation in which the intensity of mutation is strong at the beginning and then gradually decreases.

In one embodiment of the present invention, since the user inputs the POI, the process can be divided into three functions: user input function, modeling function, and evaluation function. The user input function is a function where the user inputs desired information into the system. Users enter information about their desired travel itinerary, such as travel itinerary and travel destination. The modeling function models and provides a travel plan based on the information previously entered by the user. At this time, a travel plan is modeled and provided through a genetic algorithm based on other users' evaluations of the travel location. The evaluation function is a function in which users who have completed a trip through a provided travel plan evaluate the plan. Users who have completed a trip complete the evaluation through four stages: overall trip evaluation, individual evaluation, information modification request, and travel destination recommendation.

<Initial object creation>

The initial entity is created from the travel destination entered by the user and the number of travel locations entered by the user. The length of the initial entity is initialized to the number of travel destinations entered by the user, and the genes of the initial entity consist of places belonging to the travel destination entered by the user, and are initialized to a random value. At this time, if there is a user-evaluated result, some objects are created through user-based collaborative filtering.

<Remove duplicates>

One embodiment of the present invention is based on not traveling to the same travel location. Therefore, after the mutation stage of the genetic algorithm, duplicates must be checked to ensure that the travel location is not included. If overlap is confirmed, the location is replaced with the location with the highest score among the locations that the chromosome does not have.

<Fitness function>

The fitness function is Equation 2 to calculate the time difference between the time entered by the user and the generated plan, Equation 3 with the results evaluated by users, and Equation 4 to calculate the time spent at the travel destination rather than the travel time during the travel process. divided into

In each equation, T is the total travel time entered by the user, N is the number of travel locations entered by the user, Si is the tourist time of places in the order of i, and M(i,i+1) is i and i+ The travel time between travel destinations in the order of 1, Gi, represents the score of the travel destination in the order of i. Finally, the fitness function becomes Equation 5, which has Equation 1 as the numerator and the product of Equation 3 and Equation 4 as the denominator.

Accordingly, the fitness function of the system according to an embodiment of the present invention converges to 0 as the fitness increases.

<User evaluation system>

User evaluation is divided into four stages: overall evaluation, individual evaluation, information modification request, and travel destination recommendation. The overall evaluation stage is where you enter your level of satisfaction with the overall travel plan proposed by the system. Users can enter their level of satisfaction with the proposed travel plan and enter the travel destinations they liked best or worst. Additionally, the system updates the score of the travel location in the database based on the satisfaction level entered by the user. The individual evaluation step is the step of entering the satisfaction level for each travel location among the travel plans provided by the system. Users can enter their satisfaction level for each travel location and write reasons for their satisfaction. Additionally, like the overall evaluation, the score of the travel location is updated based on the input satisfaction level. The information correction request step is a step to request correction of incorrect information among the information provided by the system. You can request modifications to various information, including travel location, transportation, travel time, and viewing time. The travel destination recommendation step is the step where the user enters the travel destinations he or she wants to add to the system. Users can make recommendations by entering the name, address, and viewing time of the travel location. If the travel destination entered in this way receives a certain number of recommendations, it is added to the travel destinations when modeling a new plan. At this time, in order to determine the suitability of the genetic algorithm, the results can be compared with Simulated Annealing and Taboo Search methods.

Through the genetic algorithm according to an embodiment of the present invention, travel plans optimized for users' schedules can be provided, and the time required for processes such as providing, modifying, and confirming quotations can be shortened. In addition, the most appropriate travel plan can be provided by considering users' evaluations, the time it takes to tour the travel destination, and the travel time between travel destinations. Through this system, users can receive recommendations for the travel route most suitable for them, so they can use a travel agency to conduct a simple yet satisfying trip that reflects the user's needs.

If the quote amount in the quotation is lower than the preset minimum quotation amount, the rejection unit 397 inquires whether the shopping schedule is included with the guide terminal 400, and if the shopping schedule is included, re-quotes the amount excluding the shopping schedule. You can request. For example, for a boat ticket from Kusadasi, Turkey to Samos Island, Greece, the wholesale price (lowest price) provided to the travel agency is $20, but if there is a quote with a lower price than $20, the shopping option is available. It is highly likely that this was included. Accordingly, if the user specifies that he or she does not want the shopping option, a shopping option query can be performed, and if the shopping option is included, the quotation can be rewritten.

The mutual review management unit 399 may collect, store, and accumulate mutual review data from the user terminal 100 and the guide terminal 400 after a video call between the user terminal 100 and the guide terminal 400. If the guide does not respond to the video call right away even though payment has been made, in one embodiment of the present invention, a separate penalty may be imposed by checking whether the guide is connected to the connection channel.

Hereinafter, the operation process according to the configuration of the guide service providing server of FIG. 2 described above will be described in detail using FIGS. 3 and 4 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

Referring to FIG. 3, (a) the guide service providing server 300 receives a real-time guide request from the user terminal 100, extracts a guide that can explain the attraction where the user is currently located, and transmits the request. And, (B) the guide service providing server 300 creates and connects a channel to enable real-time video calls between the user terminal 100 and the guide terminal 400, and the real-time video call of the user terminal 100 as shown in (c). By sharing the location, you can tell people which way to go and what kind of ruins are there. (d) The guide service providing server 300 can receive and accumulate mutual reviews after the guide is completed. In addition, when there are multiple user terminals 100 as shown in (a) of FIG. 4, by checking the battery and data capacity, the disadvantages of non-face-to-face communication, such as disconnection due to lack of battery or excessive data usage, are avoided. You can prevent a situation where more rain falls. In the case of a one-to-many connection as in (b), a representative terminal can be set to connect, and a guide explanation can be added along with the AR content as in (c). As shown in (d), comparative quotes can be provided to provide a customized travel itinerary, and competitive bidding between guides can also be conducted.

Matters that are not explained regarding the method of providing travel guide services using video calls in FIGS. 2 to 4 are the same as or are derived from the content previously described regarding the method of providing travel guide services using video calls in FIG. 1. Since it can be easily inferred, the description below will be omitted.

Figure 5 is a diagram illustrating a process in which data is transmitted and received between each component included in the travel guide service providing system using video call of Figure 1 according to an embodiment of the present invention. Hereinafter, an example of the process of transmitting and receiving data between each component will be described with reference to FIG. 5, but the present application is not limited to this embodiment, and the process shown in FIG. 5 according to the various embodiments described above It is obvious to those skilled in the art that the process of transmitting and receiving data can be changed.

Referring to FIG. 5, the guide service providing server receives guide experience, countries, regions and attractions available for guidance from the guide terminal (S5100), and receives a real-time guide request from the user terminal (S5200).

Then, the guide service providing server extracts a guide list registering the country, region, and attraction for which the user terminal applied for a real-time guide and transmits it to the user terminal (S5300).

In addition, the guide service providing server requests a real-time guide from the guide terminal of the guide selected by the user terminal (S5400), and if the guide terminal accepts the real-time guide, connects the user terminal and the guide terminal through a video call (S5500).

The sequence between the above-described steps (S5100 to S5500) is only an example and is not limited thereto. That is, the order between the above-described steps (S5100 to S5500) may be changed, and some of the steps may be executed simultaneously or deleted.

Matters that are not explained regarding the method of providing travel guide services using video calls in Figure 5 are the same as or are derived from the information previously described regarding the method of providing travel guide services using video calls in Figures 1 to 4. Since it can be easily inferred, the description below will be omitted.

The method of providing a travel guide service using a video call according to an embodiment described in FIG. 5 may also be implemented in the form of a recording medium containing instructions executable by a computer, such as an application or program module executed by a computer. You can. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and non-volatile media, removable and non-removable media. Additionally, computer-readable media may include all computer storage media. Computer storage media includes both volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.

The method of providing a travel guide service using a video call according to an embodiment of the present invention described above is performed by an application installed by default on the terminal (this may include programs included in the platform or operating system, etc., installed by default on the terminal). It may be executed by an application (i.e., a program) installed by the user directly on the master terminal through an application providing server such as an application store server, an application, or a web server related to the service. In this sense, the method of providing a travel guide service using a video call according to an embodiment of the present invention described above is implemented as an application (i.e., a program) installed by default on the terminal or directly installed by the user, and is installed on the terminal by a computer such as It may be recorded on a readable recording medium.

The description of the present invention described above is for illustrative purposes, and those skilled in the art will understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential features of the present invention. will be. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. For example, each component described as single may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

Claims (10)

When applying for a real-time guide, select a country, region, and attraction, then receive a list of guides corresponding to the country, region, and attraction, select a guide tagged with a guide available among the guide list, and request a guide. If this is accepted, the user terminal starts the video call;
A guide terminal that registers the countries, regions, and attractions where guidance is available, registers the guide available time, and then connects to the user terminal through a video call when the request from the user terminal is accepted; and
A guide register that registers guide experience, countries, regions, and attractions that can guide from the guide terminal, a reception section that receives applications for real-time guides from the user terminal, and a guide list that registers the countries, regions, and attractions that applied for real-time guides in the user terminal. A transmission unit that extracts and transmits to the user terminal, a request unit that requests real-time guidance from the guide terminal of the guide selected in the user terminal, and when the guide terminal accepts the real-time guide, a video call is made between the user terminal and the guide terminal. A connection unit that connects to, when the user terminals are a plurality of user terminals belonging to a plurality of entities, provides one-to-many communication so that the image of the guide terminal is transmitted to the plurality of user terminals, and a representative of the plurality of user terminals A group guide unit that transmits the image of the user terminal of the selected representative user to the guide terminal, receives the current location of the user terminal through GPS, displays the current location of the user terminal on a map, and sends it to the guide terminal in real time Includes a guide service providing server including a shared location sharing unit,
The connection part is,
Network information of the user terminal and the guide terminal is collected in real time, an encoding rate is set based on the collected network information of the user terminal and the guide terminal, and an ABR (Adaptive BR) is used in the guide terminal at the set encoding rate. Bitrate Rate) encoding technique is used to encode the video and provide it to the user terminal.
The group guide department,
Connecting a user terminal of a representative user selected as a representative among the plurality of user terminals and the guide terminal, transmitting an image of a user terminal selected as a representative between the user terminal selected as a representative and the guide terminal to the guide terminal, A channel is formed by linking the plurality of user terminals into a single network through Wi-Fi Lunch Box or Wi-Fi Egg, and an N screen is formed between the user terminal selected as the representative and the remaining user terminals,
The audio and video of the guide provided from the guide terminal to the user terminal of the representative user are,
Shared through a channel formed between the user terminal selected as the representative and the remaining user terminals,
The screen of the guide terminal is,
A travel guide service provision system using video calls, characterized in that the user's location is displayed in 2D or 3D on one side of the screen, and a real-time screen of tourist attractions or attractions corresponding to the user's location is provided and displayed on the other side of the screen. .
delete According to claim 1,
The guide service providing server is,
a payment management unit that provides a guide amount when providing the guide list and connects the user terminal and the guide terminal when payment is completed at the user terminal;
A travel guide service provision system using video calls, further comprising:
delete According to claim 1,
The guide service providing server is,
an available resource check unit that checks the remaining battery capacity and remaining data of the user terminal before connecting to the guide terminal, and informs of real-time guide interruption or connection failure if the remaining battery capacity and remaining data are less than a preset standard value;
A travel guide service provision system using video calls, further comprising:
According to claim 5,
The guide service providing server is,
If the user terminals are multiple user terminals belonging to multiple entities, and the remaining battery or data remaining amount of any one user terminal is less than a preset reference value, a guide for handing over to connect the video call to another user terminal linkage part;
A travel guide service provision system using video calls, further comprising:
According to claim 1,
The guide service providing server is,
An AR guide unit that provides a service for outputting pre-built AR guide content for the country, region, and attraction when there is no guide tagged with a guide available indication after requesting a real-time guide from the user terminal;
A travel guide service provision system using video calls, further comprising:
According to claim 1,
The guide service providing server is,
When the user terminal selects a country to travel to and requests a travel itinerary, the travel itinerary is transmitted to at least one guide terminal, and after receiving the travel itinerary and quotation from the at least one guide terminal, the travel itinerary and quotation are sent to the user terminal. When one of the selected travel itineraries and estimates is selected, a custom itinerary unit connects the guide terminal that prepared the selected travel itinerary and quotation form with the user terminal;
A travel guide service provision system using video calls, further comprising:
According to claim 8,
The guide service providing server is,
If the quotation amount in the quotation is lower than the preset minimum quotation amount, a rejection unit inquires whether the shopping schedule is included through the guide terminal, and if the shopping schedule is included, requests a re-quotation of the amount excluding the shopping schedule;
A travel guide service provision system using video calls, further comprising:
According to claim 1,
The guide service providing server is,
A mutual review management unit that collects, stores, and accumulates mutual review data from the user terminal and the guide terminal after a video call between the user terminal and the guide terminal;
A travel guide service provision system using video calls, further comprising:

Images