KR20210097243A - Method, system, program and computer readable recording medium for provoding virtual experiencing tour - Google Patents

Abstract

The present invention provides a method, a server program, and a computer-readable recording medium for managing lodging reservations which can virtually experience the language and culture of a travel country through a system which provides a virtual tour experience. A lodging reservation management server comprises: an information management unit receiving first lodging product information from a plurality of lodging companies and managing the first lodging product information; an information storage unit receiving the first lodging product information from the information management unit and storing the first lodging product information; and a channel linking unit receiving the first lodging product information stored in the information storage unit, and transforming the first lodging product information into second lodging product information to transfer the second lodging product information to a plurality of lodging reservation agents which provide different APIs. The channel linking unit transforms the first lodging product information into the second lodging product information in accordance with the different APIs provided by the plurality of lodging reservation agents to register the second lodging product information in the plurality of lodging reservation agents, and transmits the second lodging product information to the information storage unit. The information storage unit maps the second lodging product information and the first lodging product information received from the information management unit to be stored, and stores mapped information.

Description

Methods, systems, programs and computer-readable recording media for providing virtual tourism experiences

The present invention relates to a method, system, program and computer-readable recording medium for providing a virtual tourism experience.

Recently, interest in virtual reality (VR) is increasing, and various contents using virtual objects, such as virtual reality or augmented reality, are being proposed.

In general, virtual reality is a virtual space created by artificial technology using a computer, etc., which is similar to reality, but has features that are not real.

In addition, augmented reality (AR) is a computer graphic technique that synthesizes a virtual object in a real environment to look like an object existing in the original environment as a field of virtual reality.

Augmented reality has a feature that a user can give an improved sense of reality by interacting with a virtual object based on the real world.

Various technologies for realizing such virtual reality or augmented reality (hereinafter referred to as virtual reality) have been developed, but their application fields are very limited.

For example, it is the extent to which an image of a tourist destination is displayed while wearing a goggle-type virtual reality device capable of realizing virtual reality.

In recent years, the tourism industry is developing due to the increase in income level and the implementation of the five-day week system, and the number of Koreans visiting overseas through summer vacations or weekend trips, or foreigners visiting famous domestic tourist destinations is increasing.

However, the conventional virtual reality device is limited to providing only a three-dimensional image of a tourist destination, and there is a problem in that it is not possible to experience the language, culture, etc. when in contact with a local person in a tourist destination of another country.

The problem to be solved by the present invention is to provide a method, system, program, and computer-readable recording medium for virtual experience of the language and culture of the travel country through a system that provides a virtual tourism experience.

Furthermore, it is to provide a method, system, program and computer-readable recording medium for providing a suitable navigation and travel course by analyzing the travel country, travel city, and travel schedule, and at the same time providing a virtual tourism experience according to the navigation and travel course.

In addition, sign language for the deaf is provided to provide a method, system, program, and computer-readable recording medium in which the deaf can effectively experience the language and culture of the travel country.

The problems of the present invention are not limited to the problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

The virtual tourism experience system according to an embodiment for solving the above problem provides an input unit for providing travel information to a user and collecting the travel information input by the user, and transmitting the travel information input by the user from the input unit and a server that generates a virtual tourism experience image and a virtual reality device that receives the virtual tourism experience image and displays a three-dimensional video to the user, wherein the server includes a travel information database unit, a member information database unit, and analysis a unit and a conversion unit, wherein the analysis unit analyzes the data stored in the travel information database unit and the member information database unit to present a travel course to the user, and provides video and audio corresponding to the travel course selected by the user. and extracting a first subtitle, wherein the converting unit includes a language converting unit, wherein the language converting unit receives the audio and the first subtitle from the analyzing unit and converts the second subtitle into a language different from the first subtitle. generated and transmitted to the analysis unit, and the analysis unit synthesizes the second subtitle in the video.

The conversion unit further includes a sign language conversion unit, wherein the sign language conversion unit receives the voice and the first subtitle from the analysis unit, converts it into sign language data, and transmits it to the analysis unit, and the analysis unit uses the sign language data to add the video to the video. You can synthesize sign language videos.

The travel information database unit includes a travel country database, a means of transportation database, a travel city database, a restaurant database, a travel course database, a tourist destination database, a video database, an audio and subtitle database, a sign language database, and a travel It includes a theme database, an SNS database, and an accommodation database, and the database unit includes a storage unit made of a block chain network, and the block chain network is a request signal to record the information obtained from the input unit in the block chain network. When an in-blockchain confirmation is generated, the block-chain node propagates the block-chain transaction to adjacent nodes according to the request for the corresponding block-chain confirmation so that block-chain storage can be achieved.

The analysis unit may extract communication voice and subtitle information corresponding to each restaurant, tourist destination, lodging facility, and means of transportation appearing in the moving picture from the voice and subtitle database and synthesize them into the moving picture.

The analysis unit extracts first communication voice and subtitle information corresponding to each restaurant, tourist destination, accommodation, and means of transportation appearing in the video from the voice and subtitle database and transmits it to the converting unit, and the converting unit transmits the received first communication voice and subtitle information. 1 Communication voice and subtitle information is generated as second communication voice and subtitle information converted into the language selected by the user and transmitted to the analysis unit, and the analysis unit may synthesize the second communication voice and subtitle information into the video. .

A method of providing a virtual tourism experience according to an embodiment for solving the above problem includes the steps of: receiving first travel information by an input unit and transmitting the first travel information to a server; Analyzing the information to select travel courses selectable by the user, extracting and combining video data and second travel information corresponding to the travel course selected by the user to generate a virtual tourism experience image; 2 converting the travel information into a language or sign language selected by the user, synthesizing the image into the virtual tourism experience image, and transmitting the virtual tourism experience image to a virtual reality device, wherein the second travel information is converted into a language or sign language selected by the user In the step of converting into sign language and synthesizing it into the virtual tourism experience image, the communication voice and subtitle information for the communication experience between the virtual person concerned and the user of each restaurant, tourist destination, accommodation, and means of transportation appearing in the virtual tourism experience image are recalled. It provides a virtual tourism experience including the step of converting into a user-selected language or sign language and synthesizing the image into the virtual tourism experience image.

The step of converting the second travel information into a user-selected language or sign language and synthesizing it into the virtual tourism experience image includes information on restaurants, tourist destinations, accommodation facilities, and transportation means appearing in the virtual tourism experience image. It is possible to provide a virtual tourism experience including the step of converting the information about the user into the language or sign language selected by the user and synthesizing the information into the virtual tourism experience image.

The server includes a travel information database unit, a member information database unit, an analysis unit and a conversion unit, wherein the analysis unit analyzes the data stored in the travel information database unit and the member information database unit to determine the travel course sorting, and the conversion unit includes a language conversion unit and a sign language conversion unit, wherein the language conversion unit receives the second travel information from the analysis unit and converts it into a language selected by the user, and the sign language conversion unit analyzes It is possible to provide a virtual tourism experience that receives the second travel information from the department and converts it into sign language.

A computer program according to another embodiment for solving the above problem implements a method for providing a virtual tourism experience according to any one of claims 6 to 8.

A recording medium in which a computer-executable program is recorded according to another embodiment for solving the above problem implements the method of providing a virtual tourism experience according to any one of claims 6 to 8.

The details of other embodiments are included in the detailed description and drawings.

According to the method, system, program, and computer-readable recording medium for providing a virtual tourism experience according to an embodiment, it is possible to experience the language and culture of a travel country in a virtual way, thereby making it possible to efficiently prepare for travel. Accordingly, it is possible to reduce unnecessary time required for travel, and at the same time to prevent troubles due to cultural differences that may occur in travel destinations in advance.

In addition, through the virtual tourism experience, it is possible to effectively select the travel country, travel city, and travel course.

Furthermore, sign language for the deaf is provided so that the deaf can effectively experience the language and culture of the country of travel.

Effects according to the embodiments are not limited by the contents exemplified above, and more various effects are included in the present specification.

1 is a block diagram illustrating a virtual tourism experience system according to an embodiment.
2 is a block diagram illustrating an input unit of a virtual tourism experience system according to an embodiment.
3 is a block diagram illustrating a server of a virtual tourism experience system according to an embodiment.
4 is a block diagram illustrating a travel information database unit of a server according to an embodiment.
5 is a block diagram illustrating a relationship between a server and an output unit according to an exemplary embodiment.
6 is a perspective view illustrating a virtual reality device according to an exemplary embodiment.
7 is a block diagram illustrating a structure of a virtual reality device according to an embodiment.
8 is a diagram for explaining a virtual tourism experience system according to an embodiment.
9 is a block diagram for explaining a virtual tourism experience through a virtual tourism experience system according to an embodiment.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in a variety of different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention belongs It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims.

It should be understood that all flow diagrams, state transition diagrams, pseudo code, and the like may be tangibly embodied on computer-readable media and represent various processes performed by a computer or processor, whether or not a computer or processor is explicitly shown.

The functions of the various elements shown in the figures including a processor or functional blocks represented by similar concepts may be provided by the use of dedicated hardware as well as hardware having the ability to execute software in association with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, a single shared processor, or a plurality of separate processors, some of which may be shared. Like reference numerals refer to like elements throughout.

Hereinafter, specific embodiments will be described with reference to the accompanying drawings.

1 is a block diagram illustrating a virtual tourism experience system according to an embodiment.

Referring to FIG. 1 , the virtual tourism experience system 100 may include an input unit 110 , a server 130 , an output unit 150 , a virtual reality unit 170 , and other output devices 190 .

The input unit 110 may provide travel information to a user and collect travel information input by the user. For example, the input unit 110 presents travel information such as a plurality of travel countries, a plurality of travel cities, a travel period, and a travel date to the user, and selects and inputs the travel country, travel city, and the like, from among the presented travel information. Travel information such as travel period and travel date may be collected. The user may be diverse, such as a travel agency, a travel agency, a lodging company, or an lodging agency, as well as a person who wants to travel directly.

In some embodiments, the input unit 110 may be connected to a device provided by the user. For example, it may be connected to a smart phone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a wearable device, and the like.

In some embodiments, the input unit 110 may receive user information such as a user's name, gender, and address. Also, the input unit 110 may provide a member authentication service. The member authentication service receives the user's ID and password, collects them, and can use it as login information. In some embodiments, the input unit 110 may use SNS information as login information in connection with SNS such as Facebook or Twitter.

The server 130 may receive, from the input unit 110 , travel information such as the travel country, travel city, travel period, and travel date selected and input by the user, and user information such as the user's name, gender, and address, and the like.

The server 130 stores and analyzes travel information and user information received from the input unit 110 , and may provide a suitable travel course and navigation from a departure point to a destination. Here, the travel course may be a part of a travel city of a travel country. In addition, navigation refers to a route from a departure point to a destination, and a virtual experience image such as a means of transportation, a moving distance, a moving time, a road guide while moving, and surrounding information may be provided together with the navigation. For example, in some embodiments, the navigation may set a route from the origin to the destination from the user's home to the end point of the travel course, and from the user's home to the end point of the travel course, the travel means, travel distance, travel time, It is possible to provide virtual experience images such as road guidance while moving, airport location, airport boarding gate, ticketing information, baggage information, and surrounding information (information on tourist attractions, restaurants, accommodations, etc.).

In addition, in some embodiments, the navigation may set the route from the origin to the destination from the airport of the travel country to the end point of the travel course, and the means of transportation, the travel distance, the travel time, from the airport of the travel country to the end point of the travel course, It is possible to provide virtual experience images such as road guidance while moving, airport location, airport boarding gate, ticketing information, baggage information, and surrounding information (information on tourist attractions, restaurants, accommodations, etc.).

In addition, in some embodiments, the navigation may set the route from the departure point to the destination from the starting point of the travel course to the ending point of the travel course, and from the starting point of the travel course to the end point of the travel course the means, movement distance, and movement It is possible to provide virtual experience images such as time, road guidance while moving, and surrounding information (information on tourist attractions, restaurants, accommodations, etc.). However, the present invention is not limited thereto, and the route of the navigation may be set in various ways. The setting of a navigation route and provision of a virtual experience video will be discussed in more detail in the future.

The output unit 150 may transform and output the navigation route and virtual experience image received from the server 130 into a format suitable for an output device, and the output navigation route and virtual experience image are output to the virtual reality unit 170 . ) or other output device 190 .

The virtual reality unit 170 is a display device that can be worn in the form of glasses, and may display a 3D video in a panoramic format. The virtual reality unit 170 receives the navigation route and the virtual experience image received from the output unit 150, and displays the virtual experience image corresponding to the navigation route in three dimensions, so that the user can have a virtual tourism experience.

In addition, the user can obtain necessary information by selecting a building, a person, a background, etc. appearing in the virtual experience image, and can have a virtual experience as if he came to an actual tourist destination.

In some embodiments, by selecting a building appearing in the virtual experience image, information on the building may be output as subtitles or audio in the virtual experience image.

In some embodiments, virtual communication may be achieved by selecting a person who appears in the virtual experience image. For example, when American person A experiences a virtual tour with respect to Korea, American person A may perform virtual communication with a Korean person by selecting a Korean person appearing in the virtual experience image. In this case, the Korean voice may be translated into English and subtitles may be provided. For example, transliteration and contents of a Korean voice may be provided as subtitles.

In some embodiments, the virtual tourism experience system 100 may provide sign language. For example, when the deaf person B experiences a virtual tour in Korea, the deaf person B can perform virtual communication with a Korean person by selecting a Korean person appearing in the virtual experience image. In this case, the voice of a Korean person may be converted into sign language and provided. Here, sign language may be provided as a video or image.

The other output device 190 is a display device capable of displaying an image, such as a smart phone, a tablet computer, a notebook computer, a personal digital assistant (PDA), or a portable multimedia player (PMP). (display device) may be included. The other output device 190 receives the navigation route and virtual experience image received from the output unit 150, and displays the virtual experience image corresponding to the navigation route, so that the user can have a virtual tourism experience.

2 is a block diagram illustrating an input unit of a virtual tourism experience system according to an embodiment.

Referring to FIG. 2 , the input unit 110 may include a travel country input unit 111 , a travel city input unit 113 , a travel date input unit 115 , a travel period input unit 117 , and a language input unit 119 .

The travel country input unit 111 presents a plurality of travel countries to the user, the travel country selected by the user from among the plurality of suggested travel countries may be input, and the travel country input unit 111 sets the travel country selected by the user to the server 130 . ) can be passed to

The travel city input unit 113 may present a plurality of travel cities to the user based on the travel country selected by the user, and may receive the travel city selected by the user from among the presented travel cities. The travel city input unit 113 may transmit the travel city selected by the user to the server 130 .

In some embodiments, a travel country may be input to the travel country input unit 111 and a travel city may be input to the travel city input unit 113 . However, the present invention is not limited thereto. In some embodiments, the travel city may be input to the travel city input unit 113 first. In this case, the travel country input unit 111 may automatically set a travel country in which the selected travel city is located.

The travel date input unit 115 may input a date on which the user wants to travel. The input of the travel date may be divided into a start date and an end date. However, the present invention is not limited thereto, and either the start date or the end date may be input. The travel date input unit 115 may transmit the travel date selected by the user to the server 130 .

In some embodiments, after a travel country is input to the travel country input unit 111 and a travel city is input to the travel city input unit 113 , a travel date may be input to the travel date input unit 115 . However, the present invention is not limited thereto, and in some embodiments, the travel date may be input to the travel date input unit 115 before the travel country input unit 111 or the travel city input unit 113 .

The travel period input unit 117 may input a period for which the user wants to travel. In some embodiments, when a travel start date and a travel end date are input to the travel date input unit 115 , the travel period input unit 117 may calculate the travel period through the travel start date and the travel end date and automatically input the travel period. The travel period input unit 117 may transmit the travel period selected by the user to the server 130 .

In some embodiments, after a travel country is input to the travel country input unit 111 , a travel city is input to the travel city input unit 113 , and a travel date is input to the travel date input unit 115 , the travel period input unit 117 . A travel period may be entered in . However, the present invention is not limited thereto, and the travel period may be input to the travel period input unit 115 first.

The language input unit 119 may present a language used in each of a plurality of countries, and a language selected by the user from among the languages of each of the plurality of travel countries may be input. For example, when American person A wants to experience virtual tourism in Korea, American person A may select English, and information provided in the virtual tourism experience may be provided in English. In addition, when the American person A selects a Korean person appearing in the virtual experience image, the Korean person's voice may be translated into English and provided.

In some embodiments, the language input unit 119 may present sign language to the user, and when the user selects and inputs sign language, information provided in the virtual tourism experience may be provided in sign language.

Such a configuration of the input unit 110 is an example, and is not limited thereto. Some components included in the input unit 110 may be omitted, and additional components may be further included.

In some embodiments, the input unit 110 may include a travel expense input unit. For example, the travel expenses input unit may input the travel expenses expected by the user. The travel expense may be input as a specific amount, or may be input as an upper limit amount and a lower limit amount.

In some embodiments, the input unit 110 may include a user information input unit. For example, the user information input unit may input user information such as a user's name, gender, address, and SNS account.

In some embodiments, the input unit 110 may include a member authentication unit. For example, the member authenticator may receive the user's ID and password and use it as login information. In some embodiments, the member authenticator may use the SNS account as login information.

3 is a block diagram illustrating a server of a virtual tourism experience system according to an embodiment, FIG. 4 is a block diagram illustrating a travel information database unit of the server according to an embodiment, and FIG. 5 is an embodiment is a block diagram for explaining the relationship between the server and the output unit according to , FIG. 8 is a diagram for explaining a virtual tourism experience system according to an embodiment.

3 to 5 and 8 , the server 130 may include a database unit 131 , an analysis unit 135 , and a conversion unit 137 .

The database unit 131 may store information necessary to provide a virtual tourism experience.

The database unit 131 includes a random access memory (RAM), a flash memory, a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), registers, a hard disk, a removable disk, and a memory. It may include a storage device of a built-in type such as a card, as well as a storage device of a removable type such as a USB memory.

In some embodiments, the database unit 131 may be formed of a block chain network. As is known, a blockchain network is a distributed data storage technology that stores data in blocks, connects them in a chain, and replicates and stores them on numerous computers at the same time. Also called public ledger. Transaction history is sent to all users participating in a transaction without keeping transaction records on a centralized server, and every transaction has the advantage of preventing data forgery or falsification by sharing and collating information among all transaction participants.

The database unit 131 may obtain unique information from other components of the input unit 110 and the server 130 and store the obtained information in a block chain manner through a block chain network. And, when an update event for information stored in the block chain method occurs, the block chain update can be stored on the block chain network to match the update event.

The database unit 131 may include a storage unit formed of a block chain network, and the storage unit may perform a block chain storage process, a block chain update process, and an information utilization process. However, this is only an example, and is not limited thereto.

The block chain storage process is a process of storing the information obtained by the storage unit of the database unit 131 in a block chain method through a block chain network. For example, if a block chain confirmation is generated, which is a request signal to record information obtained from the components of the input unit 110 and the server 130 in the block chain network, the block chain node will block according to the block chain confirmation request. It propagates the chain transaction to the neighboring nodes so that the blockchain is stored.

Here, the information obtained from the components of the input unit 110 and the server 130 includes travel country information, transportation means information, travel city information, restaurant information, travel course information, tourist destination information, virtual experience image information, voice/ It may include subtitle information, sign language information, travel theme information, SNS information, accommodation information, member information, and information selected by the user (eg, travel country, travel city, travel date, travel period, language, etc. selected by the user). However, the present invention is not limited thereto, and only some of the above-described information may be stored in a block chain manner.

For example, only the user's personal information may be stored in a blockchain manner. In addition, in some embodiments, the aforementioned travel country information, transportation means information, travel city information, restaurant information, travel course information, tourist destination information, virtual experience image information, audio/subtitle information, sign language information, travel theme information, SNS information, Additional information other than accommodation information, member information, and information selected by the user (eg, travel country, travel city, travel date, travel duration, language, etc. selected by the user) may be stored in a blockchain manner.

The block chain update process is a process in which block chain updates are stored on the block chain network to match the update event when an update event for information stored in the block chain method occurs. To this end, the block chain update process includes the block chain update confirmation request process of requesting the block chain update confirmation for the information updated by the update event to the block chain node when an update event for information stored in the block chain method occurs; , when a blockchain update confirmation is requested, the blockchain node propagates the blockchain transaction based on the blockchain update confirmation to neighboring nodes to complete the blockchain update confirmation and notify the completion of the blockchain update confirmation There will be a process of notification of the completion of the confirmation. In some embodiments, the information storage unit 230 may further include a block chain management unit instructing an updater request, updater confirmation, and updater confirmation completion.

Here, the information update event includes travel country information, transportation means information, travel city information, restaurant information, travel course information, tourist destination information, virtual experience video information, audio/subtitle information, sign language information, travel theme information, and SNS information. , accommodation information, member information, and information selected by the user (the travel country, travel city, travel date, travel period, language, etc. selected by the user) are modified, changed, deleted, or added, etc., updated on the blockchain and can be stored.

In some embodiments, the database unit 131 may include a travel information database unit 131A and a member information database unit 131B.

The travel information database unit 131A includes a travel country database (DB1), a means of transportation database (DB2), a travel city database (DB3), a restaurant database (DB4), a travel course database (DB5), and a tourist destination. Database (DB6), video database (DB7), audio/subtitle database (DB8), sign language database (DB9), travel theme database (DB10), SNS database (DB11) and accommodation database (DB12) ) may be included.

In the travel country database DB1, data and identification information for a travelable country may be mapped and stored. The travel country database DB1 also stores travel country identification information for identifying travel countries when data on travelable countries and data on travelable countries are retrieved.

The travel country database DB1 may store data on location information of airports for each travel country, location information of airport boarding gates, information for ticketing, and luggage guide information.

In the moving means database DB2, data and identification information about the moving means may be mapped and stored. In the means of transportation database DB2, data on the means of transportation and identification information of the means of transportation for identifying the means of transportation are also stored together when searching for data on the means of transportation. Here, the means of transportation may include means of movement between countries, means of movement between cities, means of movement between courses, and the like, and may include various means of transportation such as air, ship, automobile, train, bicycle, and foot.

In the travel city database DB3, data and identification information on major travel cities for each travel country may be mapped and stored. The travel city database DB3 also stores travel city identification information that allows the travel city to be identified when data on the main travel city for each travel country and data on the travel city are retrieved. Here, the travel city means regions included in the travel country. Regions included in the travel country may be divided into administrative units, but is not limited thereto. For example, in some embodiments, when the travel country is Chinese, the travel city may be divided into Shanghai, Dalian, Guangzhou, Xiamen, Hainan, Beijing, and the like. In some embodiments, when the travel country is China, the travel city may be further subdivided into Yuyuan, The Bund, Tienzifang, Nangjing East Road, Xintiandi, and the like.

In the restaurant database DB4, data and identification information for a major restaurant located in each travel city may be mapped and stored. The restaurant database DB4 also stores data on major restaurants located in each travel city and restaurant identification information that allows the restaurant to be identified when searching for data on the restaurants. The restaurant data may include information such as a type, menu, price, location, and contact information of each restaurant.

In the travel course database DB5, data and identification information on a travel course that can be toured in each travel city may be mapped and stored. In the travel course database DB5, data on a travel course that can be toured in each travel city and travel course identification information for identifying a travel course when searching for data on the travel course are also stored.

In the tourist destination database DB6, data and identification information on tourist destinations that can be toured in each travel city may be mapped and stored. In the tourist destination database DB6, data on the tourist destination of each travel city and tourist destination identification information for identifying the tourist destination are also stored when searching for data on the tourist destination.

In the moving image database DB7, data and identification information for moving images of each travel country may be mapped and stored. In the video database (DB7), video data for each travel country, travel city, travel course, tourist destination, restaurant, means of transportation, accommodation, etc., when searching for video data and video data, the video identification that enables the identification of the video Information is also stored. Such moving image data may be combined according to the travel course selected by the user and provided as a 3D moving image or a 2D moving image through the virtual reality unit 170 and other output devices 190 .

In the audio/caption database DB8, as audio and subtitle data for the video data, it may be mapped and stored with the video data. For example, when a virtual tourism experience is conducted through video data A for travel course A, information about restaurants, accommodations, shopping malls, etc. displayed in video A through the audio/subtitle database (DB8) is recorded with audio and subtitles. can be provided to users. In addition, when the user selects a specific restaurant during the virtual tour experience, information on the type of restaurant, the restaurant menu and price, etc. may be provided in voice and subtitles. Here, the audio and subtitles may be provided in the language of the corresponding travel country, and may be provided after being converted into a language selected by the user through the language conversion unit 137A.

In the sign language database DB9, data for providing voice and information of moving image data in sign language may be mapped to moving image data and stored. For example, when a virtual tourism experience is performed through video data A for travel course A, information about restaurants, accommodations, shopping malls, etc. output through video A is converted into sign language through the sign language conversion unit 137B, It may be stored in the sign language database DB9.

In the travel theme database DB10, travel theme data and identification information may be mapped and stored. The travel theme database DB10 also stores travel theme data and travel theme identification information for identifying the travel theme when searching for travel theme data and travel theme data. Here, the travel theme may include various travel themes, such as a health theme, a food theme, a history theme, a movie theme, and a tourist attraction theme.

The SNS database DB11 may store data on SNS evaluation information related to each travel country, travel city, travel course, tourist destination, restaurant, transportation means, accommodation facility, and the like. For example, when a virtual tourism experience is conducted through video A data for travel course A, SNS evaluation of restaurants, accommodations, shopping malls, etc. displayed through video A may be provided to the user with voice and subtitles. In the SNS database DB11, the local SNS evaluation information and the tourist SNS evaluation information are stored separately, and according to the user's selection, the local SNS evaluation information and/or the tourist SNS evaluation information may be provided. The SNS evaluation information can derive evaluation information by collecting and analyzing the evaluations related to the travel country, travel city, travel course, tourist destination, restaurant, transportation means, accommodation facility, etc. on SNS.

In the accommodation database DB12, data and identification information on major accommodation facilities located in each travel city may be mapped and stored. In the accommodation database DB12, data on main accommodation facilities located in each travel city and accommodation facility identification information for identifying accommodation facilities are also stored when searching for data on accommodation facilities. The accommodation data may include information such as the type, size, price, promotion, ancillary facilities, location, and contact information of each accommodation facility.

The member information database unit 131B may store travel information such as a travel country, a travel city, a travel period, a travel date, and a language selected by the user from the input unit 110 . In addition, user information such as the user's name, gender, address, and SNS account may be stored in the member information database unit 131B.

The analysis unit 135 is stored in the member information database unit 131B (travel information such as the travel country, travel city, travel period, travel date, and language selected by the user) and the travel information database unit 131A. Stored databases (travel country database (DB1), transportation means database (DB2), travel city database ((DB3), restaurant database (DB4), travel course database (DB5), tourist destination database (DB6)) , video database (DB7), voice/subtitle database (DB8), sign language database (DB9), travel theme database (DB10), SNS database (DB11) and accommodation database (DB12)) A suitable navigation and a travel course included in the navigation may be selected and presented As described above, since navigation is an extension of a travel course, the following description will be made based on the travel course.

A plurality of travel courses selected and presented by the analysis unit 135 may be provided. It may be selected from among the travel courses stored in the travel course database DB5, but a user-customized course may be presented by combining a plurality of travel courses stored in the travel course database DB5 based on the travel information selected by the user. .

The analysis unit 135 may extract and combine moving image data suitable for the selected travel course from the moving image database DB7. For example, when a travel course A including the first section, the second section, the third section, and the fourth section is selected, the video data of the first section, the video data of the second section, the video data of the third section, and Each of the video data of the fourth section may be extracted and combined.

The analysis unit 135 may extract information necessary for a virtual tour experience of the travel course A from the travel information database unit 131A. For example, in some embodiments, the analysis unit 135 may include information about restaurants (restaurants) appearing in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section. type, menu, price, location, contact information, etc.) can be extracted from the restaurant database (DB8) and synthesized.

In some embodiments, the analysis unit 135 may include information about tourist spots (location of tourist spots, admission fees) appearing in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section. , operating hours, etc.) can be extracted and synthesized from the tourist destination database (DB6).

In some embodiments, the analysis unit 135 may include information on accommodation facilities (types of accommodation facilities) appearing in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section. , size, price, promotion, ancillary facilities, location, contact information, etc.) can be extracted and synthesized from the accommodation database (DB12).

In some embodiments, the analysis unit 135 may provide information on the moving means corresponding to each of the moving picture data of the first section, the moving picture data of the second section, the moving picture data of the third section, and the moving picture data of the fourth section (of the moving means). type, movement distance, movement time for each transportation means, fare for each transportation means, etc.) can be extracted and synthesized from the transportation means database DB2.

In some embodiments, the analysis unit 135 may be configured to include video data of the first section, video data of the second section, video data of the third section, and video data of the fourth section, such as tourist destinations, restaurants, transportation means, lodging facilities, etc. SNS evaluation information (evaluation information such as cost-effectiveness, convenience, service, hygiene, etc.) can be extracted and synthesized from the SNS database (DB11).

In some embodiments, the analysis unit 135 may include information (restaurant information, tourist destination information, accommodation information) synthesized in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section. Facility information, transportation means information, SNS evaluation information, etc.) can be synthesized by extracting audio/caption information corresponding to the audio/captioning database DB12.

In addition, the analysis unit 135 corresponds to restaurants, tourist destinations, accommodation facilities, transportation means, etc. that appear in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section, respectively. It is possible to extract and synthesize the voice/subtitle information of the virtual person involved in the communication from the voice/subtitle database (DB12).

In some embodiments, the analysis unit 135 may include a restaurant, tourist destination, accommodation facility, transportation means, etc. that appear in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section. The communication voice/subtitle information of the corresponding virtual person is extracted from the voice/subtitle database (DB12) and delivered to the converter 137, and the converter 137 converts it into a language selected by the user and analyzes it 135 can be forwarded to

For example, in some embodiments, the analysis unit 135 may be configured with a virtual owner of a restaurant synthesized in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section. Voice/caption information for the user's communication experience may be extracted and synthesized from the voice/caption database DB12, and in some embodiments, the analysis unit 135 may include video data of the first section and video data of the second section. , the video data of the third section and the video data of the fourth section can be synthesized by extracting audio/subtitle information for the communication experience of the virtual manager and user of the tourist destination from the audio/subtitle database (DB12), In some embodiments, the analysis unit 135 is a virtual front desk staff and user of the accommodation facility synthesized in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section Voice/caption information for communication experience can be extracted and synthesized from the voice/subtitle database DB12, and in some embodiments, the analysis unit 135 may include moving picture data of the first section, moving picture data of the second section, and the second section. It is possible to extract and synthesize voice/subtitle information for a communication experience of a virtual employee and user of a moving means synthesized in each of the moving picture data of the 3rd section and the moving picture data of the 4th section from the voice/subtitle database (DB12). However, the present invention is not limited thereto, and the communication experience may occur in various areas of the travel course.

In addition, the analysis unit 135 uses the video data of the first section, the video data of the second section, the video data of the third section, and the audio and subtitle data provided from the video data of the fourth section, information on the language selected by the user. together with the language conversion unit 137A, the language conversion unit 137A may convert voice and subtitle data into a language selected by the user. The converted voice and caption data may be transmitted to the database unit 131 and the analysis unit 135 , and the analysis unit 135 converts the converted audio and subtitle data into the video data of the first section and the video of the second section. Data, video data of the third section, and video data of the fourth section may be synthesized according to each of the data.

In some embodiments, the analysis unit 135 converts the audio and subtitle data provided from the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section into the language selected by the user. The information about the information may be transmitted to the sign language converting unit 137B, and the sign language converting unit 137B may convert voice and subtitle data into a sign language. The converted sign language data may be transmitted to the database unit 131 and the analysis unit 135 , and the analysis unit 135 converts the converted sign language into video data of the first section, video data of the second section, and the third section. It can be synthesized according to each of the moving picture data of , and the moving picture data of the fourth section.

In this way, the synthesized virtual experience image is transmitted to the output unit 150 , and the output unit 150 transmits the virtual experience image to the virtual reality unit 170 and other output devices 190 .

When the virtual reality unit 170 is described as an example, the virtual experience image transmitted from the output unit 150 is transmitted to the user's eyes through the virtual reality unit 170 . The user can obtain necessary information by selecting a restaurant, tourist destination, lodging facility, etc. that appear in the virtual experience image, and can have a virtual experience as if he had come to a real tourist destination. For example, by selecting a restaurant that appears in the virtual experience image, information about the restaurant (information such as restaurant type, restaurant menu and price, location, contact information, SNS evaluation, etc.) may be output as subtitles or voice in the virtual experience image. Here, the subtitle or voice may be output in the language of the travel country and the language selected by the user.

In some embodiments, when selecting a restaurant, tourist destination, lodging facility, and means of transportation appearing in the virtual experience image, communication experience can be performed with a virtual person concerned, such as a restaurant, tourist destination, accommodation, and means of transportation.

For example, in some embodiments, when a restaurant appearing in the virtual experience image is selected, communication experience with the virtual restaurant owner may be performed. For example, when American person A experiences virtual tourism in Korea, American person A may communicate with the virtual restaurant owner by selecting a virtual restaurant owner appearing in the virtual experience image.

In this case, the voice of the virtual restaurant owner may be converted into English transliteration and contents and provided as subtitles. For example, a virtual restaurant owner may say to a user "place an order". The virtual restaurant owner's "Please order" voice can be converted into the transliteration of "JOOMOON HAE SAE YO" and the contents of Place an order and provided as subtitles.

In addition, the user's expected answer to the virtual restaurant owner may be provided. For example, the transliteration of "Bibimbap JOO SAE YO" and the content of "Bibimbap please" may be provided as subtitles.

In some embodiments, the voice of the virtual restaurant owner may be converted into a sign language video or sign language image for the hearing impaired. In some embodiments, the voice of the virtual restaurant owner may be converted into a sign language video or sign language image and provided along with English transliteration and subtitles for content.

6 and 7 . The virtual reality unit 170 includes a frame 179 that can be worn on the head in the form of glasses, an image output unit 175 for displaying processed video data, and 3D for displaying an image on the screen as a 3D video in a panoramic format. It may include an image processing unit 171 , a voice processing unit 173 for outputting voice, and an audio output unit 177 for outputting voice.

When a user selects a travel course while wearing the virtual reality unit 170, the virtual reality device 170 displays a virtual experience image for the corresponding travel course. Furthermore, the user can obtain necessary information by selecting a restaurant, tourist destination, lodging facility, etc. that appear in the virtual experience image, and can execute virtual communication, so that the user can experience a virtual tourism as if he or she came to a real tourist destination. In some embodiments, the virtual reality unit 170 may further include a touch device for the user to select a restaurant, tourist attraction, lodging facility, etc. appearing in the virtual experience image.

The virtual reality unit 170 may provide an image of a corresponding tourist destination by interworking with an operation program mounted on the server 130 and the output unit 150 .

At this time, the technologies of FlashPix, Internet Image Protocol (IIP), Photo Vista, Object Modeler, and Reality Studio may be used to provide a 3D image, and Shape Snatcher technology for 3D virtual space production may be used. , Cult3D technology for 3D virtual space construction can be used.

The user selects a travel course through the input unit 110 through the user interface unit while wearing the virtual reality device 170 , and the server 130 combines the virtual experience image of the corresponding travel course to the output unit ( 150 ) and transmitted to the virtual reality unit 170 . In addition, the virtual experience image transmitted to the virtual reality unit 170 may be converted into a 3D video in a panoramic format by the 3D image processing unit 171 and the audio processing unit 173 .

The virtual reality unit 170 implements the received virtual experience image on the image output unit 175 and the audio output unit 177 so that the user can have a virtual tour experience for the corresponding travel course.

9 is a block diagram for explaining a virtual tourism experience through a virtual tourism experience system according to an embodiment.

9, 5 and 8 together, first, the user's travel information is input (S10).

For example, the input unit 110 may include travel country information, transportation means information, travel city information, restaurant information, travel course information, tourist destination information, virtual experience image information, audio/caption information, sign language information, travel theme information, and SNS information. , accommodation information, member information, information selected by the user (eg, travel country, travel city, travel date, travel period, language, etc. selected by the user) may be input, and the inputted information may be transmitted to the server 130 .

Next, selectable travel courses are presented by analyzing the input travel information (S20).

For example, the travel information transmitted from the input unit 110 may be stored in the member information database unit 131B of the server 130 . The analysis unit 135 of the server 130 includes a database (travel information such as a user-selected travel country, travel city, travel period, travel date, language) and a travel information database stored in the member information database unit 131B. Databases stored in the unit 131A (travel country database (DB1), means of transportation database (DB2), travel city database (DB3), restaurant database (DB4), travel course database (DB5), tourist destinations) Database (DB6), video database (DB7), audio/subtitle database (DB8), sign language database (DB9), travel theme database (DB10), SNS database (DB11) and accommodation database (DB12) )) can be analyzed to suggest suitable travel courses to the user.

Next, video data and travel information corresponding to the travel course selected by the user are extracted and combined (S30). For example, the analysis unit 135 may extract and combine moving image data suitable for the selected travel course from the moving image database DB7. Hereinafter, a case in which the travel course A including the first section, the second section, the third section, and the fourth section is selected will be described as an example.

The analysis unit 135 may extract and combine the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section, respectively. In addition, information necessary for the virtual tour experience of the travel course A may be extracted from the travel information database unit 131A. For example, in some embodiments, the analysis unit 135 may include a restaurant, tourist destination, and accommodation facility appearing in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section. , transportation means, SNS evaluation, and voice/subtitle information may be extracted and synthesized from the travel information database unit 131A. In addition, the analysis unit 135 is a restaurant, tourist destination, accommodation facility, transportation means, etc. synthesized in each of the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section, respectively. Communication voice/caption information of a corresponding virtual person may be extracted and synthesized from the voice/subtitle database DB12.

Next, the extracted travel information can be converted into a language selected by the user and synthesized (S40). For example, the extracted voice and subtitle data may be converted into a language selected by the user and synthesized. The analysis unit 135 may transmit the extracted voice and subtitle data together with information on the language selected by the user to the language conversion unit 137A, and the language conversion unit 137A converts the voice and subtitle data into the language selected by the user. can do.

For example, the analysis unit 135 may convert the video data of the first section, the video data of the second section, the video data of the third section, and the audio and subtitle data provided from the video data of the fourth section into the language selected by the user. information about the language may be transmitted to the language conversion unit 137A, and the language conversion unit 137A may convert voice and subtitle data into a language selected by the user. The converted voice and caption data may be transmitted to the database unit 131 and the analysis unit 135 , and the analysis unit 135 converts the converted audio and subtitle data into the video data of the first section and the video of the second section. Data, video data of the third section, and video data of the fourth section may be synthesized according to each of the data.

In some embodiments, the analysis unit 135 converts the audio and subtitle data provided from the video data of the first section, the video data of the second section, the video data of the third section, and the video data of the fourth section into the language selected by the user. The information about the information may be transmitted to the sign language conversion unit 137B, and the sign language conversion unit 137B may convert voice and subtitle data into sign language data. The converted sign language data may be transmitted to the database unit 131 and the analysis unit 135 , and the analysis unit 135 uses the converted sign language data to generate video data of the first section, video data of the second section, A sign language video may be synthesized according to each of the video data of the third section and the video data of the fourth section.

In this way, the extracted, converted, and synthesized video becomes a virtual tourism experience video.

Next, the synthesized virtual tourism experience image is transmitted to the output unit 150 ( S50 ), and the output unit 150 transmits the virtual tourism experience image to the virtual reality unit 170 and other output devices 190 . (S60).

Meanwhile, the method according to various embodiments of the present invention described above may be implemented as a program and provided to a server or devices. Accordingly, each device can download the program by accessing the server or device in which the program is stored.

In addition, the above-described method according to various embodiments of the present invention may be implemented as a program and stored in various non-transitory computer readable media to be provided. The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specifically, the various applications or programs described above may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains may be embodied in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: Virtual tourism experience system
110: input unit
111: travel country input
113: travel city input unit
115: travel date input unit
117: travel period input unit
119: language input unit
130: server
131: database unit
131A: travel information database unit
131B: member information database unit
135: analysis unit
137: conversion unit
150: output unit
170: virtual reality machine
190: other output device

Claims (10)

an input unit that provides travel information to a user and collects travel information input by the user;
a server receiving the travel information input by the user from the input unit and generating a virtual tourism experience image; and
and a virtual reality device that receives the virtual tourism experience image and displays a three-dimensional video to the user,
The server includes a travel information database unit, a member information database unit, an analysis unit and a conversion unit,
The analysis unit analyzes the data stored in the travel information database unit and the member information database unit, presents a travel course to the user, extracts a moving picture, a voice, and a first subtitle corresponding to the travel course selected by the user, ,
The conversion unit includes a language conversion unit,
The language conversion unit receives the voice and the first subtitle from the analysis unit, generates a second subtitle converted into a language different from the first subtitle, and transmits it to the analysis unit;
The analysis unit is a virtual tourism experience system for synthesizing the second subtitle to the video.
According to claim 1,
The conversion unit further comprises a sign language conversion unit,
The sign language conversion unit receives the voice and the first subtitle from the analysis unit, converts it into sign language data, and transmits it to the analysis unit,
The analysis unit is a virtual tourism experience system for synthesizing a sign language video to the video by using the sign language data.
3. The method of claim 2,
The travel information database unit includes a travel country database, a means of transportation database, a travel city database, a restaurant database, a travel course database, a tourist destination database, a video database, an audio and subtitle database, a sign language database, and a travel Including the theme database, SNS database and accommodation database,
The database unit includes a storage unit consisting of a block chain network,
When the block chain network generates a block chain confirmation, which is a request signal to record the information obtained from the input unit in the block chain network, the block chain node propagates the block chain transaction to adjacent nodes according to the block chain confirmation request and blocks A virtual tourism experience system with chain storage.
4. The method of claim 3,
The analysis unit extracts communication audio and subtitle information corresponding to each restaurant, tourist destination, accommodation facility, and means of transportation appearing in the video from the audio and caption database and synthesizes it into the video.
4. The method of claim 3,
The analysis unit extracts first communication voice and subtitle information corresponding to each restaurant, tourist destination, lodging facility, and means of transportation appearing in the video from the voice and subtitle database and transmits it to the conversion unit,
The conversion unit generates the received first communication voice and subtitle information into second communication voice and subtitle information converted into the language selected by the user and transmits it to the analysis unit,
The analysis unit is a virtual tourism experience system for synthesizing the second communication voice and caption information into the video.
receiving the first travel information by an input unit and transmitting the first travel information to a server;
analyzing, by the server, the first travel information, selecting travel courses selectable by a user;
generating a virtual tourism experience image by extracting and combining video data and second travel information corresponding to the travel course selected by the user;
converting the second travel information into a language or sign language selected by a user and synthesizing the second travel information into the virtual tourism experience image; and
Transmitting the virtual tourism experience image to a virtual reality device,
The step of converting the second travel information into a language or sign language selected by the user and synthesizing it into the virtual tourism experience image includes:
The virtual tourism experience image by converting communication voice and subtitle information for communication experience between the user and the virtual person concerned of each restaurant, tourist destination, accommodation facility, and means of transportation appearing in the virtual tourism experience image into the language or sign language selected by the user A method of providing a virtual tourism experience comprising the step of synthesizing the
7. The method of claim 6,
The step of converting the second travel information into a language or sign language selected by the user and synthesizing it into the virtual tourism experience image includes:
Converting information about restaurants, tourist destinations, information about accommodation facilities, and information about transportation means appearing in the virtual tourism experience image into a language or sign language selected by the user and synthesizing them into the virtual tourism experience image How to provide a virtual tourism experience.
8. The method of claim 7,
The server includes a travel information database unit, a member information database unit, an analysis unit and a conversion unit,
The analysis unit selects the travel course by analyzing the data stored in the travel information database unit and the member information database unit,
The conversion unit includes a language conversion unit and a sign language conversion unit,
The language conversion unit receives the second travel information from the analysis unit and converts it into a language selected by the user,
The sign language conversion unit receives the second travel information from the analysis unit and converts the second travel information into a sign language.
In a computer program,
A computer program implementing the method for providing a virtual tourism experience according to any one of claims 6 to 8.
In a computer-readable recording medium,
A recording medium in which a computer-executable program that implements the method for providing a virtual tourism experience according to any one of claims 6 to 8 is recorded.

Images