KR102410245B1 - Method and application for supporting communication of travelers using mobile device - Google Patents

Abstract

The present invention comprises the steps of displaying a plurality of pictograms designed to symbolize at least one of a facility, a place, an environment, a situation, an action, and an object of a travel destination on a display of a mobile device; outputting a preset dialog related to the selected pictogram and a plurality of selectable icons related to subsequent dialogs of the dialog to the display when one of the plurality of pictograms is selected by the user; and outputting a preset following dialog related to the selected icon to the display as one of the plurality of icons is selected by the user.

Description

Method and application for supporting communication of travelers using mobile device

The present invention relates to a method and a communication support application for assisting a traveler to communicate with a person of a different language using a mobile device when traveling in another country.

With the increase in overseas travel according to the globalization trend, travelers from all over the world are visiting Korea, and conversely, Korean tourists are also visiting countries around the world.

Travelers traveling abroad are often unfamiliar with the language used in the destination. In particular, in the case of foreigners visiting Korea, there are many cases where they are not familiar with the Korean language, so communication is often not easy when visiting restaurants or lodgings.

As such, when the language of the interlocutors is different, there is a method of using hand gestures, which in many cases makes it difficult to understand exactly what the other person's hand gestures mean. In addition, there is also a method of having a conversation through a note in which important or frequently used conversations are written down or through a text app on a smartphone. Therefore, there is a problem that the usability is very poor.

In addition, although a method of communicating using a voice or text-based translation mobile application is used, there is a problem in that accurate communication is also difficult because the accuracy of the translation is low or errors occur frequently.

Registered Patent Publication No. 10-0544905 (Jan. 13, 2006)

The present invention has been devised in view of the above points, and by displaying a pictogram designed to symbolize facilities, places, environments, etc. of a travel destination on a mobile device so that communication by the user's intuition is made, Its technical challenge is to enable unfamiliar travelers to communicate easily and efficiently.

The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. will be able

According to an embodiment of the present invention, the method comprising: displaying a plurality of pictograms designed to symbolize at least one of a facility, a place, an environment, a situation, an action, and an object of a travel destination on a display of a mobile device; outputting a preset dialog related to the selected pictogram and a plurality of selectable icons related to subsequent dialogs of the dialog to the display when one of the plurality of pictograms is selected by the user; and outputting a preset following dialog related to the selected icon to the display as one of the plurality of icons is selected by the user.

In addition, the following dialog may include a preset replies to an answer of the counterpart of the dialog.

Also, the pictogram may include one or more of hotel check-in, hotel check-out, and hotel facilities.

Also, the pictogram may include one or more of product purchase, price bargaining, currency exchange, and card payment.

In addition, when the pictogram corresponding to the purchase or price bargaining is selected by the user, a keypad for allowing the seller or the user to input the price of the product may be output on the display.

In addition, the pictogram may include a plurality of ingredients to be excluded from the food, and the dialog may include an order to exclude an item selected by the user from among the plurality of ingredients from the food.

Also, the dialog and the following dialog may have a format in which text in a local language used in a travel destination and text in a language of a region set by the user are written together on the display.

In addition, when the dialog and the following dialog are output, a voice in a local language of a travel destination may be output together.

In addition, the pictogram includes a plurality of different types of facilities, and in this case, displaying the location of the facility corresponding to the pictogram selected by the user on the display; may be additionally performed.

On the other hand, according to another embodiment of the present invention, it is possible to store in the memory of the mobile device, as a communication support application for travelers executed by the processor of the mobile device, facilities, places, environments, situations, actions, objects of the travel destination displaying a plurality of pictograms designed to symbolize at least one of at least one on a display of a mobile device; outputting a pre-stored dialog related to the selected pictogram and a plurality of selectable icons related to subsequent dialogs of the dialog to the display when one of the plurality of pictograms is selected by the user; and outputting a preset following dialog related to the selected icon to the display as one of the plurality of icons is selected by the user. do.

According to the present invention as described above, it is possible to greatly reduce the travel burden of travelers who are not familiar with the language of a destination by enabling travelers and locals to intuitively communicate through a pictogram output on a mobile device.

In addition, by outputting the dialog related to the pictogram as text on the display, the conversation partner can understand more clearly what the traveler is trying to say. You have the advantage of being able to communicate.

1 is a flowchart sequentially illustrating a communication support method of a traveler using a mobile device according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of a pictogram that can be displayed on a display of a mobile device in relation to the communication support method of a traveler shown in FIG. 1 .
3 is a view showing a first operation example illustrating the operation of the communication support application for a mobile device of the present invention.
4 is a view showing a second operation example illustrating the operation of the communication support application for a mobile device of the present invention.
5 is a view showing a third operation example illustrating the operation of the communication support application for a mobile device of the present invention.
6 is a view showing a fourth operation example illustrating the operation of the communication support application for a mobile device of the present invention.

Since the present invention can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as "comprises" or "have" are intended to designate that a feature, number, step, operation, component, part, or a combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Hereinafter, a method and application for supporting communication of travelers using a mobile device according to the present invention will be described in detail with reference to the accompanying drawings. and a redundant description thereof will be omitted.

1 is a flowchart sequentially illustrating a communication support method of a traveler using a mobile device according to an embodiment of the present invention.

The traveler's communication support method according to the present embodiment uses a mobile device (eg, a smart phone, a tablet, etc.), and the steps described below are executed by a processor of the mobile device. The travel support method according to the present invention can be implemented as an application for a mobile device. In this case, the application is stored in a storage means such as a memory provided in the mobile device, and is executed by a processor of the mobile device.

Referring to FIG. 1 , the method for supporting communication of travelers according to the present embodiment will be described. First, a plurality of pictograms related to a travel destination are displayed on the display 11 of the mobile device 10 (refer to FIG. 2 ), see FIG. 2 . ) is displayed (S11). A pictogram is a language system with pictures that can have the same meaning no matter how anyone sees it, and in the present invention, it has a design designed to symbolize at least one of facilities, places, environments, situations, actions, and objects of a travel destination.

2 shows examples of pictograms that can be displayed on the display 11 of the mobile device 10, according to which the airport 21, the hotel 22, the food 23, the transaction 24, the sea 25 ), mountains 26, Wi-Fi 27, Wi-Fi, emergency calls 28, and the like are illustrated pictograms.

For reference, FIG. 2 shows pictograms that can be displayed on the main screen of the application. Some of the pictograms illustrated in FIG. 2 may function as a higher-level menu for entering a lower-level menu. For example, when the user selects a pictogram corresponding to the airport 21 or the hotel 22 through a touch input or the like, a menu at a lower level of the selected item may be entered.

3 shows a first operation example illustrating the operation of the communication support application for mobile devices of the present invention, and when the user selects the hotel 22 on the main screen (see FIG. 2 ), the lower level menu is displayed. appears to have entered.

When entering the lower-level menu of the hotel 22 item as shown in FIG. 3 (a), the hotel check-in 29, hotel check-out 30, and pub 31 or restaurant ( 32) and the like may be displayed on the display 11 .

And when the user selects one of these items, for example, when selecting a pictogram representing hotel check-in 29, as shown in (b), the sub-items such as reservation confirmation 33, reservation inquiry 34, Pictograms representing dialogs such as other inquiries 35 may be displayed on the display 11 .

And, as one of the pictograms displayed on the display 11 is selected by the user, a preset dialog 36 related to the selected pictogram is output to the display 11, and a dialog 38 following the dialog 36 A plurality of selectable icons 37 related to the items are output to the display 11 (S12).

For example, when the user selects the pictogram representing the reservation inquiry 34 as shown in (c), a dialog 36 "Is there an empty room?" is output on the display 11 . In addition, the following dialog of the dialog 36 , for example, the user's predictable replies to the answer of the counterpart of the dialog may be output in the form of an icon 37 .

In the case of FIG. 3, an example of displaying this icon at the bottom of the display 11 is exemplified, and the icon 37 may have the form of characters or symbols such as Y, N, T, !, and ?. where "Y" is "Yes", "N" is "No", "T" is "Thank you", "!" is "I know", and "?" is "I am sorry, but I don't" It can be set to display the following dialog of "know".

As one of the plurality of icons 37 is selected by the user, a preset subsequent dialog 38 related to the selected icon is output to the display 11 (S13). 3(d) illustrates a case in which “T” is selected, and in this case, as illustrated, “thank you”, which is the following dialog 38 corresponding to the “T” icon, may be output.

In the previous description, a plurality of pictograms are displayed on the main screen of the application, and when one of them is selected, a menu composed of lower-level pictograms of the corresponding item is entered, and the pictograms representing the dialog are output to the lowest-level menu. Although the case of doing so is exemplified, it will be possible to directly output a pictogram representing a dialog on the main screen. For example, when a pictogram representing the Wi-Fi 27 is selected on the main screen of FIG. 2 , a dialog such as “Where is the Wi-Fi access point (AP)?” may be output to the display 11 .

Meanwhile, the dialog 36 and the following dialog 38 may be displayed such that text in a local language used in a travel destination and text in a language of a region set by the user are concurrently displayed. For example, when an American tourist user visits Korea, Korean may be set as a language used in the travel destination, and in this case, the user may set English as a language used together with Korean. In this case, as in the case of FIG. 3 , when the dialog 36 and the following dialog 38 are output, Korean and English texts can be written together. In addition, when the dialog 36 and the following dialog 38 are output, the voice in the local language of the travel destination may be output together.

4 shows a second operation example illustrating the operation of the communication support application for a mobile device of the present invention, and when the user selects the transaction 24 of the main screen (see FIG. 2 ), the lower level menu is displayed. appears to have entered.

When entering the lower-level menu of the transaction (24) item as shown in FIG. 4 (a), purchase 39, price bargaining 40, currency exchange 41, card payment 42, etc. are performed as lower-level items. The indicated pictogram can be displayed on the display 11 .

And when the user selects one of these items, a preset dialog 43 related thereto is output to the display 11, and an icon 44 indicating a dialog 44 following the dialog 43 is displayed. output to (11).

For example, when the pictogram representing the price bargaining 40 is selected as shown in (b), a dialog 43 saying “How much is this?” is output on the display 11 . In addition, an icon 44 related to the following dialog 44 is output to the display 11 .

In the present embodiment, the case in which "O", "B", and "T" are outputted to the display 11 as icons 44 for the following dialog 44 is exemplified, where "O" is "Okey", " B" may be set to indicate a follow-up dialog saying "Buy it" and "T" to "Thank you."

For example, when the user selects the "B" icon, as shown in (c), the following dialog 46 "I'll buy it (Buy it)" may be output.

In addition, when the user selects a pictogram corresponding to the purchase 37 or the price negotiation 40, a keypad 45 for allowing the seller or the user to input the price of the product may be output to the display 11 have. The seller or the user can touch the number on the keypad 45 to input the price of the product or the price of the desired product, so that the price is displayed on the screen. You can easily deliver the price you want to the other party.

5 shows a third operation example illustrating the operation of the communication support application for a mobile device of the present invention, and when the user selects the food 23 of the main screen (see FIG. 2), the menu at a lower level is displayed. appears to have entered.

When entering the lower-level menu of food 23 as shown in FIG. 5 (a), reservation confirmation (48), food material exclusion request (49), liquor order (50), toilet location confirmation (51) as lower-level items A pictogram showing the like can be displayed on the display 11 .

In the case of this embodiment, as in the previous embodiment, when a pictogram such as a reservation confirmation 48 or an alcoholic beverage order 50 is selected, a preset dialog related thereto and an icon indicating a subsequent dialog of the dialog are output on the display 11 do.

When the user selects the request for exclusion of ingredients 49 , a plurality of pictograms 52 indicating ingredients to be excluded from the ordered food are output as a lower-level menu. These pictograms 52 may include pork, beef, fish, milk, and the like. The user can select one or more of these plurality of pictograms, and when the user completes the selection, a dialog 53 requesting that the user-selected ingredients (eg, pig, fish, milk) be excluded from the food is displayed on the display 11 print out Then, an icon 54 related to a dialogue following the dialogue 53 output therewith is output to the display 11 . In the present embodiment, the case where "F", "P", and "T" are output as the icons 54 for the following dialog is exemplified, where "F" is "Fried rice" and "P" is "Pay" , "T" may be set to indicate the following dialog of "Thank you". When the user selects one of these icons, the set following dialog may be output on the display 11 .

Figure 6 shows a fourth operation example illustrating the operation of the communication support application for mobile devices of the present invention, Figure 6 (a) is that the user has selected the airport 23 of the main screen (see Figure 2) It shows that you have entered the lower level menu when you do.

In the present embodiment, the display of a plurality of pictograms indicating different types of facilities in the airport is exemplified in the submenu of the airport 23 . In this case, when the user selects a pictogram indicating a specific type of facility, the location of the facility corresponding to the selected pictogram may be displayed on the display 11 through a means such as a pointer 58 .

For example, when a pictogram representing the bus stop 55 is selected as shown in FIG. 6B , the location of the bus stop 55 may be displayed on the map 58 within the airport of the display 11 . At this time, the map 58 in the airport may be displayed for each floor, and a floor number selection key 57 may be displayed so that the user can select a floor. When the user selects one of the floor number selection keys 57, the map 56 in the airport corresponding to the selected floor may be displayed.

In this embodiment, the airport facility has been described as an example, but the matters exemplified in this embodiment are equally applicable to other buildings or locations as well as the airport.

The embodiment according to the present invention described above may be implemented in the form of program code that can be executed through various computer components and recorded in a non-transitory computer-readable recording medium. The computer-readable recording medium may include a program code, a data file, a data structure, etc. alone or in combination. The program code recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and used by those skilled in the computer software field. Examples of the computer-readable recording medium include hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floppy disks. medium), and hardware devices specially configured to store and execute program code, such as ROM, RAM, flash memory, and the like. Examples of the program code include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. A hardware device may be converted into at least one software module to perform the processing according to the present invention, and vice versa.

Although the above has been described with reference to specific embodiments of the present invention, those of ordinary skill in the art may vary the present invention within the scope without departing from the spirit and scope of the present invention described in the claims below. It will be understood that modifications and changes can be made to

10: mobile device 11: display
21~35: Pictogram 36: Dialog
37: icon 38: trailing dialog
45: keypad

Claims (10)

Displaying a plurality of pictograms designed to symbolize at least one of a facility, a place, an environment, a situation, an action, and an object of a travel destination on the display of the mobile device;
outputting a preset dialog related to the selected pictogram and a plurality of selectable icons related to subsequent dialogs of the dialog to the display when one of the plurality of pictograms is selected by the user; and
outputting a preset following dialog related to the selected icon to the display as one of the plurality of icons is selected by the user;
The dialog and the following dialog are output in the form of text on the display,
The following dialog includes a preset replies to the other party's answer to the dialog,
The icon includes characters or symbols indicating the content of the replies,
The pictogram includes a plurality of ingredients that you want to exclude from food,
The dialog is a method for supporting communication of travelers using a mobile device, characterized in that it includes an order to exclude an item selected by the user from among the plurality of food materials.
delete According to claim 1,
The pictogram is a method for supporting communication of travelers using a mobile device, characterized in that it further comprises one or more of hotel check-in, hotel check-out, and hotel facilities.
According to claim 1,
The pictogram is a method for supporting communication of travelers using a mobile device, characterized in that it further comprises one or more of product purchase, price bargaining, currency exchange, and card payment.
5. The method of claim 4,
When the pictogram corresponding to the purchase or price bargaining is selected by the user,
A method for supporting communication of travelers using a mobile device, characterized in that a keypad for allowing a seller or a user to input a price of an item is output on the display.
delete According to claim 1,
In the dialog and the following dialog, text in a local language used in a travel destination and text in a language set by a user are written together on the display.
According to claim 1,
A method for supporting communication of travelers using a mobile device, characterized in that when the dialog and the following dialog are output, the voice in the local language of the travel destination is output together.
According to claim 1,
The pictogram further includes a plurality of facilities of different types,
Displaying the location of the facility corresponding to the pictogram selected by the user on the display; The method for supporting communication of travelers using a mobile device, characterized in that it further comprises.
A traveler's communication support application storable in the memory of the mobile device and executed by the processor of the mobile device, the application comprising:
Displaying a plurality of pictograms designed to symbolize at least one of a facility, a place, an environment, a situation, an action, and an object of a travel destination on the display of the mobile device;
outputting a pre-stored dialog related to the selected pictogram and a plurality of selectable icons related to subsequent dialogs of the dialog to the display when one of the plurality of pictograms is selected by the user; and
When one of the plurality of icons is selected by the user, outputting a preset following dialog related to the selected icon to the display;
The dialog and the following dialog are output in the form of text on the display,
The following dialog includes a preset replies to the other party's answer to the dialog,
The icon includes characters or symbols indicating the content of the replies,
The pictogram includes a plurality of ingredients that you want to exclude from food,
The dialog is characterized in that it includes an order to exclude the item selected by the user from among the plurality of ingredients from the food, the traveler communication support application.

Images