TW201635171A - Graph communication system and method - Google Patents

Abstract

This invention discloses a graph communication system and method. The graph communication system is established on a mobile apparatus; the graph communication system comprises a voice conversion unit, a graph database, a searching unit or/and a screen capture unit; a user can dictate a word or continuously dictate a plurality of words to the mobile apparatus, while the voice conversion unit can be used for converting the words into characters, graphs corresponding to implications of the characters are searched through the searching unit and are then displayed on a screen of the mobile apparatus, and the screen capture unit can be used for automatically capturing pictures on the screen and storing the pictures in a photo library of the mobile apparatus, so that the user can directly play graphs to be watched by persons speaking different languages or open the photo library of the mobile device to continuously play each the graphs to be watched by the persons speaking different languages, and furthermore , the effect of communicating or inquiring by virtue of the graphs is achieved.

Description

Graphic communication system and method

The present invention relates to a device for communicating between different language users, and more particularly to a graphical communication system and method that can communicate using graphics.

With the improvement of living standards, modern people are paying more and more attention to leisure activities, and those with more prosperous family economies often arrange trips for overseas travel. Traveling abroad, whether it is with a tour group or a free way, there will inevitably be a situation in which you need to communicate and ask with foreigners. This is especially true for free travel.

English can be regarded as the common language of the current international. If the English level is enough to communicate with foreigners, there will be no inability to communicate with foreigners when traveling, but if the English level is weak, unless there is a good friend of English. Peers, otherwise use a language translator to speak or text.

Although the language translators currently seen can translate words or sentences into different languages to achieve the effect of communicating with different language speakers, in general, the translation of simple sentences is less problematic in terms of the correctness of translation. And complex sentences are more prone to translation distortion, which involves the development of translation software and database, and the translation software of more national languages The style is also more complicated and the development costs are even higher.

Secondly, humans have a variety of communication methods such as spoken language, words, pictures (graphics, patterns) or sign language. It takes time to use spoken language translators to communicate with spoken words or words, and pictures can provide information more quickly than spoken and written words. Achieving communication effects and overcoming language barriers, however, there are no devices available to communicate with people who use different languages.

The main object of the present invention is to provide a graphic communication system and method, which can be used by a user to communicate or interrogate with a language and a language using a mobile device that is carried by the user. The communication effect is better than that of a conventional language or a text translation. The method is more direct, effective, and has practical value.

Therefore, in order to achieve the foregoing object, the present invention provides a graphic communication system including a voice conversion unit, a sounding device built in a mobile device and connected to the mobile device, for converting the voice spoken by the user into text. And displayed on the touch screen of the mobile device for confirmation; a graphic database containing a plurality of graphics capable of displaying a specific text meaning; a search unit built in the mobile device and connected to the voice conversion unit and the graphic A database for searching for a graphic corresponding to the meaning of the text and displaying it on the touch screen of the mobile device.

Further, the mobile device is a smart phone that can be connected to the network.

Further, the voice conversion unit is built in the mobile device application.

Further, the graphic database is built in one of a network cloud or a mobile device, and the search unit connects the graphic database and searches for graphics through the network.

Further, the search unit is a Google graphics search engine.

Further, a screen capture unit is further disposed on the mobile device and connected to the search unit for automatically capturing a screen of the screen when the searched graphic is displayed on the screen of the mobile device, and storing the screen on the mobile device Photo gallery for viewing.

Further, the voice conversion unit, the search unit and the picture capturing unit are integrated and built into the mobile device by using a PHONE GAP application.

In addition, the present invention further provides a graphical communication method using the foregoing graphic communication system, which first dictates a word toward a mobile device, and then converts the word into text through the voice conversion unit, and then searches for the corresponding word meaning through the search unit. Finally, the graphic is displayed on the screen of the mobile device, and the user can display the graphic to a different language to obtain the effect of communicating or inquiring through the graphic.

In addition, the present invention further provides a graphical communication method using the foregoing graphic communication system, which first dictates a word toward a mobile device, and then converts the word into text through the voice conversion unit, and then searches for the corresponding text meaning through the search unit. a graphic, and then display the graphic on the mobile device The screen is automatically captured in the photo library of the mobile device, and the user can directly display the graphic of the screen to a different language person, or open the photo library of the mobile device to find the graphic to give a different language. Watching and getting results through graphic communication or inquiry.

Further, the user can continually dictate a plurality of different words toward the mobile device, so that the mobile device can automatically capture a plurality of graphics corresponding to different words and store them in the photo library of the mobile device, and the user can open the action. The photo library of the device continuously plays each of the graphics to be viewed by different languages, and enhances the effect of communication or inquiry through graphics.

1‧‧‧ mobile device

2‧‧‧ touch screen

3‧‧‧ language selection area

4‧‧‧ microphone

5‧‧‧Text display area

6‧‧‧Start button

7‧‧‧Graphic display area

8‧‧Photo library

10‧‧‧Graphic communication system

12‧‧‧Voice Conversion Unit

14‧‧‧Graphic database

16‧‧‧Search unit

20‧‧‧Graphic communication system

22‧‧‧Screen capture unit

100‧‧‧Graphic communication method

110‧‧‧ Speaking words to mobile devices

120‧‧‧Converting words into words through a voice conversion unit

130‧‧·Search for the graphic meaning of the corresponding words through the search unit

140‧‧‧ Display the graphic on the screen of the mobile device

150‧‧‧Automatic capture of the screen image stored in the photo library of the mobile device

The first figure is a system diagram of a preferred embodiment of the present invention.

The second to fourth figures are diagrams showing the state of use of a preferred embodiment of the present invention, showing a mobile device for recording, selecting text and graphics.

Figure 5 is a system diagram of another preferred embodiment of the present invention.

Figure 6 is a flow diagram of a method of still another preferred embodiment of the present invention.

Figure 7 is a flow chart of a method of still another preferred embodiment of the present invention.

In order to enable the reviewing committee to have a better understanding and recognition of the features and features of the present invention, the following preferred embodiments are illustrated and described below with reference to the drawings: First, referring to the first figure, the present invention Good implementation The graphic communication system 10 is built in a mobile device 1, such as a smart phone that can be connected to a network, such as a smart phone with Android and I-OS two systems. The invention uses a smart phone as an embodiment. However, it does not exclude other mobile devices that can be connected to the Internet, such as a tablet computer, etc., which can be set as an application application running on a smart phone, for the user to use the graphic to communicate or interrogate with different languages, including a voice. The conversion unit 12, a graphic database 14 and a search unit 16.

The voice conversion unit 12 is stored in an application of the mobile device 1 or a built-in firmware of the mobile device, such as a Google speech recognition engine. In this embodiment, a Google speech recognition engine is used to utilize the microphone of the mobile device 1 . The voice dictated by the user is converted into a text, and then a plurality of voice similar words are displayed on the touch screen of the mobile device for the user to select and confirm.

The graphic database 14 can be built in the mobile device 1 (self-built photo gallery) or in the network cloud (searchable through the network), and includes a plurality of graphics that can display specific text meanings, this embodiment Search through the Internet and search for graphics.

The search unit 16 is a search engine and can be built in the mobile device 1 or a network search engine, such as a Google graphic, a map search engine, etc., and connected to the voice conversion unit 12 and the graphic database 14 for searching correspondingly. After confirming the graphic meaning of the text, and displaying a number of similar meanings on the touch screen of the mobile device for selection, this embodiment uses Google graphics. Shape, map search engine.

In addition, the voice conversion unit 12 and the search unit 16 are integrated with a PHONE GAP application and built into the mobile device 1 (for example, integrated into an APP application that can drive the Google speech recognition engine and Google graphics, a map search engine). The PHONE GAP application is a familiar app for cross-platform (eg Android, I-OS) smart phone apps, which can be used to drive smart phones with cameras, speakers, microphones, GPS positioning, sensors, The functions such as the digital compass are not described here.

Therefore, the mode, function and function of the graphic communication system 10 of the present invention are as follows: when the user wants to communicate with foreigners or ask for things abroad, the graphic communication system 10 can be activated, as shown in the second figure, before the second picture The language selection area 3 on the screen 2 (touch screen) of the mobile device 1 selects its own language, and then presses the microphone 4 icon displayed on the screen 2, the graphic communication system 10 can cause the mobile device 1 to start recording. The user can dictate the words to be communicated or inquired, such as address, station, landmark, store name, food, etc., after the mobile device 1 delivers the recorded voice to the voice converting unit 12, the voice converting unit 12 A plurality of words similar to the voice can be displayed on the text display area 5 of the screen 2 for the user to select and confirm. As shown in the third figure, the microphone 4 icon on the screen 2 is pressed to stop the recording.

After the user selects and confirms the correct meaning on the screen 2, and clicks the start button 6 on the screen 2, the search unit 16 can start. The operation is to search for the graphic corresponding to the meaning of the text after confirmation, and a plurality of graphics close to the meaning of the text can be displayed on the graphic display area 7 on the screen 1, as shown in the fourth figure. In this way, the user can select a suitable graphic and touch the screen 2, so that the selected graphic is displayed on the screen 2 for the user to watch, and the graphic can be used to communicate with different languages. Or ask for things, unlike the way in which you use a language translator to communicate with foreigners.

The use of language translation machines to communicate with foreigners is a communication method of spoken or written language. The correctness of language translation machine translation will affect the efficiency and correctness of communication. This method of using graphic communication can be more than language or text. For direct and correct communication, communication is better than using language translators, and it is effective in transcending language barriers and direct communication.

Accordingly, the present invention can form a graphic communication system by using a mobile communication system in a mobile device that the user can carry, and the user can dictate the mobile device by communicating the content of the foreigner to the mobile device. The voice conversion unit, the graphic database and the search unit cooperate to convert the voice into text for the user to select and confirm, and automatically search for a graphic with the same or close meaning as the text, for the user to use the selected graphic and the different language. Communicate or ask, the communication effect is better than the traditional language or text translation, and it is of practical value.

In addition, after the inventor actually tests the operation of the graphic communication system 10, the voice converting unit 12 converts the voice into a text recognition rate and is correct. The rate is very high. Therefore, the screen 2 of the mobile device 1 does not need to display a certain number of characters for the user to select and confirm, and the search unit 16 associates the graphic database 14 with the correct rate of searching for the corresponding text. Therefore, it is not necessary to display a plurality of graphics on the screen 2 of the mobile device 1 for the user to select, thereby simplifying the display and operation mode of the graphic communication system 10 on the mobile device 1 and improving the convenience of the user operation. That is, after the user presses the icon of the microphone 4 displayed on the screen 2 to record, the voice converting unit 12 can directly convert the voice into text, and the searching unit 16 searches for a graphic corresponding to the meaning of the text, and A graphic close to the meaning of the text can be displayed on the screen 1 for the user to communicate or interrogate with the operator who uses the selected language, and the graphic communication system 10 is displayed on the mobile device 1 and operates in the mode. Simplification is accomplished by adjusting the PHONE GAP application described above, and such techniques are well known and will not be described here.

As shown in the fifth figure, a graphic communication system 20 according to another preferred embodiment of the present invention is substantially the same as the graphic communication system 10 except that the voice conversion unit 12, the graphic library 14 and the search unit are included. In addition, the difference is that a screen capture unit 22 is further included, and can also be integrated into the mobile device 1 and connected to the search unit 16 through the PHONE GAP application. Therefore, the operation mode of the graphic communication system 20 is also similar to that of the graphic communication system 10. In particular, when the user displays the graphic on the screen 2 of the mobile device 1 through the operation of the graphic communication system 20, the The screen capture unit 22 can automatically capture the graphic image on the screen 2 and store it in the mobile device 1 Photo Gallery 8 (a collection of photos for both smart phones and tablets) is provided for viewing by the user directly to the screen of the screen 1 for viewing by different languages, or to open the photo library 8 of the mobile device 1 The graphic is given to people who speak different languages to obtain the effect of communicating or inquiring through graphics.

As can be seen from the above, as shown in the sixth figure, the present invention further provides a graphical communication method 100 for using the graphic communication system 10, comprising the step 110 of dictating a word to the mobile device 1 first, and then transmitting the voice conversion unit 12 The step 120 of converting the words into words, and then searching through the search unit 16 for the corresponding words of the words means 130, and finally, the pictures can be displayed on the screen 2 of the screen 2 of the mobile device 1, the user can The graphics are given to people who speak different languages to get the effect of communicating or asking through graphics.

In addition, as shown in the seventh figure, the present invention further provides a graphic communication method 200 using the graphic communication system 20, which includes the steps 110-140 of the graphic communication method 100, and further includes automatically capturing the screen 2. The screen is stored in the photo library of the mobile device 1 in step 150. In addition to directly displaying the graphic of the screen 2 to the different language users, the user can also open the photo library of the mobile device 1 to find the graphic to be viewed by different languages. , the effect of communicating through graphics or asking questions.

Furthermore, the present invention further provides a graphical communication method using the graphic communication system 20, wherein the user can continuously recite a plurality of words toward the mobile device 1, such as dictating "train station", "road" and "direction" in sequence. So that the mobile device 1 can automatically capture the plural graphic corresponding to the meaning of different words, and store In the photo library 8 of the mobile device 1 (ie, repeating steps 110-150 of the graphic communication method 200), for example, three screens displaying the "train station", "road" and "direction" graphics in sequence can be automatically captured. The screen allows the user to open the photo library of the mobile device 1 and play continuously (the finger continuously dials the graphic displayed on the screen 2 of the mobile device 1). The three modes of the "train station", "road" and "direction" are given to the operation. Viewing by different language users enables those who speak different languages to understand the question that the user wants to ask is "Which way is the train station and which direction to go" to enhance the effect of communication or inquiry through the graphic.

However, the above description is only a few preferred embodiments of the present invention, and the scope of the patent application and the content of the description of the present invention are not limited thereto, All should still fall within the scope of protection covered by the scope of the invention.

10‧‧‧Graphic communication system

12‧‧‧Voice Conversion Unit

14‧‧‧Graphic database

16‧‧‧Search unit

1‧‧‧ mobile device

Claims (10)

A graphic communication system is built into a mobile device, and can be used by a user to communicate or interrogate by using a graphic and a language, including: a voice conversion unit, a radio device built in the mobile device and connected to the mobile device For converting a user's dictated voice into text; a graphic database containing a plurality of graphics capable of displaying a specific textual meaning; and a search unit built on the mobile device and connected to the voice conversion unit and A graphic database for searching for a graphic corresponding to the meaning of the text and displaying it on the screen of the mobile device. The graphic communication system according to claim 1, wherein the mobile device is a smart phone connected to the network. The graphic communication system of claim 2, wherein the voice conversion unit is an application built in the mobile device. For example, the graphic communication system described in claim 2, wherein the graphic database is built in one of a network cloud or a mobile device, and the search unit connects the graphic database and searches for graphics through the network. The graphic communication system of claim 4, wherein the search unit is a Google graphics search engine. The graphic communication system of claim 4, further comprising a picture capturing unit, disposed in the mobile device and connected to the searching unit, when the graphic for searching is displayed on the screen of the mobile device The screen of the screen is automatically captured and stored in the photo library of the mobile device for viewing. Such as the graphic communication system described in claim 6 of the patent scope, wherein the language The sound conversion unit, the search unit and the picture capture unit are integrated and built into the mobile device using a PHONE GAP application. A graphical communication method using a graphical communication system as described in claim 1 is directed to dictating a word to a mobile device, and then converting the word into text through the voice conversion unit, and then searching for a corresponding word through the search unit. The text means the graphic. Finally, the graphic is displayed on the screen of the mobile device, and the user can display the graphic to the different language speakers to obtain the effect of communicating or inquiring through the graphic. A graphical communication method using a graphical communication system as described in claim 6 is to first dictate a word toward a mobile device, and then convert the word into text through the voice conversion unit, and then search for the corresponding word through the search unit. The text means the graphic, and then displays the graphic on the screen of the mobile device, and then automatically captures the screen of the screen and stores it in the photo library of the mobile device, so that the user can directly display the graphic of the screen to the different language speakers. Or open the photo library of the mobile device to find the graphic to be viewed by different languages, and the effect of communicating or inquiring through the graphic is obtained. The graphical communication method of claim 9, wherein the user can continually dictate a plurality of words toward the mobile device, so that the mobile device can automatically capture a plurality of graphics corresponding to different words and store them in the action. The photo library of the device allows the user to open the photo library of the mobile device, and continuously play each of the graphics for viewing by different languages to enhance the effect of communication or inquiry through graphics.