WO2021023012A1

WO2021023012A1 - Wearable translation and information retrieval apparatus and use method therefor

Info

Publication number: WO2021023012A1
Application number: PCT/CN2020/103515
Authority: WO
Inventors: 林泉
Original assignee: 汕头大学
Priority date: 2019-08-02
Filing date: 2020-07-22
Publication date: 2021-02-11
Also published as: CN110347215A

Abstract

A wearable translation and information retrieval apparatus, a trigger control unit, an image acquisition unit, an image recognition unit, an information processing unit, and information display or reading unit, and a method for using the apparatus. A wearable device is used for achieving the functions of translation and retrieval, can greatly reduce the burden on the user to carry the device, can also reduce the preparation time duration for the user to use the device, minimizes the interference to the reader in the translation/retrieval process, and ensures that reading is smoothly performed. The implementation process is that the reader can obtain the required information by pointing his finger at information to be translated and/or retrieved. This process is an extremely "natural" human-computer interaction mode, and is easy for users to learn and use. According to the method and apparatus, the scanned information to be translated and/or retrieved can also be connected to the Internet for translation and/or retrieval, and the extensibility of the method and information frontier are improved.

Description

Wearable translation and information retrieval device and its use method

Technical field

The present invention relates to the field of computers, and more specifically to a wearable translation and information retrieval device and its use method.

Background technique

When reading non-native language materials or professional documents with a large number of professional vocabulary, readers usually need the help of bilingual dictionaries or the Internet to find unfamiliar foreign vocabulary or explanations of professional vocabulary. In the early days, the main way to solve this problem was to use paper/electronic bilingual dictionaries or Internet-enabled devices such as translators, mobile phones or computers to enter the vocabulary to be queried to obtain relevant information. However, this method is inconvenient in operation and may cause serious interference to the reading process. To this end, some improved methods have recently appeared, such as using a scanning translation pen or a voice input translator.

These new and improved methods are indeed much more convenient than traditional methods, but there are still many shortcomings. For example, the scanning translation pen is still not convenient enough to carry, and cannot connect to the Internet to obtain information; the voice input translator has problems such as inaccurate input or heavy input burden.

Therefore, it is necessary to provide a new implementation method and device, which can allow users to obtain translation information or perform information retrieval in real time under a smaller burden.

Summary of the invention

The purpose of the present invention is to provide a wearable translation and information retrieval device and its use method. The present invention allows the user to quickly obtain the purpose of the information that needs to be translated and/or retrieved only by pointing at the information to be translated and/or retrieved with a finger without grasping the translation device.

To achieve the above objective, the present invention provides a wearable translation and information retrieval device, including a trigger control unit, an image acquisition unit, an image recognition unit, an information processing unit, and an information display or reading unit;

The trigger control unit is used to identify the control signal input by the user, and control the working state of the translation and information retrieval device, including turning on, stopping or suspending;

The image acquisition unit is used to acquire a complete image of the language/graphic information pointed to by the finger;

The image recognition unit is used to recognize the text/retrievable graphic information in the image acquired by the image acquisition unit;

The information processing unit is used to translate and/or retrieve the text/retrievable graphic information recognized by the image recognition unit into the target language/graphic information or to translate and/or retrieve related content via the Internet;

The information display or reading unit is used to display or read the translated/retrieved information.

Further, the trigger control unit includes a shock sensor, a pressure sensor or a capacitive touch screen.

Furthermore, the image acquisition unit includes a camera or a scanner.

Furthermore, the trigger control unit and the image acquisition unit are worn on the fingers, and other parts are worn on other parts of the body, thereby reducing the burden on the fingers. At this time, the image acquisition unit is connected with an information sending module, and the The image recognition unit is connected with an information receiving module, and the information sending module sends the image information acquired by the image acquisition unit to the information receiving module, and the image recognition unit connected thereto performs recognition.

Further, the image recognition unit or the information processing unit is connected to a second information sending module, the information processing unit is connected to a second information receiving module, and the second information sending module connects the image recognition unit to The image information before recognition is sent to the peripheral device for online identification, translation and/or retrieval on the Internet, or the information received by the information processing unit is sent to the peripheral device for online translation and/or retrieval on the Internet, the second information receiving module The information translated and/or retrieved online by the peripheral device is sent to the information processing unit. The peripheral devices include electronic devices such as mobile phones and computers.

Further, it can be set whether to connect the second information sending module and the second information receiving module with a switch device for online identification, translation and/or retrieval of peripheral equipment and the Internet.

The present invention also provides a method for implementing a wearable translation and information retrieval device. The method includes the following steps:

The finger wearing the image acquisition unit points to the vicinity of the location of the information to be processed, and specifies the information content to be translated or retrieved;

Trigger the image acquisition unit to acquire the language/graphic information image to be processed by controlling the trigger control unit worn on the finger;

Identify, translate and/or retrieve the language/graphic information image to be processed, and obtain the language/graphic information after translation/retrieval;

Display or read out the translated/searched information.

Further, the triggering method of the trigger control unit includes touching a finger wearing the trigger control unit, triggering the image acquisition unit to acquire a complete image of the language/graphic information to be translated/retrieved; or using a vibration/pressure detector to detect Pointing to the action information of the finger that needs to translate or retrieve information, when the vibration amplitude or pressure of the finger exceeds a certain threshold, the image acquisition unit is triggered to acquire the complete image of the language/graphic information to be translated/retrieved.

Further, the image of the language/graphic information to be translated/retrieved is optically recognized to obtain the recognized text/retrievable graphic information. The text/retrievable graphic information can be used for the translation of different languages/graphics, and it can also be used on the Internet. Search to obtain language/graphic information after translation/search. Another way is to pass the image information through the wireless communication module, including the information sending module and the information receiving module, to peripheral devices (such as mobile phones) for optical recognition and translation/retrieval, and to obtain translated and/or retrieved language/graphic information .

Further, display or read out the translated/retrieved information.

The implementation of the present invention has the following beneficial effects:

The implementation method of the wearable translation and information retrieval device of the present invention uses the wearable device to realize the function of translation and/or retrieval, which can greatly reduce the burden on the user to carry the device, reduce the preparation time for the user to use the device, and minimize the translation and/or/ Or the retrieval process interferes with readers to ensure the smooth progress of reading. The realization process of the present invention is that the reader can obtain the required information by pointing his finger at the information to be translated/retrieved. This process is an extremely "natural" human-computer interaction mode, which is easy for users to learn and use. In addition, the present invention can simultaneously access the scanned information to be translated and/or retrieved into the Internet for query, which improves the scalability and information frontier of the method.

Description of the drawings

Figure 1 is a schematic diagram of an embodiment of the wearable translation and information retrieval device of the present invention.

Figure 2 is a principle flow chart of the implementation method of the wearable translation and information retrieval device of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

As shown in Fig. 1, the input device for wearable finger-sensing wireless communication includes H10 worn on the finger and H20 worn on the wrist.

Specifically, the H10 includes a trigger control unit H11, an image acquisition unit H12, an information sending module H13, and a battery module H14. The specific working methods are as follows:

The trigger control unit H11 is composed of a touch switch and a vibration/pressure detector. When pressed by a finger, the translation and information retrieval device is activated, the image acquisition unit H12 is triggered, and the camera acquires the target to be translated and/or retrieved by the finger. The complete image of the message. The information sending module H13 converts the complete image information into a wireless signal and transmits it.

The H20 includes an information receiving module H21, an image recognition unit H22, an information processing unit H23, an information display/reading unit H24, and a battery module H25.

The information receiving module H21 restores the received signal to image information, the image recognition unit H22 recognizes the image information as text/retrievable graphic information, and the information processing unit H23 translates the text/retrievable graphic information recognized by the image recognition unit and/ Or retrieve the target language/graphic information or translate and/or retrieve related content through the Internet, and finally display or read the information translated/retrieved by the display/reading unit H24.

It can be seen from the above that the wearable translation and information retrieval device of the present invention activates the device by triggering the control unit H11, the image acquisition unit H12 acquires the complete image of the language/graphic information to be translated and/or retrieved, and the information sending module H13 will complete The image information is converted into a wireless signal and transmitted. The information receiving module H21 restores the signal to image information after receiving the signal. The image recognition unit H22 recognizes the acquired image information as text/retrievable graphic information, and the information processing unit H23 recognizes the image The recognized text/retrievable graphic information is translated and/or retrieved into the target language/graphic information or related content is translated and/or retrieved via the Internet, and finally the information translated/retrieved by the display/reading unit H24 is displayed or read aloud.

As another embodiment, the image recognition unit H22 or the information processing unit H23 may also be connected with a second information sending module, and the information processing unit H23 may also be connected with a second information receiving module, and the second information sending The module sends the image information before recognition by the image recognition unit H22 to the peripheral device for Internet online recognition, translation and/or retrieval, or sends the information received by the information processing unit H23 to the peripheral device for Internet online translation and/ Or search, the second information receiving module sends the online translation and/or searched information of the peripheral device to the information processing unit H23.

As shown in Figure 2, the implementation method of the wearable translation and information retrieval device includes the following steps:

S1 points the finger above or below the location of the information to be translated and/or retrieved.

S2 triggers the camera to acquire a complete image of the language/graphic information to be translated and/or retrieved by touching/pressing the device or vibration/pressure detector worn on the finger.

S3 Perform optical recognition, translation and/or retrieval of images of language/graphic information to be translated and/or retrieved, or transmit the images to peripheral devices (such as mobile phones) through wireless communication modules for optical recognition, translation and/or retrieval, and obtain Language/graphic information after translation and/or retrieval.

S4 displays or reads out the translated and/or retrieved information.

It can be seen from the above that the implementation method of the wearable translation and information retrieval device of the present invention is to obtain the position of the information to be translated and/or retrieved by pointing the user's finger, and by the user touching/pressing the device or vibration/pressure The detector triggers the camera to obtain a complete image of the language/graphic information to be translated and/or retrieved, and then performs optical recognition, translation and/or retrieval on the image of the language/graphic information to be translated and/or retrieved, or transmits the image through wireless communication The module is passed to peripheral devices (such as mobile phones) for optical recognition, translation and/or retrieval, to obtain translated and/or retrieved language/graphic information, and finally displays or reads the translated and/or retrieved information to the user .

This method allows users to quickly obtain translation and/or information retrieval purposes without interrupting the reading process.

The present invention has been described above in conjunction with the best embodiments, but the present invention is not limited to the embodiments disclosed above, but should cover various modifications and equivalent combinations made according to the essence of the present invention. The described embodiments are merely Some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

Claims

A wearable translation and information retrieval device, which is characterized by a trigger control unit, an image acquisition unit, an image recognition unit, an information processing unit, and an information display or reading unit;

The trigger control unit is used to identify the control signal input by the user and control the working state of the translation and information retrieval device;

The image acquisition unit is used to acquire a complete image with language/graphic information pointed by a finger;

The image recognition unit is used to recognize the text/retrievable graphic information in the image acquired by the image acquisition unit;

The information processing unit is used to translate and/or retrieve the text/retrievable graphic information recognized by the image recognition unit into the target language/graphic information, or to translate and/or retrieve related content via the Internet;

The information display or reading unit is used to display or read the translated/retrieved information.
The wearable translation and information retrieval device according to claim 1, wherein the trigger control unit comprises a vibration sensor, a pressure sensor or a capacitive touch screen.
The wearable translation and information retrieval device according to claim 1, wherein the image acquisition unit comprises a camera or a scanner.
The wearable translation and information retrieval device according to claim 1, wherein the trigger control unit and the image acquisition unit are worn on a finger.
The wearable translation and information retrieval device according to claim 1, wherein the image acquisition unit is connected with an information transmission module, the image recognition unit is connected with an information reception module, and the information transmission module transmits the image The image information obtained by the obtaining unit is sent to the information receiving module and is recognized by the image recognition unit connected to it.
The wearable translation and information retrieval device according to claims 1 to 5, wherein the image recognition unit or the information processing unit is connected with a second information sending module, and the information processing unit is connected with the second information The receiving module, the second information sending module sends the image information before the image recognition unit recognition to the peripheral device for Internet online recognition, translation and/or retrieval, or sends the information received by the information processing unit to the peripheral The device performs Internet online translation and/or retrieval, and the second information receiving module sends the online translation and/or retrieval information of the peripheral device to the information processing unit.
The wearable translation and information retrieval device according to claim 6, wherein the second information sending module and the second information receiving module are provided with a switch device for starting or closing the connection with peripheral equipment and Internet online Identification, translation and/or retrieval.
A method for using the wearable translation and information retrieval device according to claim 1, wherein the finger wearing the image acquisition unit points to the location of the information to be processed;

Triggering the image acquisition unit to acquire the image of the language/graphic information to be processed by controlling the trigger control unit worn on the finger;

Recognize, translate and/or retrieve the image of the language/graphic information to be processed, and obtain the language/graphic information after translation and/or retrieval;

Display or read out the translated/searched information.
The method according to claim 8, wherein the triggering mode of the control unit includes touching, pressing, or shaking a finger wearing the control unit.
The method according to claim 8 or 9, further comprising sending the recognized language/retrievable graphic information to peripheral devices for translation and/or retrieval, or sending the image of the language/graphic information to be processed to The terminal device performs identification, translation and/or retrieval, and then sends the translated and/or retrieved information to the information display or reading unit.