KR20210080764A - Neckband-type sound converting device - Google Patents

Abstract

The present invention relates to a learning system using a neckband type sound converter, which shoots images by a camera included in a neckband type sound converter detachably worn on a user's body, and rapidly informs meanings of a character to a user through character recognition and translation in the images. The learning system using a neckband type sound converter comprises: a body part placed at the user's body and including both ends forming an opening at a front side; a speaker mounted at the body part; a camera mounted at the body part to shoot images in a preset reference direction; a light irradiation unit irradiating light to a shooting position of the camera in the preset reference direction; a communication unit communicating with an electronic communication terminal; an input unit acquiring a shooting input; and a data processor controlling the camera and the light irradiation unit to perform a shooting mode, for operating the camera according to a shooting operation input from the input unit, for receiving a shooting image from the camera, for transmitting the shooting image from the camera to the electronic communication terminal through the communication unit, and for receiving translation information from the electronic communication terminal to apply a sound signal included in the translation information to the speaker so that sound is output.

Description

Learning system using a neckband-type sound converter {NECKBAND-TYPE SOUND CONVERTING DEVICE}

The present invention relates to a learning system, and more particularly, to quickly provide the meaning of text to a user through image capturing by a camera provided in a neckband-type sound conversion device that is detachably worn on a user's body, and text recognition and translation in the captured image. It relates to a learning system using a neckband-type sound transducer that can inform you.

Recently, the number of foreign visitors to Korea and Koreans visiting overseas has been steadily increasing year by year. In particular, the number of Chinese visits to Korea is increasing rapidly as transactions with China are made in the overall industry. In addition, it is easy to predict that a large number of visitors from all over the world, including Japan, will visit. Also, the number of people visiting Korea for business purposes is increasing. Therefore, communication between numerous visitors from all over the world and communication between Koreans is becoming very important.

These foreign visitors and overseas travelers usually use hotels with thorough services. Generally, in hotels, when visitors want to communicate using their own language, or they use a language other than their own, If you want to communicate with someone you want to communicate with, you can communicate through an interpreter resident in the hotel, or you can use e-mail or facsimile using the Internet.

Accordingly, in the field of technology, it is required to be able to more conveniently understand the meaning of foreign languages in tourism or business.

The present invention is a neckband type that can quickly inform a user of the meaning of a character through image capturing by a camera provided in a neckband type sound conversion device that is detachably worn on the user's body, and character recognition and translation in the captured image. An object of the present invention is to provide a learning system using an acoustic transducer.

A learning system using a neckband-type sound conversion device according to the present invention is seated on the user's body and includes a main body having both ends that form an opening in the front, a speaker mounted to the main body, and a preset installed in the main body. A camera for photographing an image in a reference direction, a light irradiator for irradiating light to a photographing position of the camera in a preset reference direction, a communication unit for communicating with an electronic communication terminal, an input unit for obtaining a photographing operation input, and a camera; The shooting mode is performed by controlling the light irradiation unit, but the camera is operated according to the shooting operation input from the input unit, the shooting image is received from the camera, and the shooting image from the camera is transmitted to the electronic communication terminal through the communication unit, and electronic communication and a data processor for receiving the translation information from the terminal and emitting sound by applying an acoustic signal included in the translation information to a speaker.

In addition, the learning system includes a communication unit that communicates with the neckband-type sound conversion device, receives a photographed image through the communication unit, and includes a voice synthesized from translated text of text corresponding to characters included in the received photographed image. It is preferable to provide an electronic communication terminal including a data processor for transmitting translation information including an acoustic signal and/or translated text to a neckband-type acoustic conversion device through a communication unit.

The present invention can promptly inform the user of the meaning of a character through image capturing by a camera provided in a neckband-type sound conversion device that is detachably worn on the user's body, and character recognition and translation in the captured image, and electronic communication By using only the neckband-type sound converter without operating the terminal to use the translation function, there is an effect of improving the convenience when using it for study/travel.

1 is a perspective view of a neckband-type acoustic conversion device according to the present invention.
FIG. 2 is a configuration diagram of a learning system using the neckband-type acoustic transducer of FIG. 1 .

Hereinafter, the present invention will be described in detail through examples and drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of the present invention are included. In connection with the description of the drawings, like reference numerals may be used for like components.

In this document, expressions such as "have", "may have", "includes", or "may include" refer to the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.

In this document, expressions such as "A or B", "at least one of A and/and B", or "one or more of A or/and B" may include all possible combinations of the items listed together. . For example, "A or B", "at least one of A and B", or "at least one of A or B" means (1) includes at least one A, (2) includes at least one B; Or (3) it may refer to all cases including both at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" used in this document may modify various elements, regardless of order and/or importance, and may modify one element to another. It is used only to distinguish it from the components, and does not limit the components. For example, the first user equipment and the second user equipment may represent different user equipment regardless of order or importance. For example, without departing from the scope of the rights described in this document, a first component may be referred to as a second component, and similarly, the second component may also be renamed as a first component.

A component (eg, a first component) is "coupled with/to (operatively or communicatively)" to another component (eg, a second component) When referring to "connected to", it will be understood that the certain element may be directly connected to the other element or may be connected through another element (eg, a third element). On the other hand, when it is said that a component (eg, a first component) is "directly connected" or "directly connected" to another component (eg, a second component), the component and the It may be understood that other components (eg, a third component) do not exist between other components.

The expression "configured to (or configured to)" as used in this document, depending on the context, for example, "suitable for", "having the capacity to" It can be used interchangeably with "," "designed to", "adapted to", "made to", or "capable of". The term “configured (or set up to)” may not necessarily mean only “specifically designed to” hardware. Instead, in some circumstances, the expression “a device configured to” may mean that the device is “capable of” with other devices or parts. For example, the phrase "a processor configured (or configured to perform) A, B, and C" may be used to execute a dedicated processor (eg, an embedded processor), or one or more software programs stored in a memory device, to perform the corresponding operations. By doing so, it may mean a generic-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe specific embodiments, and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meanings as commonly understood by one of ordinary skill in the art described in this document. Among the terms used in this document, terms defined in a general dictionary may be interpreted with the same or similar meaning as the meaning in the context of the related art, and unless explicitly defined in this document, have an ideal or excessively formal meaning. not interpreted In some cases, even terms defined in this document cannot be construed to exclude embodiments of this document.

1 is a perspective view of a neckband-type acoustic conversion device according to the present invention.

The present invention's neckband-type acoustic transducer 1 forms an opening in the front through which the user's body (eg, neck, etc.) can pass, and has at least an annular or U-shaped shape, around the user's neck or shoulder. It has a body portion 10 to be seated on the. At least a portion of the body portion 10 may be configured to have elasticity. A plurality of sound emission holes 11 for emitting sound to the outside are provided on the outer surface of the main body 10 .

The body portion 10 has first and second accommodating portions 12a and 12b, respectively, which are opposite ends of the body portion 10 forming an open portion, and the first and second accommodating portions 12a and 12b, respectively, are The first and second earphone units 20a and 20b are respectively provided with first and second grooves 14a and 14b in which they are accommodated or seated, respectively.

Each of the first and second earphone parts 20a and 20b, which can be inserted and received (mounted) or detached and separated (not mounted) in each of the first and second accommodating parts 12a and 12b, is the body part 10 (or data It is connected to the main body 10 through the first and second connecting lines 30a and 30b respectively for electrical and physical connection with the processor 70).

In addition, a winding device (not shown) for unwinding and winding the first and second connecting wires 30a and 30b is provided in the main body 10 . The winding device may perform unwinding and winding operations by external force or automatically. Each of the first and second connecting wires 30a and 30b is wound or unwound by a winding device through a through hole (not shown) formed in the first and second grooves 14a and 14b, and the first and second earphone units ( 20 and 20b are electrically connected to the data processor 70 through first and second connection lines 30a and 30b.

In addition, the first or second receiving portions 12a and 12b, which are both ends of the body portion 10 , include a camera 30 for photographing an image in a preset reference direction A, and a camera 30 for photographing the camera 30 . A light irradiator 40 for informing the user of the photographing position by irradiating light to the photographing position in the reference direction A is mounted. The photographing direction of the camera 30 and the light irradiation direction of the light irradiation unit 40 are mounted to face the same direction (reference direction), and the camera 30 and the light irradiation unit 40 are formed in the first and second receiving units 12a , 12b) in addition to both ends of the body portion 10 or may be mounted at other locations.

In the case of FIG. 1 , the winding device performs the winding operation, and the first and second earphone units 20a and 20b are accommodated and seated in the first and second grooves 14a and 14b (mounted state). As shown, the first and second connecting wires 30a and 30b are accommodated in the main body 10 by a winding device. In addition, a state in which the winding device performs an unwinding operation and the first and second earphone units 20a and 20b are separated from each of the first and second grooves 14a and 14b (not mounted state) is shown. The first and second connecting lines (not shown) extend to the outside of the main body 10 and are exposed.

FIG. 2 is a configuration diagram of a learning system using the neckband-type acoustic transducer of FIG. 1 .

The present inventor's learning system receives, in addition to a sound reproduction function and a phone call function, a photographing function of photographing an image (photo) including a text that the user wants to translate, and translation information corresponding to the photographed text from the electronic communication terminal 100 . A neckband-type sound converter 1 that performs a translation guide function to emit sound by receiving a captured image from the neckband-type sound converter 1, translates characters included in the received captured image, and emits sound It is possible to communicate through the electronic communication terminal 100 and the electronic communication terminal 100 and the network 140 that generate possible translation information and apply it to the neckband-type sound conversion device 1, and and a translation server 120 that generates translation information in response to a translation request and applies it to the electronic communication terminal 100 or updates a translation function of the electronic communication terminal 100 . However, the network 140 corresponds to a system for performing wired communication and/or wireless communication, and corresponds to a technology naturally recognized by those skilled in the art to which the present invention pertains, and thus detailed description thereof will be omitted.

First, the neckband-type sound conversion device 1 according to the present invention includes the above-described first and second earphone units 20a and 20b, a camera 30, a light irradiation unit 40, an on/off input of power and The input unit 42 for acquiring an input such as play/stop/tune selection and communication connection (eg, pairing, etc.) of a song to be played, a camera activation/deactivation input, and a shooting operation, and an operating mode (eg, sound reproduction) mode, phone call mode, shooting mode, etc.), a display unit 44 for displaying an external sound, a microphone 46 for acquiring an external sound, and a speaker 48 for emitting sound through the sound emission hole 11 and , the communication unit 50 for performing wired and/or wireless communication with the electronic communication terminal 100, and at least one of a sound reproduction mode, a phone call mode, and a shooting mode (including a translation guide function) by controlling the above-described components It consists of a data processor 70 that performs one or more modes. However, the power supply unit (not shown) that supplies the necessary power, the input unit 42, the display unit 44, the microphone 46, the speaker 48, the communication unit 50, etc. are common knowledge in the technical field to which the present invention belongs. Since it is only a technique widely known to those who have it, a detailed description thereof will be omitted.

The camera 30 is implemented as an imaging device implemented by, for example, a CCD, a CMOS sensor, etc., and is activated by the control of the data processor 70 (eg, in a state in which power is supplied and photographing is possible), and a photographing operation and deactivation (eg, a state in which photographing is impossible because power is cut off).

The light irradiator 40 is for visually displaying the photographing position of the camera 30 , and is implemented, for example, by including a laser diode, such as a laser pointer.

As is well known, the data processor 70 performs a phone call function and a sound reproduction function, and includes a processor (eg, CPU, MCU, MICROPROCESSOR, etc.) performing a photographing mode, a photographed image, translation information, and the like. It is configured to include a storage space (eg, memory, etc.) for storing the .

Here, the captured image refers to a still image image captured by the camera 30 , and the translation information includes an acoustic signal and/or translated text corresponding to the translated text received from the electronic communication terminal 100 . is composed

The process of performing the shooting function (or mode) function according to the present invention will be described below.

The electronic communication device 40 corresponds to, for example, an information communication device such as a smart phone or tablet having a communication function, and performs wired and/or wireless communication with the neckband-type sound conversion device 1 (eg, Bluetooth communication, etc.) and the communication unit 102 communicating with the translation server 120 through the network 140, and input from the user (eg, selection of start or end of an application for a translation function, translation The input unit 104 for obtaining and applying the function start or end selection, the selection input of the translation target language and/or the translation target language, etc.) to the data processor 49, and the user interface for the translation function, etc., visually or audibly It is configured to include a display unit 106 for displaying or expressing, and a data processor 110 that performs a phone call function and a sound reproduction function, and performs a translation function according to the present invention. However, the configuration or function of the power supply unit (not shown) for supplying power, the communication unit 102, the input unit 104, and the display unit 106 corresponds to the technology naturally recognized by those skilled in the art to which the present invention belongs. The description is omitted.

The data processor 110 includes a processor (eg, CPU, MCU, MICROPROCESSOR, etc.) performing a phone call function, a sound reproduction function, and a translation function, and an application and user interface for the translation function, a photographed image, and translation information. It is configured to include a storage space (eg, memory, etc.) for storing. In addition, the data processor 110 may have a function of recognizing a character in the photographed image and converting it into text and/or a function of translating a character (text) to generate a translated text and/or a TTS (Text to Speech) function (text to speech) function of synthesizing with ). The data processor 110 performs an application for a translation function, and will be described in detail below through various embodiments.

The translation server 50 has a function of recognizing a character in a photographed image and converting it into text and/or a function of translating a character (text) to generate a translated text and/or a TTS (Text to Speech) function (synthesizing text into speech) function), such a translation server 50 corresponds to a technology that is naturally recognized by those skilled in the art to which the present invention belongs, and thus detailed description thereof will be omitted.

The operation of the present learning system will be described. The operation of the present learning system is started by the data processor 110 operating the corresponding application according to the activation input of the application for the translation function from the input unit 104, and the communication unit 102 of the electronic communication terminal 100 and the neckband The type acoustic conversion device 1 is in a state in which the communication unit 50 is connected to communication.

First, a process in which the electronic communication terminal 100 receives a photographed image from the neckband-type sound conversion device 1 will be described. The data processor 110 transmits an activation command of the camera 30 to the neckband-type sound conversion device 1 through the communication unit 102 , and the data processor 70 receives the camera according to the activation command through the communication unit 50 . (30) to perform the activation operation. Alternatively, the data processor 70 may perform an activation operation according to a camera activation input from the input unit 42 without receiving an activation command from the electronic communication terminal 100 .

After activating the camera 30 , the data processor 70 maintains the camera 30 in the photographing state according to the photographing state input from the input unit 42 or without additional input. In the photographing state of the camera 30 , the data processor 70 operates the light irradiator 40 so that the user can check the photographing position.

The data processor 70 causes the camera 30 to photograph an image according to a photographing operation input from the input unit 42 in the photographing state of the camera 30, and the camera 30 generates a photographed image to generate a photographed image and the data processor ( 70) is approved. The data processor 70 transmits the applied photographed image to the electronic communication terminal 100 through the communication unit 50 .

The data processor 110 receives and stores the captured image from the neckband-type sound conversion device 1 through the communication unit 102 .

Next, a process of generating translation information including an acoustic signal by translating a text image included in a captured image will be described. The process of generating this translation information includes a first process of recognizing characters from a photographed image and converting them into text, a second process of translating characters (text) to generate translated text, and synthesizing the translated text into speech to generate an acoustic signal A third process is included.

The first to third processes of the process of generating the translation information may all be performed in the electronic communication terminal 100 , and in another embodiment, the electronic communication terminal 100 performs the first process and the translation server 120 . After performing the second and third processes, the translation server 120 may transmit the translation information to the electronic communication terminal 100 . That is, the first to third processes may be performed by the electronic communication terminal 100 and/or the translation server 120 . However, in the present embodiment, a process in which the electronic communication terminal 100 performs all of the first to third processes is described, but is not limited thereto.

First, in the first process, the data processor 110 recognizes a character (ie, a character image) included in a captured image, but recognizes a character in the center of the captured image or close to the center. The data processor 110 converts the recognized character into text and stores it.

Next, in the second process, the data processor 110 translates the text, but automatically checks the language type of the text and translates it into the translation target language, or the translation target language and/or the translation input by the input unit 104 . The translation is performed according to the selection input of the target language and the translated text is stored.

Next, in a third process, the data processor 110 synthesizes the translated text into speech, which is the translation target language, and generates and stores an acoustic signal of the translated text.

The data processor 110 generates and stores an acoustic signal of the translated text and/or translation information including the translated text.

Next, a process in which the electronic communication terminal 100 receives a photographed image from the neckband-type sound conversion device 1 will be described.

The data processor 110 transmits the translation information to the neckband-type sound conversion device 1 through the communication unit 102 . The data processor 70 receives and stores the translation information through the communication unit 50 , and applies an acoustic signal included in the translation information to the speaker 48 so that the translated text is expressed in sound.

By generating the captured image and sound emission of the translation information as described above, the user uses only the neckband-type sound conversion device 1 without operating the electronic communication terminal 100 to use the translation function while the translation function is being performed, It improves the convenience when using it for study/travel.

Also, the translation server 120 may perform an update process of a function (a function performing the first to third processes) in the electronic communication terminal 100 .

At least a portion of an apparatus (eg, a processor or functions thereof) or a method (eg, operations) according to various embodiments is stored in a computer-readable storage medium in the form of, for example, a program module It can be implemented with stored instructions. When the instruction is executed by a processor, the one or more processors may perform a function corresponding to the instruction. The computer-readable storage medium may be, for example, a memory.

Computer-readable recording media include hard disks, floppy disks, magnetic media (eg, magnetic tape), optical media (eg, CD-ROM, DVD (Digital Versatile Disc), magnetic- It may include an optical medium (eg, a floptical disk), a hardware device (eg, ROM, RAM, or flash memory, etc.), etc. In addition, program instructions include It may include not only machine code but also high-level language code that can be executed by a computer using an interpreter, etc. The above-described hardware device may be configured to operate as one or more software modules to perform operations of various embodiments, and The same goes for the station.

The processor or functions by the processor according to various embodiments may include at least one or more of the above-described components, some may be omitted, or may further include additional other components. Operations performed by a module, a program module, or other components according to various embodiments may be executed sequentially, in parallel, iteratively, or in a heuristic method. Also, some operations may be executed in a different order, omitted, or other operations may be added.

As described above, the present invention is not limited to the specific preferred embodiments described above, and anyone with ordinary skill in the art to which the invention pertains can use various methods without departing from the gist of the present invention as claimed in the claims. It goes without saying that modifications are possible, and such modifications are intended to be within the scope of the claims.

1: Neckband-type sound transducer 100: electronic communication terminal

Claims (2)

a body portion that is seated on the user's body and has both ends that form an opening in the front;
a speaker mounted on the main body;
a camera mounted on the main body to take an image in a preset reference direction;
a light irradiator for irradiating light to a photographing position of the camera in a preset reference direction;
a communication unit configured to communicate with the electronic communication terminal;
an input unit for obtaining a photographing motion input;
Control the camera and the light irradiation unit to perform the shooting mode, but operate the camera according to the shooting operation input from the input unit, receive the photographed image from the camera, and transmit the photographed image from the camera to the electronic communication terminal through the communication unit, A neckband type acoustic transducer comprising: a data processor for receiving translation information from an electronic communication terminal and applying an acoustic signal included in the translation information to a speaker to emit sound; learning system used. The method of claim 1,
The learning system includes a communication unit communicating with the neckband-type sound conversion device, receiving a photographed image through the communication unit, and an acoustic signal including a voice synthesized from translated text of text corresponding to a character included in the received photographed image and/or an electronic communication terminal including a data processor for transmitting translation information including the translated text to the neckband-type sound conversion device through a communication unit.

Images