KR101841450B1 - Method and apparatus for speech synthesis guide service for hearing-impaired people - Google Patents

Abstract

The present invention relates to a method and apparatus for a synthetic voice guidance service for a hearing impaired person, and a method for providing a synthetic voice guidance service according to an embodiment of the present invention includes receiving text corresponding to a synthesized voice from a voice synthesizer for generating a synthetic voice, Receiving a sound wave code from a terminal when a terminal used by a hearing impaired person receives a sound wave code and a synthesized sound from the speech synthesizer, and generating a sound wave code corresponding to the sound wave code And providing the text corresponding to the synthesized voice to the audible impaired person so that the hearing impaired person can recognize the contents of the synthesized voice as audible data as visual data There is an effect that can be.

Description

METHOD AND APPARATUS FOR SPEECH SYNTHESIS GUIDE SERVICE FOR HEARING-IMPAIRED PEOPLE [0002]

[0001] The present invention relates to a method and apparatus for a synthetic voice guidance service for a hearing impaired person, and more particularly, to a method and apparatus for a hearing impaired person who can output a synthesized voice, To a method and apparatus for providing a synthetic voice guidance service.

The speech synthesizer is a device that divides a voice recorded by one person into a predetermined unit, inputs the code into a speech synthesizer, and then combines necessary units to produce speech. That is, the speech synthesizer means a device for generating input characters by speech. Since the speed, pitch and tone of speech are freely adjustable, the speech synthesizer can generate various types of speech.

The speech synthesizer receives the text and outputs the speech including the same contents as the text, thereby reducing the inconvenience of recording every time the contents of the speech to be output are changed. In addition, various voice filters can be easily applied to voice, thereby shortening the process required for voice conversion. Therefore, the speech synthesizer is actively used in services such as speech recognition, announcement broadcasting, translation of foreign languages, and output of voice by a user who is difficult to read characters.

Thus, although information is transmitted through a speech synthesizer in various fields, there is a problem that a hearing impaired person can not recognize speech output information of a speech synthesizer. For example, when the announcement speech generated by the speech synthesizer is output, the hearing impaired person can not recognize the speech and can not recognize the contents of the announcement.

Accordingly, there is a need for a method for converting audible information, which is audio output from a speech synthesizer, into visual information, so that even a hearing impaired person can recognize auditory information.

[Related Technical Literature]

Digital device and method of processing voice character conversion (Patent document 10-2015-0101900)

The object of the present invention is to provide a synthesized sound for a hearing impaired person who can output the synthesized sound to a terminal through an object capable of visually confirming the contents of the synthesized sound so that the hearing- And to provide a guide service method and apparatus.

Another problem to be solved by the present invention is to provide a method and apparatus for a synthetic voice guidance service for a hearing impaired person who does not change the sound quality of a synthesized sound to be output by including text data which is the content of a synthetic sound in a sound wave code of an invisible frequency band .

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a method for providing a synthetic voice guidance service for a hearing impaired person, the method comprising: receiving text corresponding to a synthesized voice from a voice synthesizer for generating a synthetic voice; Receiving a sound wave code from a terminal when the terminal used by the hearing impaired user receives a sound wave code and a synthesized sound from the speech synthesizer, and transmitting the text corresponding to the sound wave to the terminal .

According to another aspect of the present invention, the step of receiving the text includes receiving the synthesized voice data from the speech synthesizer, wherein the step of generating the sound wave code includes generating an additional sound wave code for the synthesized voice data The step of transmitting to the terminal may include transmitting the synthesized voice data corresponding to the additional sound wave code to the terminal.

According to another aspect of the present invention, the synthesized voice data may include a photograph, a moving image, a URL, or a coupon.

According to another aspect of the present invention, a sound wave code may be generated in a speech synthesizer and received from a speech synthesizer.

According to another aspect of the present invention, the step of receiving the sound wave code may be a step of extracting and extracting a sound wave code of the non-audible frequency band through frequency conversion from the terminal, and receiving the sound wave code from the terminal.

According to another aspect of the present invention, a method of synthesizing a sound guide service for a hearing impaired person may further include generating a database that matches text and sound code or matches synthetic sound supplement data and additional sound wave codes.

According to another aspect of the present invention, a method of synthesizing a voice guidance service for a hearing impaired person further includes retrieving synthesized voice addition data matched with a text or an additional sound wave code matched with a sound wave code stored in a database based on the sound wave code , The step of transmitting the text to the terminal may include transmitting the text or the synthesized voice added data retrieved from the database to the terminal.

According to an aspect of the present invention, there is provided a synthetic speech guide service apparatus for a hearing impaired person, comprising: a receiver for receiving text corresponding to a synthesized speech from a speech synthesizer for generating a synthetic speech; And a transmitter for transmitting a sound wave code to the speech synthesizer when the terminal used by the hearing impaired person receives the sound wave code and the synthesized sound from the speech synthesizer and the transmitter transmits the sound wave code to the sound wave code And transmits the corresponding text to the terminal.

According to another aspect of the present invention, the receiving unit receives the synthesized sound data from the speech synthesizer, the processor generates the additional sound wave code for the synthesized sound data, and the transmitting unit transmits the synthesized sound data corresponding to the additional sound wave code to the terminal have.

According to another aspect of the present invention, the synthesized voice data may include a photograph, a moving image, a URL, or a coupon.

According to another aspect of the present invention, a sound wave code may be generated in a speech synthesizer and received from a speech synthesizer.

According to another aspect of the present invention, a receiver may extract a sound wave code of an inaudio frequency band from a terminal and receive a sound wave code from the terminal.

According to still another aspect of the present invention, a synthetic speech guide service apparatus for a hearing impaired person may further include a storage unit that matches a text and a sound code, or generates a database that matches the synthetic sound supplementary data and the supplementary sound wave code.

According to another aspect of the present invention, a processor retrieves synthesized tone data matched to a text or an additional sound wave code matched to a sound wave code stored in a database based on a sound wave code, The synthesized tone data can be transmitted to the terminal.

According to another aspect of the present invention, when a sound wave code is generated in a separate sound wave code generating apparatus, the sound wave code may be received from the separate sound wave code generating apparatus, or received together with the text from the sound synthesizing apparatus.

According to an aspect of the present invention, there is provided a computer-readable recording medium storing instructions for providing a synthetic speech guide service apparatus for a hearing impaired person, Receives a sound wave code from a terminal when a terminal used by a hearing impaired person receives a sound wave code and a synthesized sound from a speech synthesizer, generates a sound wave code for a text, transmits a sound wave code to a sound synthesizer, And transmits the text corresponding to the code to the terminal.

The details of other embodiments are included in the detailed description and drawings.

The present invention has the effect of outputting the contents of the synthesized sound to the terminal through an object which can be visually confirmed by text and visually so that the hearing impaired person visually recognizes the contents of the synthesized sound output by the sound.

The present invention has an effect that the sound quality of the synthesized sound to be outputted is not deformed by including text data which is the content of the synthesized sound in the sound wave code in the non-audible frequency band.

The effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the specification.

FIG. 1 is a schematic diagram illustrating a relationship between a synthetic voice guide service apparatus, a speech synthesizer, and a terminal according to an exemplary embodiment of the present invention.
2 shows a schematic configuration of a synthetic voice guidance service apparatus according to an embodiment of the present invention.
FIG. 3 illustrates a procedure for visually guiding a synthesized voice according to a method for providing a synthetic voice guidance service for a hearing impaired person according to an embodiment of the present invention.
4A and 4B illustrate exemplary output of text and synthesized voice data corresponding to a synthesized voice through a terminal according to an embodiment of the present invention.
5 illustrates a database in which a sound code and text are matched according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

The shapes, sizes, ratios, angles, numbers, and the like disclosed in the drawings for describing the embodiments of the present invention are illustrative, and thus the present invention is not limited thereto. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. Where the terms 'comprises', 'having', 'done', and the like are used herein, other parts may be added as long as '~ only' is not used. Unless the context clearly dictates otherwise, including the plural unless the context clearly dictates otherwise.

In interpreting the constituent elements, it is construed to include the error range even if there is no separate description.

Although the first, second, etc. are used to describe various components, these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, the first component mentioned below may be the second component within the technical spirit of the present invention.

Like reference numerals refer to like elements throughout the specification unless otherwise specified.

It is to be understood that each of the features of the various embodiments of the present invention may be combined or combined with each other partially or entirely and technically various interlocking and driving is possible as will be appreciated by those skilled in the art, It may be possible to cooperate with each other in association.

FIG. 1 is a schematic diagram illustrating a relationship between a synthetic voice guide service apparatus, a speech synthesizer, and a terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 1, a synthetic voice guidance service apparatus 100 is an apparatus for providing a synthetic voice guidance service for a hearing impaired person. Here, the synthetic voice guidance service means a service for providing visual data corresponding to a synthesized voice. The visual data includes text and synthesized tone data. The text means a character expressing the same contents of the synthesized sound. Further, the synthesized sound data refers to a photograph, a moving image, a URL, a coupon, etc., which can additionally explain the contents of the synthesized sound in addition to the text. The synthetic voice guide service apparatus 100 communicates with the voice synthesizer 200 and the terminal 300 to provide visual data corresponding to the synthesized voice. Specifically, the synthetic voice guide service apparatus 100, the voice synthesizer 200, and the terminal 300 may exist in the same network or may be connected by communication. Here, the apparatus 100 may be implemented in the form of a server, for example, but not limited to, a co-location server or a cloud server.

The synthesized voice guidance service apparatus 100 receives the text corresponding to the synthesized voice from the voice synthesizer 200 and generates a sound wave code for the text. In addition, the synthetic voice guidance service apparatus 100 may receive the synthesized voice data from the voice synthesizer 200 and generate an additional sound wave code for the text. The synthesized voice guidance service apparatus 100 may transmit the generated sound wave code to the speech synthesizer 200. [ If the additional sound wave code exists, the synthesized sound guide service apparatus 100 may transmit the additional sound wave code to the speech synthesizer 200. [ When receiving the sound wave code from the terminal 300, the synthetic sound guide service apparatus 100 transmits the text corresponding to the received sound wave code to the terminal 300 so that the terminal 300 can provide the text. At this time, the terminal 300 can extract the sound wave code of the non-audible frequency band through frequency conversion. In addition, when receiving the additional sound wave code from the terminal 300, the synthetic sound guide service apparatus 100 transmits the synthesized sound attachment data corresponding to the received additional sound wave code to the terminal 300, So that data can be provided. The concrete configuration and function of the synthetic voice guide service apparatus 100 will be described later in detail with reference to FIG. 2 and FIG.

The voice synthesizer 200 generates a synthesized voice. Also, the speech synthesizer 200 transmits the text corresponding to the synthesized speech to the synthesized voice guidance service apparatus 100. If synthesized voice additional data exists in addition to the text, the voice synthesizer 200 can transmit the synthesized voice supplementary data to the synthesized voice guidance service apparatus 100. Then, the speech synthesizer 200 receives the sound wave code corresponding to the text from the synthetic sound guide service apparatus 100, and outputs the synthesized sound and the sound wave code so that the terminal 300 responds to the synthesized sound from the synthetic sound guide service apparatus 100 To receive the text. The voice synthesizer 200 may generate a sound wave code and transmit the generated sound wave code to the synthetic sound guide service apparatus 110.

The speech synthesizer 200 receives the additional sound wave code corresponding to the synthesized sound addition data from the synthetic sound guide service apparatus 100 and outputs the synthesized sound and the additional sound wave code so that the terminal 300 It is possible to receive the synthesized sound data corresponding to the synthesized sound. Accordingly, the speech synthesizer 200 may be configured in the form of a server, such as a CO-location server, a cloud server, or the like, but is not limited thereto . The specific configuration and function will be described later in detail with reference to Fig.

The terminal 300 is a terminal used by a hearing-impaired person. The terminal 300 receives the synthesized sound and the sound wave code from the speech synthesizer 200. In addition, the terminal 300 transmits the received sound wave code to the synthetic sound guide service apparatus 100, and receives text from the synthetic sound guide service apparatus 100, thereby outputting the text corresponding to the synthesized sound to the display. In addition, the terminal 300 may also receive the synthesized tone data corresponding to the synthesized tone from the synthetic tone guide service device 100, and output the synthesized tone attached data to the display along with the text. At this time, the terminal 300 may be a desktop, a laptop, a tablet PC, a smart phone, and the like, but is not limited thereto. The display unit of the terminal 300 may be a liquid crystal display (LCD), a light emitting diode (LED), a plasma display panel (PDP), a field emission display (FED), an organic light emitting diode It is not limited. The specific configuration and function will be described later in detail with reference to Fig.

1, the speech synthesizer 200 and the terminal 300 are shown as one for ease of explanation. However, the present invention is not limited to this, and a plurality of speech synthesizers and a plurality of terminals can communicate with the synthetic voice guide service apparatus 100 have.

Hereinafter, the synthesized voice guidance service apparatus 100 and the synthesized voice guidance service apparatus 100 will be described with reference to FIG. 2 for a more detailed description of the synthetic voice guidance method.

2 shows a schematic configuration of a synthetic voice guidance service apparatus according to an embodiment of the present invention. For convenience of explanation, the components will be described with reference to FIG. 1 and reference numerals.

Referring to FIG. 2, the apparatus 100 includes a receiver 110, a transmitter 120, a storage 130, and a processor 140. For convenience of explanation, the components will be described with reference to FIG. 1 and reference numerals.

The receiving unit 110 receives the text corresponding to the synthesized voice from the voice synthesizer 200 that generates the synthesized voice. If the synthesized voice data corresponding to the synthesized voice is additionally present in addition to the text, the receiving unit 110 can receive the synthesized voice data from the voice synthesizer 200. [ Also, the receiving unit 110 can receive the sound wave codes of the inaudible frequency band extracted through the frequency conversion from the terminal 300. [

The transmitting unit 120 transmits the sound wave code to the speech synthesizer 200. In addition, the transmitting unit 120 transmits the text corresponding to the sound wave code to the terminal 300. When there is synthesized tone data corresponding to the additional sound wave code, the transmission unit 120 can transmit the additional sound wave code to the speech synthesizer 200 and transmit the synthesized tone data corresponding to the additional sound wave code to the terminal 300 . Also, the transmitting unit 120 may transmit the text matching the search result in the database to the terminal 300. In addition, the transmitter 120 may transmit the synthesized tone data matching the search result in the data base to the terminal 300.

The storage unit 130 matches the text and sound code or generates a database that matches the synthesized sound data and the additional sound wave code. Also, the storage unit 130 may store text and sound wave codes, synthesized sound addition data, and additional sound wave codes included in the generated database. In addition, the storage unit 130 may store the sound wave code and the text or synthesized sound data and the additional sound wave code received by the receiving unit 110 and transmitted by the transmitting unit 120 before creating the database.

The processor 140 generates a sound wave code for the text. If synthesized voice data is present, the processor 140 may generate additional sound wave codes for the synthesized voice data. When the receiving unit 110 receives a sound wave code from the terminal 300, the processor 140 searches for a text matched to the sound wave code stored in the database based on the received sound wave code. At this time, the processor 140 may extract the sound wave code of the non-audible frequency band through frequency conversion. When the receiving unit 110 receives the additional sound wave code from the terminal 300, the processor 140 searches the synthesized sound data matched to the additional sound wave code stored in the database based on the received additional sound wave code.

In some embodiments, the sound wave code may be generated in a separate sound wave code generator. At this time, the receiving unit 110 can receive a sound wave code from a separate sound wave code generating apparatus. In addition, the receiving unit 110 may receive a sound wave code transmitted to the speech synthesizer 200 from the speech synthesizer 200, together with the text, in a separate sound code generating apparatus.

Accordingly, the synthetic voice guidance service apparatus 100 further transmits the text corresponding to the synthesized voice and the synthesized voice added data to the terminal 300, so that the hearing impaired person can recognize the synthesized voice as visual data.

The receiving unit 110 and the transmitting unit 120 are connected to the voice synthesizer 200 and the terminal 300 through a communication link And may be configured as one communication unit.

Hereinafter, the synthesized voice guidance service method in the synthetic voice guidance service apparatus 100 will be described with reference to FIG. 3 for a more detailed description.

FIG. 3 illustrates a procedure for visually guiding a synthesized voice according to a method for providing a synthetic voice guidance service for a hearing impaired person according to an embodiment of the present invention. For convenience of explanation, the components will be described with reference to FIG. 1 and FIG. 2 and reference numerals.

The receiving unit 110 receives the text from the speech synthesizer 200 that generates the synthetic sound (S310).

For example, if the synthesized voice includes the phrase "the station to descend is the station OOO," the text is the same as the content of the synthesized voice.

In addition, when synthesized voice data corresponding to the synthesized voice exists in addition to the text, the receiving unit 110 can receive the synthesized voice data from the voice synthesizer 200. For example, if the synthesized voice is an announcement for a specific location, the synthesized voice data may be a map URL for a specific location or a picture for a specific location. In addition, when the synthesized voice is announcement broadcast for a specific product, the synthesized voice data may be a discount coupon for a specific product or a description video for a specific product. Accordingly, the synthesized voice generated by the voice synthesizer 200 may be a voice representing the content of the synthesized voice data or a voice representing the same contents as the text.

Subsequently, the processor 140 generates a sound wave code for the text (S315).

The processor 140 generates a sound wave code for a text corresponding to the synthesized sound received by the receiving unit 110 from the speech synthesizer 200. [ Here, the sound wave code is a unique code assigned to each text. The processor 140 generates a sound wave code to distinguish each text. That is, the processor 140 generates one sound wave code in one text.

In some embodiments, a sound wave code may be generated in the speech synthesizer 200. Accordingly, the receiving unit 110 can receive the sound wave code from the speech synthesizer 200. [

If synthesized voice data is present, the processor 140 may generate additional sound wave codes for the synthesized voice data. Here, the additional sound wave code is a unique code assigned to each of the synthesized sound data, and is generated in order to distinguish each additional sound wave code like the sound wave code. At this time, the sound wave code may be composed of numbers or letters, and may be composed of a combination of numbers and letters, but is not limited thereto. An exemplary configuration of a specific database is described below with reference to FIG.

Then, the storage unit 130 generates a database for matching and storing the text and the sound code (S320).

Specifically, the storage unit 130 matches sound codes corresponding to the text and the text. At this time, the storage unit 130 matches the text and the sound code one to one. Then, in order to provide the text matching the sound wave code to the terminal 300, the storage unit 130 generates a database in the form of a table storing the matched text and sound wave codes.

The storage unit 130 generates a database in which the storage unit 130 stores and stores the text and the sound code. However, in some embodiments, the storage unit 130 further stores the text and sound code Can be stored in the stored database.

Then, the transmitting unit 120 transmits the sound wave code to the speech synthesizer 200 (S325).

The transmitting unit 120 transmits the sound wave code generated by the processor 140 to the speech synthesizer 200 so that the speech synthesizer 200 can insert a sound wave code into the synthesized sound. If the additional sound wave code generated by the processor 140 exists, the transmission unit 120 may transmit the additional sound wave code to the speech synthesizer 200. [

Subsequently, the speech synthesizer 200 inserts a sound wave code into the synthesized sound (S330).

Specifically, the speech synthesizer 200 inserts the sound wave code generated by the processor 140. At this time, the speech synthesizer 200 inserts the sound wave code into the non-audible frequency band, and then inserts the sound wave code into the synthetic sound. Here, the non-audible frequency band is a frequency band of sound that can not be recognized by a person and means a band of 18 kHz or more. Accordingly, the speech synthesizer 200 inserts the sound wave code into the synthesized sound, thereby inserting the sound wave code into the non-audible frequency band so that the synthesized sound of the audible frequency band is not altered. The speech synthesizer 200 may insert an additional sound wave code into the synthesized sound.

Then, the terminal 300 receives the synthesized sound and the sound wave code (S335).

Specifically, the terminal 300 receives the synthesized sound output from the speech synthesizer 200 and the sound wave inserted into the synthesized sound. That is, the terminal 300 receives the sound wave signal including the synthesized sound and the sound wave code. At this time, the terminal 300 receives the sound wave signal output from the speaker of the speech synthesizer 200 through the microphone of the terminal 300. The terminal 300 may receive the synthesized sound and the additional sound wave code as well as the synthesized sound and the sound wave code.

Subsequently, the terminal 300 extracts a sound wave code in the non-audible frequency band (S340).

Specifically, the terminal 300 extracts a sound wave code of the non-audible frequency band from the received sound wave signal. At this time, the terminal 300 extracts a sound wave code of a non-audible frequency band through frequency conversion. Here, the frequency conversion refers to the conversion of two different frequencies, that is, the frequency of the different synthetic sounds and the frequency of the sound wave code, which are added while inserting the sound wave code into the synthesized sound, to different frequencies again. Accordingly, the terminal 300 transmits the sound wave code extracted through the frequency conversion to the synthetic sound guide service apparatus 100. When receiving the additional sound wave signal, the terminal 300 may extract the additional sound wave code of the non-audible frequency band from the received additional sound wave signal.

In some embodiments, the receiving unit 110 may receive a sound wave code of the audible frequency from the terminal 300. [ Subsequently, the processor 140 can extract the sound wave code of the non-audible frequency band through frequency conversion.

Then, the receiving unit 110 receives the sound wave code transmitted by the terminal 300 (S345). When the terminal 300 transmits the additional sound wave code, the receiving unit 110 may receive the additional sound wave code.

 Subsequently, the processor 140 searches for text matched to the sound wave code (S350).

Specifically, the processor 140 searches for a text matching the sound wave code stored in the database based on the sound wave code received from the terminal 300. [ For example, when the sound wave code received from the terminal 300 is '1', the processor 140 searches for a text matching the sound wave code '1' stored in the database based on the sound wave code '1'.

While processor 140 has been described in an embodiment for retrieving text that is matched to a sound wave code, in some embodiments processor 140 may retrieve synthesized sound data matched to the additional sound wave code.

Then, the transmitting unit 120 transmits the text to the terminal 300 (S355).

Specifically, the transmitting unit 120 transmits the text matched to the sound wave code retrieved through the processor 140 to the terminal 300. The transmitting unit 120 may transmit the synthesized sound data matching the additional sound wave code retrieved through the processor 140 to the terminal 300.

Subsequently, the terminal 300 outputs text (S360).

Specifically, the terminal 300 outputs a text corresponding to the synthesized speech received from the transmitter 120. [ The terminal 300 outputs a text so that a user, that is, a hearing-impaired person, can perceive auditory data as synthetic voice as visual data, which is text. In addition, the terminal 300 may output the synthesized voice data.

Accordingly, the synthetic voice guidance service apparatus 100 provides the terminal with text or text and synthesized voice data corresponding to the synthesized voice, so that the hearing impaired person can grasp the contents of the synthesized voice.

4A and 4B illustrate exemplary output of text and synthesized voice data corresponding to a synthesized voice through a terminal according to an embodiment of the present invention. For convenience of explanation, the components will be described with reference to FIG. 1 and reference numerals.

Referring to FIG. 4A, the terminal 400 may include a display unit 410 and a voice receiving unit 420.

The display unit 410 displays visual data corresponding to the synthesized sound to visually provide the synthesized sound to the hearing-impaired person. Specifically, the display unit 410 displays the text 412 corresponding to the synthesized voice 411 and the URL 413 corresponding to the synthesized voice 411, that is, the synthesized voice attached data. For example, when the voice receiving unit 420 receives the synthesized voice 411, which is a backward announcement of "the next lowering station is the OOO station", the display unit 410 displays the text 412 corresponding to the synthesized voice 411 "Next departing station is OOO station" is displayed. Further, the display unit 410 displays a URL 413 corresponding to the synthesized voice 411, that is, "http://www.OOOO.com" which is a backward guidance map URL.

The voice receiving unit 420 receives the synthesized voice output 411. At this time, the voice receiving unit 420 can receive not only the synthesized voice 411 but also a sound wave code in the non-audible frequency band and an additional sound wave code. The terminal 400 extracts a sound wave code and an additional sound wave code in an invisible frequency band through frequency conversion. The terminal 400 receives the text 412 matched with the sound wave code and the URL 413 matched with the additional sound wave code from the synthesized sound guidance service apparatus on the basis of the extracted sound wave code and the additional sound wave code. Accordingly, the received text 412 and the URL 413 are displayed through the display unit 410. [

In the example shown in FIG. 4A, the sound wave code and the additional sound wave code are simultaneously received. However, only the sound wave code may be received. In addition, although a single terminal displays text and URL corresponding to a synthesized voice, the present invention is not limited to the number of terminals, and a plurality of terminals may display text and URL corresponding to the same synthesized voice.

4B, the display unit 410 displays a text 412 corresponding to the synthesized sound 411 and a picture 414 corresponding to the synthesized sound 411. [ For example, when the voice receiving unit 420 receives the synthesized voice 411, which is a backward announcement of "the next lowering station is the OOO station", the display unit 410 displays the text 412 corresponding to the synthesized voice 411 "Next departing station is OOO station" is displayed. In addition, the display unit 410 displays a picture 413 corresponding to the synthesized voice 411, that is, an 'OOO station' image.

The sound receiving unit 420 receives a sound wave code and an additional sound wave code corresponding to the synthesized sound 411 and the synthesized sound 411 to be output. Subsequently, the terminal 400 receives the text 412 matched with the sound wave code and the picture 414 matched with the additional sound wave code from the synthesized sound guidance service apparatus on the basis of the extracted sound wave code and the additional sound wave code. Accordingly, the received text 412 and the picture 414 are displayed through the display unit 410. [

Referring to FIG. 4B, the voice transmitter 420 included in the terminal 400 receives the synthesized voice 411 output through the speaker. The display unit 410 of the terminal 400 displays the text 412 corresponding to the received synthesized sound 411 and the picture 414 corresponding to the synthesized sound 411. [

Accordingly, the synthetic voice guide service apparatus 100 can display not only the text corresponding to the synthesized voice but also text such as a photograph and other types of synthesized voice data on the terminal 400, So that the contents of the synthesized sound can be grasped.

5 illustrates a database in which a sound code and text are matched according to an embodiment of the present invention.

Referring to FIG. 5, the database 500 includes a sound wave code 510 and text 520 corresponding to a synthesized sound.

Referring to FIG. 5, the sound wave code 510 is a code corresponding to the text 520 for the synthesized sound, and may be expressed by a series of numbers. For example, the sound wave code 510 may be represented by a 1- to 6-digit Arabic numeral.

Referring to FIG. 5, the text 520 includes text that corresponds to a sound wave code and is based on generating a synthetic sound. Specifically, the text 520 may be a document file including character data that generates a synthetic sound. For example, the text 520 may exist in the form of a text file (.txt).

For example, when the sound wave code 510 of the OO station announcement synthesized sound is '1', the text 520 for the OO station announcement matches the sound wave code 510 of '1' . In addition, the text 520 for the evacuation announcement is matched to the sound wave code 510 in which the sound wave code 510 of the evacuation guidance broadcast synthesized sound is '2', and is stored in the database 500. In addition, the text 520 for the apartment inspection announcement broadcast is matched to the sound wave code 510 in which the sound wave code 510 of the apartment inspection announcement broadcast synthetic sound is '3', and is stored in the database 500.

5, the text corresponding to the sound wave code is stored in the database. However, not only the text, but also the photograph, the moving picture URL, or the coupon, which are the synthesized sound data, may be matched with the sound wave code and stored in the database.

Accordingly, when receiving the sound wave code from the terminal 300, the synthetic sound guide service apparatus 100 generates a database in which a sound wave code and text are matched and stored, thereby searching for and providing text matched with the received sound wave code .

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor, which is capable of reading information from, and writing information to, the storage medium. Alternatively, the storage medium may be integral with the processor. The processor and the storage medium may reside within an application specific integrated circuit (ASIC). The ASIC may reside within the user terminal. Alternatively, the processor and the storage medium may reside as discrete components in a user terminal.

Although the embodiments of the present invention have been described in detail with reference to the accompanying drawings, it is to be understood that the present invention is not limited to those embodiments and various changes and modifications may be made without departing from the scope of the present invention. . Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

100: synthetic voice guidance service device
110:
120:
130:
140: Processor
200: speech synthesizer
400: terminal
410:
411: Composite sound
412: Text
413: URL
414: Photos
420:
500: Database
510: Sound wave code
520: Text

Claims (16)

Receiving text from a speech synthesizer for generating a synthesized voice, the text being a character representing the same contents of the synthesized voice;
Generating a sound code that is unique to the text, the sound code matching the text;
Transmitting the sound wave code to the speech synthesizer;
Receiving the sound wave code from the terminal when the terminal used by the hearing impaired user simultaneously receives the synthesized sound in the audio frequency band from the speech synthesizer and the sound wave code in the non-audible frequency band inserted in the synthesized sound; And
And transmitting the text corresponding to the sound wave code to the terminal. The method according to claim 1,
Wherein the step of receiving the text comprises:
Receiving synthesized tone data from the speech synthesizer,
Wherein the generating the sound wave code comprises:
And generating an additional sound wave code that is a unique code given to the synthesized sound data and matches the synthesized sound data,
Wherein the step of receiving the sound wave code comprises:
Receiving the sound wave code and the additional sound wave code from the terminal when the terminal simultaneously receives the additional sound wave code of the non-audible frequency band inserted into the synthesized sound from the speech synthesizer,
The method of claim 1,
And transmitting the synthesized voice attached data corresponding to the additional sound wave code to the terminal. 3. The method of claim 2,
Wherein the synthesized voice data includes a photograph, a moving picture, a URL, or a coupon. The method according to claim 1,
Wherein the sound wave code is generated in the speech synthesizer and received from the speech synthesizer. The method according to claim 1,
Wherein the step of receiving the sound wave code comprises:
Wherein the terminal extracts a sound wave code of the non-audible frequency band inserted in the synthesized sound through frequency conversion and receives the sound wave code from the terminal. 3. The method of claim 2,
Further comprising generating a database that matches the text and the sound wave code or that matches the synthetic sound attachment data and the additional sound wave code. The method according to claim 6,
Further comprising searching the synthesized voice attached data matched to the text or the additional sound wave code matched to the sound wave code stored in the database based on the sound wave code,
Wherein the transmitting the text to the terminal comprises:
And transmitting the text or the synthesized voice attached data retrieved from the database to the terminal. A receiving unit for receiving text, which is a character representing the same contents of the synthesized sound, from a speech synthesizer for generating a synthetic sound;
A processor for generating a sound code that is unique to the text and matches the text; And
And a transmitter for transmitting the sound wave code to the speech synthesizer,
The receiver may further comprise:
Receiving a sound wave code from the terminal when a terminal used by a hearing impaired person simultaneously receives the synthesized sound of the audible frequency band from the speech synthesizer and the sound wave code of the non-audible frequency band inserted into the synthesized sound;
Wherein the transmission unit comprises:
And transmits the text corresponding to the sound wave code to the terminal. 9. The method of claim 8,
The receiver may further comprise:
Receiving synthesized voice data from the speech synthesizer,
The processor comprising:
And generating additional sound wave codes that are unique codes assigned to the synthesized sound data and matched with the synthesized sound data,
The receiver may further comprise:
Wherein the terminal receives the sound wave code and the additional sound wave code from the terminal when the terminal simultaneously receives the additional sound wave code of the inaudible frequency band inserted in the synthesized sound,
Wherein the transmission unit comprises:
And transmits the synthesized voice attached data corresponding to the additional sound wave code to the terminal. 10. The method of claim 9,
Wherein the synthesized voice attached data includes a photograph, a moving image, a URL, or a coupon. 9. The method of claim 8,
Wherein the sound wave code is generated in the speech synthesizer and received from the speech synthesizer. 9. The method of claim 8,
The receiver may further comprise:
Wherein the terminal extracts a sound wave code of the non-audible frequency band inserted in the synthesized sound through frequency conversion and receives the sound wave code from the terminal. 10. The method of claim 9,
Further comprising a storage unit for matching the text and the sound wave code or for creating a database that matches the synthetic sound addition data and the additional sound wave code. 14. The method of claim 13,
The processor comprising:
Searching the synthesized voice attached data matched to the text or the additional sound wave code matched with the sound wave code stored in the database based on the sound wave code,
Wherein the transmission unit comprises:
And transmits the text or the synthesized voice attached data matching the search result in the database to the terminal. 9. The method of claim 8,
When the sound wave code is generated in a separate sound wave code generating apparatus,
Wherein the sound wave code is received from the separate sound wave code generation device or received with the text from the speech synthesizer. Receiving a text corresponding to the synthesized speech from a speech synthesizer that generates a synthetic speech,
A unique code assigned to the text, generating a sound wave code that matches the text,
Transmitting the sound wave code to the speech synthesizer,
Receiving a sound wave code from the terminal when a terminal used by a hearing impaired person simultaneously receives the synthesized sound of the audible frequency band from the speech synthesizer and the sound wave code of the non-audible frequency band inserted into the synthesized sound;
And transmit the text corresponding to the sound wave code to the terminal.

Images