KR100705901B1 - Mobile Device And Television Receiver Based On Text To Voice Converter - Google Patents

Abstract

The present invention relates to a text and voice information service system for servicing text information provided to subscribers via wired or wireless network as voice information.

Conventionally, by receiving text information provided by a server and displaying it on a terminal, desired information can be obtained in the form of text.

The present invention transmits text information from a server, and the user's terminal (mobile communication terminal or TV receiver) has a means for synthesizing the received text information into a voice signal corresponding to the text and outputting the converted text information into voice information. To print. In addition, the present invention is processed by the server with the text information, the information desired by the user is transmitted to the voice information, the user terminal reproduces the received text information and voice information to display the text information and the voice information corresponding to the text information Is converted into an audible signal and output. In addition, the present invention performs the output control of the text signal and the voice signal, the synchronization, the speed control of the progress of the output of the voice information, and provides a hyperlink to the voice information.

Mobile communication terminal, voice information service device of mobile communication terminal

Description

Text and voice information service system for mobile communication terminal and television {Mobile Device And Television Receiver Based On Text To Voice Converter}

1 is a view for explaining the concept of a mobile communication terminal according to a first embodiment of the present invention;

2 is a block diagram of a mobile communication terminal according to the first embodiment of the present invention;

3 is a conceptual diagram of a mobile communication server and a terminal according to a second embodiment of the present invention;

4 is a server block diagram of an auditory information service system according to a second embodiment of the present invention.

5 is an example of a text and voice information processing method in a server of an auditory information service system according to a second embodiment of the present invention;

6 is a block diagram of a mobile communication terminal of the auditory information service system according to the second embodiment of the present invention.

7 is a block diagram of a TV receiver to which the auditory information service system is applied according to the third embodiment of the present invention.

The present invention relates to a text and voice information service system for a mobile communication terminal and a TV.

Particularly, in the present invention, a mobile communication terminal or a TV receiver receives text information provided by a server through a wired or wireless network, synthesizes the text information corresponding to the text into a voice signal corresponding to the text, and synthesizes the synthesized text signal corresponding to the text information. Mobile communication terminal and TV receiver, which converts and outputs audible signals from a communication terminal or an Internet TV receiver, etc. so that text information provided by a server can be provided as a voice signal from a user terminal based on a wired or wireless network. It is about.

In addition, the present invention transmits the voice information corresponding to the text along with the text information through the wired or wireless network, and the mobile terminal or TV receiver to receive text and voice information provided by the server based on the wired or wireless network The present invention relates to a mobile communication server, a mobile communication terminal, and a TV receiver, which receive and convert an audio signal into an audible signal, thereby receiving information provided by the server as text and voice information.

In the conventional mobile communication system, various content information is provided for the mobile communication subscriber (terminal) through not only the existing voice call but also the Internet connection.

However, the portable wireless terminal is small in size and light in order to increase portability, and according to the miniaturization, the size of the display for showing the information is inevitably limited.

Therefore, the amount of information that can be represented on one screen is limited in expressing characters (which may include image information such as images) through the display of a small size. This is inconvenient to move the page.

In order to partially solve the inconvenience, the information provided is re-edited in accordance with a portable terminal (small size) so that more information can be displayed on a small sized display, and the re-edited information is read by a subscriber (terminal). A service to provide to people is also being proposed.

However, in this case, since the information is re-edited with simplified sentence expression, it may be suitable for an information service that is simple in content delivery, but it is difficult to apply to a system such as an Internet service that requires relatively rich content delivery. In addition, even if applied, the information was re-edited by the subjective judgment, and thus, the re-edited information could not be regarded as sufficiently reflecting the original content.

Moreover, since the services of the wireless mobile communication system and the terminal are provided for those with physical ability to identify texts, the visually impaired are easily alienated from the service target and cannot or cannot read texts (literacy). , Elderly, etc.) are also likely to be alienated from the service target (although they may be viewed as alienated in nature).

On the other hand, with the explosive increase in the use of the Internet, Internet TVs equipped with Internet access functions on TV receivers have been proposed, so that various services such as Internet access and information retrieval can be received using TV receivers in general homes.

However, the Internet TV has the advantage of providing a larger screen than a mobile communication terminal, but instead of watching the TV from a long distance, it is difficult to recognize the displayed Internet information screen and the concentration is low, and the text is read in detail. Is difficult.

In addition, Internet TV also relies only on visual information expression, so it is inevitably less concentrated and aware of information than in the case of audiovisual information expression, and a large number of family members gather to search for information for the same purpose, such as traveling or purchasing goods. In this case, it is necessary to share information of a common part among the screens in which various pieces of information are mixed, but it is difficult to satisfy such necessity only by the existing visual information expression.

According to the present invention, a network-based information service system for providing information to a subscriber based on a wired or wireless network includes means for synthesizing text information into a voice signal corresponding to the text information and outputting it as an audible signal. Provides a mobile communication terminal and a TV receiver to receive a variety of rich information provided in the form of visual and audio services.

In addition, the present invention is processed by the server of the network-based information service system for providing information to the subscriber based on a wired or wireless network to process the information to be provided to the user text information and the voice information corresponding to the text, the user terminal Receiving and decoding voice information corresponding to the text information, and converting and decoding the decoded voice information into an audible signal so that text and voice information provided from a server of an information service system can be visually serviced. Provide server, mobile communication terminal and TV receiver.

The present invention provides a receiving means for receiving text information provided by a mobile communication server, means for synthesizing the received text information into a voice signal corresponding to the text, and a voice signal for outputting the synthesized text information corresponding voice signal. Output means, control means for controlling the processing and output of the text information and voice signal, and user interface means for inputting a user command for processing and output control of the text information and voice signal to the control means. It is a mobile communication terminal characterized in that made.

The present invention also provides text information processing means for processing text information in the mobile communication server, voice information processing means for processing to service voice information corresponding to the text, the processed text information and And a synchronization means for synchronizing voice information and providing the same to a subscriber.

The present invention also provides a receiving means for receiving text and voice information provided by a mobile communication server, text information decoding means for decoding the received text information, voice information decoding means for decoding the speech information, and the text information. And / or output means for outputting a voice signal, control means for controlling the processing and output of the text information and voice signal, and inputting a user command to the control means for processing and outputting the text information and voice signal. The mobile communication terminal further comprises a user interface means for.

The present invention also provides a TV receiver for receiving and displaying text information provided by a system for providing information to a subscriber based on a network, and synthesizing and outputting a voice signal corresponding to the text.

Also, the present invention receives text information and voice information corresponding to a text from a server serving text information and voice information corresponding to a text to a subscriber based on a network, and displays the text and the text corresponding voice information. Provides a TV receiver for converting the output into an audible signal.

Referring to the text and voice information service system of the present invention made as described above in detail with reference to the accompanying drawings as follows.

When the network-based information service system to which the present invention is applied is a wireless mobile communication system, and text information serviced by the wireless mobile communication system is based on the Internet, text and voice information is provided to a terminal of the subscriber of the mobile communication system. The case is described as an example.

In addition, a case where the network-based information service system to which the present invention is applied is a TV system and the terminal of the subscriber of the TV system is a TV receiver when the text information serviced by the TV system is based on the Internet will be described as an embodiment.

The Internet system is largely divided into a server, a network, and a client, where the server sends information requested from a terminal (client) connected to the server while storing, processing, and managing Internet information.

The client may be a wireless mobile communication terminal, and may be a portable wireless mobile communication terminal such as a PCS or a cellular phone.

The client (terminal) finds the server where the information desired by the user exists through the internet address and hyperlink, gets the desired information from the server, and delivers it to the user through various expression methods (visual and audio expression).

The network forms a passage of information transfer from the server to the client or the client to the server, and transmits and receives information in accordance with a protocol, which is a promised communication standard between the server and the client.

However, in general, the server processes and stores the information in an appropriate form in order to express and transmit certain information more effectively, for example, a document composed of text, graphic information, or real-time video and audio information, an execution program, and the like. The information is processed into a form and stored, and the information is served to a desired user (terminal).

Therefore, the terminal should have a function of bringing the information already processed and stored in the server and expressing it to the user. To this end, the mobile communication terminal has a display means such as an LCD for displaying the decoded result and the decoded result. Most have.

However, as described above, the portable mobile communication terminal based on portability is compact and lightweight for convenience of portability, and the size of a display for delivering information from the server to the user may be limited. There is no choice but to.

The present invention is to solve the limitations and inconveniences of information transfer (cognition) of the limited size terminal display, so that the access to the service information from the server can be made not only by the conventional visual information access method but also by the auditory method. do.

1 is a view for explaining the concept of a mobile communication terminal in a text and voice information service system for a mobile communication terminal of the present invention, and is a first embodiment applied to service based on text information.

In normal servers, the service is mainly based on character information.

This character information 101 is information processed to provide to the client (terminal) as described above, and is provided to the terminal via the network.

The text information 101 is input to the portable terminal 102 proposed in the present invention and is serviced in the form of the audio information representation 104 as well as the existing visual information representation 103.

To this end, the portable terminal 102 proposed in the present invention has speech synthesis means for decompressing and displaying text information and synthesizing a voice signal corresponding to the text based on the text information.

This speech synthesizing means will be safe if the terminal interprets the meaning that the character (sentence) is read by the terminal together with the character information displayed in the form of the character.

And a user interface 105 for inputting a user's command to the auditory information representation, including the visual information representation.

The user interface unit 105 includes instructions related to synthesizing (converting) the text information into a voice signal and outputting the text information, and commands related to expressing or connecting the text information when the text information includes a hyperlink. Input to portable terminal 102.

The terminal control operation according to the command input by the user interface unit will be described in more detail with reference to FIG.

2 is a block diagram illustrating an internal configuration of a mobile communication terminal according to a first embodiment of the present invention, and includes a signal receiving unit 201 for receiving text information provided from a mobile communication system server through a network, and the signal receiving unit. The control unit 202 performs control for outputting the text information received at 201 as visual information and / or audio information according to a user command, and data for storing data processed by the control unit 202. A storage unit 203, a user interface unit 204 for inputting a user command to the controller 202, and a display process to visually express the text information under the control of the controller 202; And a signal processor 205 for synthesizing the audio signal corresponding to the text and expressing the text information audibly.

The signal receiving unit 201 receives text information transmitted through a network from a server, receives modulated information in a form suitable for the physical characteristics of the network, and transmits the information to the controller 202 in the form of digital information.

The signal receiver 201 may be, for example, a modem for wireless data communication.

Of course, if the mobile communication system is a form of the additional information service of the text information in the mobile communication system for the purpose of the voice call, the signal receiving unit 201, as well as the demodulation process of the voice signal as well as the demodulation process of the text information as described above It can also be a component to perform.

The controller 202 performs data storage and processing control for outputting text information input from the signal receiving unit 201 as visual, audio, or audiovisual information, and in particular, a user command input to the user interface unit 204. In accordance with the above, proper control of the processing and output of the visual and audio information is performed.

The data storage unit 203 stores processing results for various types of information from the server made by the control unit 202, temporary data storage for data processing, and outputs for visually and audibly expressing the stored information. Memory means.

The signal processing unit 205 includes a display (processing) means composed of a display for driving a visual expression by displaying text information and a driving circuit thereof.

In particular, it is an important feature of the first embodiment of the present invention that the signal processing unit 205 further includes speech synthesis means for synthesizing the character information into the speech signal corresponding to the character in order to convert the character into the speech signal.

The speech synthesis means can apply a conventionally known character / voice synthesizer (character / voice synthesis algorithm), and since the voice synthesis technology is well known, detailed circuit configurations and algorithms will be omitted.

The user interface unit 204 inputs a command related to the visual representation of the text information from the server, an audio representation, an audiovisual simultaneous expression, and the like, for example, an input using a key switch or a user command using a touch screen method. Input can be made.

The user interface unit 204 has an input means of a 'voice conversion' command for determining whether to convert (combine) and output text information into a voice signal.

In response to the input means of the 'voice conversion' command, the control unit 202 has means for determining whether or not the 'voice conversion' command is input, and is included in the signal processing unit 205 when the 'voice conversion' command is input. The voice synthesizing means (which may be active or enable control).

When the voice conversion command is input, the control unit 202 operates the voice synthesizing means of the signal processing unit 205, and the character information is synthesized into a voice signal corresponding to the character to output the speaker or the like. It will be delivered to the user in the form of auditory expression through the medium.

The user can view the text information of the part which is converted into the current voice and is expressed acoustically through the display by synchronizing the text information with the voice. In this case, the user interface unit 204 selects the voice / 'display type selection' command.

Corresponding to this, the control unit 202 controls (sets) the display form by controlling the signal processing unit 205. For example, when the display means of the signal processing unit 205 has a screen scroll function, the voice progresses while The document portion corresponding to the voice may have a display form scrolling up or down, left or right, or may be updated and expressed in units of one page (one screen).

Alternatively, it may be performed in the form of displaying only important information such as a document title.

The user interface unit 204 has command input means such as 'speed adjustment', 'stop', 'previous', 'next', etc. in connection with the progress of the audio signal output.

In response to this, the controller 202 recognizes whether the command is input and performs a control operation corresponding to the recognized command.

When a 'speed adjustment' command is input, the controller 202 may control the speed at which the user desires to speed up the voice process.

For example, an important part and a part requiring thought may be a slower speed, and a lesser interested part may cause the voice to proceed at a higher speed. In this case, the display speed of the text is also changed in accordance with the speed of the voice.

The speed control of the voice progression gives a speed adjustment command of the voice progression to the signal processing unit 205 in the control unit 202, and accelerates the output traveling speed of the synthesized voice in the signal processing unit 205 in response to the speed adjustment command. Or by decelerating.

Of course, the signal processing unit 205 controls the speed of display character information in accordance with the speed of the voice progression.

In the case of a 'stop' command, the controller 202 controls the signal processor 205 to stop the audio output.

This 'stop' command can be used when the information needs to be analyzed or when the visual and audio output of the information needs to be stopped to determine the next action.

When the 'stop' command is input, the control unit 202 controls the signal processing unit 205 to stop not only the voice output but also the text information display at that time without further progressing.

When the 'voice conversion' command is input, the 'stop' operation is stopped and the output of voice and text information continues.

When the 'previous / next' command is input, the control unit 202 returns to the previously viewed information position or skips forward with a predetermined criterion from the point where the voice is currently being processed.

For this control, the controller 202 may use the information stored in the data storage 203.

That is, the control unit 202 analyzes the document, searches for spaces, periods, or line breaks, page breaks, and the like in the document, and stores the information in the data storage unit 203 to facilitate skip search. It can be realized.

As a reference for skipping immediately before or to the next, for example, the controller 202 stores data by dividing words or sentences, paragraphs, or page units with respect to the character information received from the signal receiver 201. When the 'previous / next' command is inputted from the user interface unit 204, the user skips to the desired position with the above criteria, and the skipped position information is stored in the signal processing unit ( In step 205, control is performed to display and output audio.

Therefore, when the user is not interested in the part where the current voice progresses, the voice is advanced by executing a skip to 'next word' or 'next sentence' or 'next paragraph', 'next page', or the like. You can quickly search for the information you want.

In addition, when you go back to the information that was already in progress, you can easily search by the command, such as 'previous word', 'previous sentence', 'previous paragraph', 'previous page'.

On the other hand, even when executing the skip command, the control unit 202 controls the signal processing unit 205 to achieve a synchronization output of the text and voice, and the 'speech conversion' command is not input or the 'stop' command is performed. When the 'previous / next' command is issued in the state, the control unit 202 controls only the display means of the signal processing unit 205 to skip only the display, and when the 'voice conversion' command is input at the desired information position. Synchronization output of the text at the position and the text signal corresponding to the text is started.

Meanwhile, the user interface unit 204 may further have a means for inputting a command relating to a hyperlink, and in response thereto, the control unit 202 may include at least a means for searching for a hyperlink among the inputted text information and a hyperlink. Means for controlling the connection of the data, and stores the hyperlink search data in the data storage unit 203.

As is known, hyperlinks link a site or file with relevant information to a section of the document, and the user's selection changes the network's connection to the relevant site or file location.

In the case of text information, hyperlinks are usually expressed in different colors or underlined.

Commands related to the hyperlink of the user interface unit 204 include 'hyper link connection', 'hyper link search', and 'hyper background sound selection'.

The 'hyperlink search' command causes the controller 202 to find a hyperlink searched and stored among the input text information and to inform the user by text and voice, and the 'hyper link connection' command selected by the user from the searched 'hyper link'. The hyper background sound selection is used to connect to the hyperlink. When the hyperlink is detected, an acoustic signal is used as a means of audibly informing the hyperlink.

The hyper background sound has various sound data by the voice synthesizing means of the signal processing unit 205 or the separate sound data processing means, and outputs an acoustic signal when the hyperlink is searched by the control unit 202. In this case, the background sound is selected according to a user's taste, and the selected information (type of background sound) is recognized by the controller 202 as a kind of background sound setting data.

Therefore, when the document information includes the hyperlink, even if the user listens to the document information as a voice signal, the selected background sound is output at the location where the hyperlink is located, so that the user can acoustically recognize the existence of the hyperlink. In this case, the hyperlink can be commanded.

In addition, by using the 'Hyper Link Search' command, it is possible to search only the portion of the text information where the hyperlink exists and search in the form of excerpts and summarized information, and by using the 'Hyper Link Link' command, Moving to a file can be done simply.

In addition, the above skip for the hyperlink can be executed in combination with the 'previous / next' command, so that an easy search and connection of the desired information (hyperlink information) can be performed.

FIG. 3 is a view for explaining the concept of a mobile communication terminal in a text and voice information service system for a mobile communication terminal of the present invention, and is applied to a case in which voice information corresponding to the text information is served together with text information. Example.

In a typical server, only text information is serviced. In the mobile communication service system according to the second embodiment of the present invention, the server simultaneously services text information and voice information corresponding to the text information.

That is, the portable terminal dedicated server 301 services information such as text, graphics, audio (audio), video (video), and execution program, and the information from the server 301 is a client (terminal) as described above. The processed information is provided to the terminal and provided to the terminal through the network.

The text and voice information 301 is input to the portable terminal 302 proposed in the present invention and is serviced in the form of audio information expression as well as existing visual information expression.

To this end, the portable terminal 302 proposed in the present invention not only decodes and displays text information, but also decodes and outputs voice information provided from the server 301 in response to the text. Have

And a user interface unit 303 for inputting a user's command to the audio information representation, including the visual information representation.

The user interface unit 303 expresses the commands related to the decoding of the text information and the voice information and the output of the decoded text and voice information, and the information serviced from the server 301 when the information includes the hyperlink. Commands related to giving or connecting to the portable terminal 302 are entered.

The terminal control operation according to the command input by the user interface unit 303 will be described in more detail with reference to FIG.

Figure 4 shows the configuration of the server according to the second embodiment of the present invention, the visual information processing unit for processing the information for the visual representation of the information to be serviced to the subscriber and outputs by connecting the link information to the position where the hyperlink exists 401, an audio information processing unit 402 for processing the information for the audio representation among the information to be serviced to the subscriber, and connecting and outputting link information to a location where a hyperlink exists; and the visual information processing unit 401 And audio-visual information synchronization processing unit 403 for receiving visual and audio information output from the audio-visual information processing unit 402 to synchronize visual and audio information.

The visual information processing unit 401 processes the visual information (characters, graphics, video information, etc.) so that the expression is suitable for the portable terminal display.

For example, in consideration of the display of the mobile communication terminal, processing of the format of the document or the layout of the inserted picture, and coding or encoding suitable for the network and protocol characteristics of the mobile communication system are performed.

In addition, the visual information processing unit 401 connects the hyperlink information when the hyperlink is included in the visual information.

An example of visual information processed by the visual information processing unit 401 is indicated by reference numeral 501 in FIG. 5.

In the visual information 501 illustrated here, 'link', 'link: URL1', and 'link: URL2' are hyperlink information.

The auditory information processing unit 402 divides the auditory information into sections, sentences, paragraphs, pages, and the like so that the terminal can refer to the user's command, and associates the link information with the hyperlink. The information is inserted into the promised standard at the location agreed with the terminal and output.

An example of the auditory information processed by the auditory information processing unit 402 is indicated by reference numeral 502 in FIG.

In the illustrated auditory information 502, 'sentence' indicates the starting point of the sentence, 'section' indicates the starting point of the passage, and 'link' and 'link: URL1' are link information.

The audiovisual information synchronization processor 403 inserts and outputs information about a boil so that the information processed by the visual information processor 401 and the audio information processor 402 may be expressed in synchronization with the terminal.

An example of synchronized information is shown at 503 in FIG.

In the synchronized audiovisual information 503, 'text order' indicates the order of the progress as text information, and 'voice order' indicates the order of the progress as voice information, and also indicates the 'text order' and 'voice'. If the sequence number of the sequence is the same, it means that the information of the same content is synchronized and output by text and voice simultaneously.

According to the second embodiment of the present invention shown in Figs. 4 and 5, the auditory form of information represents detailed information, and the visual form represents important information such as a summary of information and keywords.

By providing visual information and processing form of audio information corresponding to the visual information as illustrated in FIG. 5, the user can view the title, keyword, summary, etc. on the terminal display (based on visual information), and the details thereof. Can be serviced by a voice signal (based on auditory information).

The reason for doing this is that it is not suitable to express the entire information in the form of information (visual representation) in consideration of the display size of the terminal, as described above. This is because presenting detailed information about the summarized contents can provide the information desired by the user more easily and efficiently.

In addition, unlike the existing real-time service (real-time video / audio service) of the audio-visual information, in the present invention, the control signal promised in the position promised to the terminal so that the terminal can control the audio and visual playback by receiving a user's command Is inserted into the service information itself and sent.

The auditory information processed by the auditory information processing unit 402 may be a voice signal itself, or may be text information (for voice signals) to be reproduced as a voice signal in a terminal (ie, audio information but substantially The type of information serviced may be textual information).

If the service auditory information is a voice signal (processed in the form of digital voice data and transmitted) itself, the terminal may have a means for decoding and outputting the voice signal (digital data) from the server into an audible signal. In the case of the text information for the voice signal to be reproduced in the terminal, it is only necessary to have means for synthesizing the text into the voice signal as in the first embodiment of the present invention.

6 is a block diagram of a mobile communication terminal according to a second embodiment of the present invention, and includes a signal receiver 601 for receiving synchronized audiovisual information provided through a network from a mobile communication system server, and the signal receiver 601. The control unit 602 performs a control for outputting the audiovisual information received by the user as visual information and / or audio information according to a user command, and a data storage unit for storing data processed by the control unit 602 ( 603, a user interface unit 604 for inputting a user command to the controller 602, and a signal processor 605 for performing decoding and output synchronization processing of the audiovisual information under the control of the controller 602. ) Is configured to include.

The signal receiving unit 601 receives the synchronized audiovisual information transmitted through the network from the server, receives the modulated information in a form suitable for the physical characteristics of the network and transfers the information to the control unit 602 in the form of digital information. do.

The signal receiver 601 may be, for example, a modem for wireless data communication.

The controller 602 performs data storage and process control for outputting audiovisual information input from the signal receiver 601 as visual, audio, or audiovisual information, and in particular, a user command input to the user interface unit 604. In accordance with the above, proper control of the processing and output of the visual and audio information is performed.

The data storage unit 603 is configured to store processing results for various types of information from the server made by the control unit 602, temporary data storage for data processing, and output for visually and audibly expressing the stored information. Memory means.

The signal processing unit 605 includes a display (processing) means composed of a display, a driving circuit, and the like for decoding and displaying character information from the audiovisual information to form a visual representation.

In addition, the signal processor 605 includes audio signal processing means for decoding audio information from audiovisual information and outputting the audio information as an audible signal.

This voice signal processing means is possible in two embodiments depending on the type of auditory information provided from the server.

One is when the audio information from the server is the audio signal itself, and the audio signal is decoded and output as an audible signal. The other is when the audio information from the server is character information corresponding to the audio information. In the case of synthesizing and outputting the audio signal corresponding to the character.

The user interface unit 604 inputs a command related to a visual representation of the audiovisual information, an audio representation, an audiovisual simultaneous representation, and the like from a server. For example, an input using a key switch or a user command using a touch screen method may be used. Input can be made.

A command that the user interface 604 may have and a terminal operation corresponding to the command will be described.

The user interface unit 604 has an input means of the 'audible information' command, and in response to the input of the 'aural information' command, the control unit 602 controls the signal processing unit 605 to express information on the display. Show the promised marker at the point where the information exists at the same time.

For example, in the case of simultaneous service of audiovisual information, the user may be informed of this by a graphic of a speaker or text.

This marker is displayed continuously while the visual information associated with the auditory information is displayed unless the user issues a 'remove' command.

Accordingly, the user interface unit 604 has an input means of the 'remove' command, and correspondingly, the control unit 602 performs recognition of the 'remove' command.

The user inputs an 'audio information' command to cause the controller 602 to reproduce the audiovisual information in the terminal.

That is, under the control of the control unit 602, the signal processing unit 605 performs decoding and display processing of visual information, decoding of audio information and output to an audio signal, and synchronization of audiovisual information, thereby Audiovisual expression is achieved.

On the other hand, in the second embodiment of the present invention shown in Figure 6 'voice / display form', 'speed adjustment', 'stop', 'previous / next', 'hyper link connection', ' Hyperlink search ',' hyper background sound selection 'and the like, and the control operation of the controller 602 is the same as the first embodiment of the present invention described with reference to FIG.

However, in the second embodiment of the present invention, since the audiovisual information includes hyperlink information in the audiovisual information from the server, the hyperlink information of the auditory information can be searched, and the auditory information The only difference is that a search such as 'skip' or 'hyperlink connection' can be performed, and the control operation on the auditory information is substantially the same as the control operation on the text information. Reference is made to the description of the first embodiment of FIG.

7 is a block diagram of a TV receiver to which the auditory information service system is applied as a third embodiment of the present invention.

The TV receiver using the auditory information service system receives a signal receiver 701 for receiving information provided through a network from a server, and visually and / or auditoryly receives information received from the signal receiver 701 according to a user command. A control unit 702 for performing control for outputting information, a data storage unit 703 for storing data processed by the control unit 702, and a user for inputting a user command to the control unit 702 A signal processing unit 705 for performing decoding and output synchronization processing of the audiovisual information under the control of the interface unit 704 and the control unit 702 and receiving a TV signal under the control of the control unit 702. A TV receiver 706, a TV broadcast signal (video / audio) of a predetermined channel received by the TV receiver 706, and audio-visual information output from the signal processor 705 It has been configured to include a TV signal processor 707 to output to the display and an audible signal.

The signal receiving unit 701 receives information transmitted from the server through the network, the server receives the text information if the service mainly text information, if the server services the synchronized audiovisual information, and receives the synchronized audiovisual information, If an Internet-based information service is provided, information modulated in a form suitable for the physical characteristics of the network for accessing the Internet is received, and the information is transmitted to the controller 702 in the form of digital information.
For example, in the case of digital broadcasting, text information and voice information may be included in a data channel for transmitting various additional information, and in the case of analog broadcasting, text information, voice information, etc. may be included in information provided in teletext. It can be transmitted including.

The control unit 702 performs data storage and processing control for outputting the text information input from the signal receiving unit 701 or the audio and visual information of the text and voice as visual, audio, or audiovisual information. In accordance with the user command input to 704, appropriate control of the processing and output of the visual and audio information is performed. In addition, the TV receiver 706 is controlled in response to the TV control command input from the user interface 704 to adjust the broadcast channel or adjust the volume.

The data storage unit 703 stores processing results for various types of information from the server made by the control unit 702, temporary data storage for data processing, and outputs for visually and audibly expressing the stored information. Memory means.

The signal processor 705 decodes the audiovisual information and outputs visual information and audio information.

At this time, if the auditory information from the server is the audio signal itself, the signal processing unit 705 decodes the audio signal and outputs it as an audible signal. If the auditory information from the server is character information corresponding to the auditory information, The synthesized audio signal corresponding to the character is output.

Therefore, the signal receiving unit 701 and the signal processing unit 705 are means for receiving and decoding the audio signal corresponding to the visual information and decoding and outputting the audio signal, or means for receiving and synthesizing the text information into the audio signal. Each of these functions can be implemented.

The user interface unit 704 inputs a command related to a visual representation of the audiovisual information, an audio representation, an audiovisual simultaneous representation, and the like from the server, and for example, an input using a key switch or a user command using a touch screen method. Input can be made.

Since the command that the user interface 704 has and the operation of the terminal corresponding to the command are the same as those of the first and second embodiments, the description thereof will not be repeated.

However, the user interface 704 may also serve as a means for inputting a user command (volume, channel selection, power, etc.) for TV control, and when the TV control command is input, the control unit 702 receives the TV receiver 706. ) To adjust channel or volume.

The visual and audio information output from the signal processor 705 is input to the TV signal processor 707.

The TV signal processing unit 707 performs the output of the TV receiving unit 706 and the selective output of the visual and audio information (display and audio signal output), or known screen division or overlapping techniques, for example, Using the Picture In Picture (PIP) technique, it is also possible to display the Internet information search screen together with the TV screen on one screen.

According to the text and voice information service system for a mobile communication terminal of the present invention, since the service information is provided visually, it is convenient for information search and confirmation, and the hearing information service function is also used for the visually impaired, illiterate, and the elderly. It is possible to receive information services such as the Internet.

In particular, simultaneous use of sight and hearing doubles the information transmission (acquisition) ability, thus providing the advantage that the user can recognize the information more clearly and quickly.

In addition, the present invention can be applied to the Internet TV, etc., it is also possible to convert the text information into voice information to confirm the information search results visually.

Claims (21)

When the mobile communication system provides the subscriber terminal with predetermined information desired by the subscriber in the form of text information, (a). Signal receiving means for receiving text information provided from a server of the mobile communication system, and (b). Display processing means for decoding and displaying the character information received by the signal receiving means, and (c). An audio signal processing means for converting the text information received by the signal receiving means into an audio signal corresponding to the text and outputting the audible signal; and (d). Control means for controlling the output of the text information and the audio signal in response to a user command, and (e). And a user interface means for inputting a user command to control the output of the text information and the audio signal to the control means. When the mobile communication system provides the subscriber terminal with predetermined information desired by the subscriber in the form of text information and audio information (voice, sound, music, etc.) corresponding to the text information, (a). Signal receiving means for receiving audio-visual information provided from a server of the mobile communication system, and (b). Display processing means for decoding and displaying character information from the audiovisual information received by the signal receiving means, and (c). Audible signal processing means for decoding audio information (voice, sound, music, etc.) from the audiovisual information received by the signal receiving means and outputting it as an audible signal; and (d). Control means for controlling the output of the text information and the audio signal in response to a user command, and (e). And a user interface means for inputting a user command to control the output of the text information and the audio signal to the control means. When the mobile communication system services the subscriber terminal in the form of text information that the subscriber desires to visually express in the terminal and text information for audio signal to be reproduced in the terminal corresponding to the text information, (a). Signal receiving means for receiving audio-visual information provided from a server of the mobile communication system, and (b). Display processing means for decoding and displaying character information to be visually represented on a display from the audiovisual information received by the signal receiving means, and (c). Auditory signal processing means for converting the audio signal information from the audiovisual information received by the signal receiving means into an audio signal corresponding to the character and outputting it as an audible signal; and (d). Control means for controlling the output of the text information and the audio signal in response to a user command, and (e). And a user interface means for inputting a user command to control the output of the text information and the audio signal to the control means. The mobile communication according to any one of claims 1, 2 and 3, wherein the text information and the audio signal are output in synchronization with each other when the text information and the audio signal are output. terminal. The mobile communication terminal of claim 1, 2 or 3, wherein at least one of the text information and the audio signal is selected by a user. The method according to any one of claims 1 to 4, wherein the character information and audio information (voice, sound, music, etc.) are stopped, continued, speeded up, before / after Mobile communication terminal, characterized in that the degree of progress is adjusted. 4. A mobile communication terminal according to any one of claims 1, 2, or 3, wherein a start point of expression of the information to be audibly expressed is selected by a user. The audiovisual information according to any one of claims 1 to 3, wherein if the information received from the server of the mobile communication system includes a hyperlink and the terminal includes a hyperlink detecting means. When the hyperlink is detected in the expression process of the mobile communication terminal characterized in that to inform the user of the hyperlink by using audible information including voice, sound, music. 4. The method according to any one of claims 1, 2, or 3, wherein if the information received from the server of the mobile communication system includes a hyperlink and the terminal includes hyperlink detecting means, A mobile communication terminal comprising a summary of a hyperlink with respect to the detected location, and notifying the user with auditory information including voice, sound, and music. 4. The hyperlink according to any one of claims 1, 2 and 3, wherein the information received from a server of the mobile communication system includes a hyperlink and the terminal includes a hyperlink detecting means. And inform the user by using audible information including voice, sound, and music, and connect the hyperlink by a user selection. (a). Visual information processing means for processing textual representations in the subscriber terminal and visually inserting hyperlink information capable of linking to relevant information corresponding to the text information, and (b). Acoustic information (voice, sound, music, etc.) corresponding to the character information is processed in order to audibly express to the subscriber terminal, and the audio information to insert a hyperlink in the audio information (voice, sound, music, etc.) Information processing means, and (c). And network processing means for automatically synchronizing audio information (voice, sound, music, etc.) to correspond to text information processed by the visual information processing means and the audio information processing means. Text and Audio Information Server. 12. The method of claim 11, wherein the visual information by the visual information processing means is a summary of information to be serviced and extracted information such as keywords, and the audio information by the auditory information processing means correspondingly is oral form. Network-based text and audio information server, characterized in that the detailed description of the. 12. The network-based text and audio information server according to claim 11, wherein the timing of the presentation of the audiovisual information of the terminal is controlled by the synchronization of the visual information and the audio information made by the synchronization processing means. 12. The network-based text and audio information server according to claim 11, wherein the processing of the audio information by the audio information processing means is an actual audio signal corresponding to the visual information. 12. The network-based text and auditory information server according to claim 11, wherein the processing of the auditory information by the auditory information processing means is text information for auditory signals corresponding to the visual information. delete delete delete delete delete delete

Images