KR20140015228A

KR20140015228A - Mobile media service system and the method using tts(text to speech) engine of a mobile device

Info

Publication number: KR20140015228A
Application number: KR1020130160917A
Authority: KR
Inventors: 강상원
Original assignee: 강상원
Priority date: 2013-12-23
Filing date: 2013-12-23
Publication date: 2014-02-06

Abstract

Mobile terminals such as smartphones are convenient to carry anywhere anytime, but in many cases, the user's attention is attracted by signals that inform the status of the phone or the arrival of messages. There are many steps to unpacking the device, opening the notification window to view the message, and then opening the application to view the contents. However, the above steps such as watching TV, exercise, and work can not be performed or the operation is cumbersome, and there is a need for a means to replace it, and various notifications as well as part or all of the contents delivered can be spoken without the operation process. Of course, the present invention provides a technology and service system for converting information of interest or text-type text into real-time or on demand, such as radio, to listen to voice.

Description

Mobile media service system and the method using TTS (Text To Speech) engine of a mobile device}

The present invention provides a notification message output from an operating system (OS) of a mobile terminal such as a smartphone, a notification message output from applications installed on the terminal, a request from the terminal, or information of a preset format. The application of the terminal in converting the message transmitted to the terminal through the Internet (push, push), and the advertisement and promotional messages sent to the terminal to the voice using the TTS (Text To Speech) engine mounted on the terminal The present invention relates to a service and a method of operating the same without closing the screen and turning off the power.

Mobile terminals, such as smartphones, are used in various ways (User interface), which can be used to view or listen to the output on the screen, to synthesize the screen contents into voice, and to check the contents after recognizing the notification by vibration or sound. This is achieved through various touch operations, which may be inconvenient or inconvenient due to the use characteristics of the mobile terminal, and the operation method is also confused depending on each application.

In other words, when a light or serious condition is delivered to the user in the form of a notification from the terminal system itself, and whenever a great news such as a disaster or a light story such as humor is delivered, the importance of the content is not known without checking the contents. Therefore, most users go through complicated steps, which is causing a lot of waste.

This is a new technology and service that listens to various texts, messages, news, advertisements, and promotions such as status notifications and texts (SMS) in a predetermined time or manner without any manipulation such as turning on and touching the screen of the terminal. Will be needed.

A new method of using a mobile terminal, such as a smartphone, includes status information transmitted from a terminal system at a predetermined time and method, notification information from various applications installed in the terminal, and a terminal user's selection and delivery from a server. In order to hear text messages by voice using the TTS engine of a terminal, a service system configuration method of controlling and managing the flow of text information transmitted through the various paths and methods as described above is provided so that they can be output without a separate operation. Should be.

In order to solve this problem, the present invention sets a method of receiving a service in a mobile terminal to configure a terminal application (client) for operating the relevant functions, and to configure a service server to collect and deliver text information to the terminal, the Internet The present invention provides a method of configuring a service system by using a data communication network such as a mutual information exchange and a method of transferring information through an external push message server, and solves a problem by operating each component with a minimum delay.

The service server receives the service selection and setting information of the client (user) and the provided information through data communication and stores and manages the information in the DB, and the necessary information from the client and external information providers according to the service and setting information selected by the client, that is, various information. It collects news, posts, advertisements, promotions, and announcements, requests them to an external push message server, and delivers them to the client, and provides a method of directly delivering data requested by the client receiving the push message through data communication.

The application for the terminal, that is, the client, the status notification messages of the terminal itself, notification messages from other applications, push messages delivered to wake up the client from the service server, and delivered from the requested service server for additional necessary information. How to convert various messages such as news, etc., into the voice by using the TTS engine installed in the terminal or separately installed by the user, and send them to the sound output device of the terminal, and deliver the information input by the information provider to the service server To provide.

The external push message server is constructed and serviced by a mobile operating system operating company such as Google, Apple, or Microsoft, and operates on a request for delivering a message required by a service server of the present invention to a client.

In accordance with the present invention, the mobile terminal user operates the provided application (client) to set the service type, operation time, and operation method as basic or additional settings, and then operates in the background even if the application is turned off as well as the screen is turned off. You can listen to the information in the middle of the service, such as using a convenient radio, such as a smarter to use the terminal, information providers can be used as a social media, local advertising and promotional means can be operated as a new type of media.

1 is a block diagram of a service system according to the present invention;
2 is a functional configuration diagram of a service server according to the present invention.
3 is a functional configuration diagram of a client according to the present invention.
4 is a process flow diagram performed in a client in accordance with the present invention.
5 is a process flow diagram performed in a service server according to the present invention.

The service providing method of the present invention will be described in detail with the accompanying drawings.

1 is a block diagram of a media service system using a TTS according to the present invention.

The user using the service of the present invention is a user of the mobile terminal 100, as shown in the system configuration diagram, and the configuration of the service system is, first, various status information from the terminal's own operating system (OS) in the form of a general notification (Notification) In the present invention, the status information is also output through the TTS engine, and the second information is transmitted through the TTS engine. Second, the Internet server 120 of the web page contents of the website of the external information provider 130 is provided by the service server 140. The text-type information collected and collected by the push message server 150 is transmitted to the user 100 in need through the Internet 120 to be output as a voice, and third, the text input by the information provider 110 that is a part of the user The type of advertisement, publicity, information is delivered to the service server 140 through the Internet 120, the service server 140, the user who needs the information (100) Consists of selected criteria, such as region, type and to the internet 120 through a push message server 150 is a system that performs three main functions of which allows the user to hear the.

The mobile terminal user 100 starts a background operation by setting a listening time and a listening method in a separately provided application and closes the application screen, and then listens to the voice in the order in which the information arrives. do.

The information provider 110 enters text-type information to be listened to by the user 100 through a separate application and transmits the information to the service server through the Internet 120. The delivered information is transmitted by the service system to the user. The voice is delivered to the voice 100.

The external information provider 130 is provided through the web page of the website including the information required by the user 100, the service server 140 periodically collects and needs the user 100 Selected by region, type, and delivered through a push message server, the delivered information is spoken to the user 100 by voice.

The service server 140 stores and manages region and type-specific information of the user 100 or extracts additional request information of the user 100 from a DB and delivers the information to the user 100 through the push message server 150. It serves to deliver the information of the external information provider 130 to the user (100).

The push message server 150 identifies the user terminal 100 in its own way and forcibly delivers the message. The push message server 150 is operated by an external organization irrelevant to the present invention.

The Internet 120 data communication is in accordance with widely used open communication protocols such as HTTP and SOCKET.

2 is a diagram showing the functional configuration of the service server 140 according to the present invention by using the process flow diagram performed in the service server of FIG. All of them are configured to access and use DB.

The information collection 200 module extracts the necessary information from the external information provider 130 and temporarily stores it in a DB to allow the user to transmit or receive the information by the information transmission 250 module or the push message transmission module 220 under the judgment of the transmission / reception control 210 module. To be delivered to (100).

The request receiving module 230 requests information necessary for the message received by the user 100 or receives the information requested by the information provider 110 to be temporarily stored in a DB to be processed by the transmission and reception control 210 module. Do this.

If there is any request or collected information, the push message transmission 220 module selects necessary information according to the region or type of the user 100 and transmits the information through the information transmission 250 module or the push message transmission 220 module. It plays a role.

The push message transmission 220 module performs a request for information transmission to an external push message server by the transmission and reception control 210 module.

The information transmission module 250 transmits information to the user 100 through the Internet by the transmission / reception control module 210.

Each of these modules share a DB and perform services.

3 is a functional configuration diagram of a client according to the present invention, which represents modules for each function of an application to be installed and used by a user 100. Each module is an element necessary for development together with a processing flowchart performed by the client of FIG. Each module is composed of a library or hardware modules included in the user 100 application or externally provided, and are interconnected and operate around the information output control 340 module.

The system 311 module targets the basic status information of the system to be displayed on the terminal in the form of a notification, and additional system status information other than the basic notification is collected by a separate notification message collection 313 module.

The external application 312 module refers to an application that provides a service in a notification form among applications installed in the terminal.

The notification message collection module 313 collects information required by the user 100, such as a notification message from a system or an external application, necessary system information, and a current time, so that the information is output by voice by the information output control 340 module. Perform a collection role.

The request information receiving module 321 receives the information transmitted from the service server 140 through the Internet and outputs the voice by the information output control module 340.

The push message receiving 322 module receives a message from the external push message server 150 and outputs the voice by the information output control 340 module.

The user input 330 module inputs information to be heard by the users 100 through an application provided separately, and requests the information transmission to the service server 140 through the Internet by the information output control 340 module. To perform.

The information output control 340 module transmits the collected information to the service server 140 or outputs the voice to the audio output terminal 370 through the TTS engine.

The information / request transmission 350 module transmits information to the service server 140 through the Internet or requests additional information.

The TTS engine 360 module performs voice synthesis of text data and outputs the audio to the audio output terminal 370. The TTS engine 360 module may be installed in a terminal or may be selected by installing a plurality of separate modules.

The audio output terminal 370 is a module for outputting voice data received from the TTS engine and may be a speaker, an earphone connection terminal, or a Bluetooth communication line.

4 is a flowchart of a process performed in a client according to the present invention, which provides a flow of program logic as required by a user 100 to develop an application to be installed and operated in a terminal.

When the client application starts, it sets when (day, time), how (whether the terminal outputs a voice when the vibration is set, output volume, etc.) and what (select system status information, select information types) (411). And, if necessary information is input 412, and transmits the input information to the service server 140 (413), there is no input information (412) at the same time starting the service closes the application screen and executes the background operation (414) do.

The operation of the application performed in the background may include receiving events 421 and classifying 422 to extract notification messages when the notifications are received 424 and receiving information when the requested information is received from the service server 140 425. ), If the message is received from the push message server 150 (423) after determining whether the additional information is needed (431), if necessary, sends the additional information request 432 to the service server 140, if necessary extracts the additional information After the received notification message and the received information are collected, it is controlled 441 in which order and period of the voice output to be performed, the voice output 443 is performed using the TTS engine, and then enters the next event waiting state.

5 is a flowchart of a process performed by a service server according to the present invention. The push message server 150 communicates with the user terminal 100 or directly communicates with the user 100, exchanges necessary data, and performs a media server role. do.

When a script to perform an operation in the service server 140 is executed in the background (daemon), the event is classified (510), and if there is an information request (521) of the user 100, the user (100) is required directly through the Internet communication to the terminal. Information is transmitted (522), if there is no request to search the web page of the external information provider 130, collects the necessary information (523) and transmits to the push message server 150 (530) to deliver to the user (100) terminal Be sure to

Shown in the drawing.

Claims

In a media service system using a TTS of a mobile terminal, a terminal application to be used to perform a voice output service or provide information on a user's terminal, and information collected from a website or a web page of an external information provider and provided through the terminal. Mobile voice output, comprising a service server for collecting, storing, processing, managing, and transmitting information produced directly to a user terminal, a push message server to be used for push message transmission, and a data transmission network such as the Internet. Media service system.

The system of claim 1, wherein the terminal application outputs various status information of the system, messages output in a notification window, text messages (SMS) received, and messages received through a communication network from a server through a TTS engine. Application configuration method characterized in that.

The service method of claim 1, wherein the terminal application sets a method of receiving a service once to hear information output by a voice even when the application screen is closed and the screen is turned off.

The terminal application of claim 1, wherein the terminal application receives a region of a terminal user to receive information, a desired date and time, and a number of users from a service server.

The system of claim 1, wherein the service server delivers the received information and the collected information through a push message server or directly through the Internet in accordance with the date and time selected by the application of the user terminal and the selected service information type. .

The method of claim 1, wherein the type of information is classified into channels and the respective channels can be selected in duplicate in order to select desired information in the terminal application.

The media service system of claim 1, wherein the terminal application distinguishes between a live broadcast listening for real-time generation or immediately receiving information received from a server and a request-type listening for receiving desired information from among information stored in the server. Service method characterized in that.

The method of claim 1, wherein the media service system provides information based on the location of the user terminal among the information provided to the terminal application in a text message so as to be heard by a voice.

The media service system of claim 1, wherein an external information provider who wants to broadcast information stores the textual information input through the application and the web page of the terminal through a data communication network or a push message server without or after storing the textual information on the server. Delivering to a mobile terminal, the mobile terminal using a TTS engine, characterized in that the synthesized voice output.