KR20130070675A - Wireless terminal and information processing method - Google Patents

Abstract

PURPOSE: A wireless terminal and an information processing method thereof are provided to automatically operate a TTS(Text To Speech) engine and an STT(Speech To Text) engine by confirming the location of the wireless terminal. CONSTITUTION: When a wireless terminal is located within a vehicle, a conversion unit(245) converts voice information into text information received by one or more applications for transmitting and receiving text information. A processing unit(250) outputs the converted voice information through a speaker. An input unit(260) receives the voice information of a wireless terminal user. The conversion unit coverts the inputted voice information into the text information. [Reference numerals] (100) User terminal; (200) Control unit; (210) Interface unit; (215) Registration unit; (220) Memory unit; (225) Determination unit; (230) Communication unit; (235) Confirmation unit; (240) Extraction unit; (245) Conversion unit; (250) Process unit; (255) Output unit; (260) Input unit; (AA) Each application; (BB) Application information for SMS transception; (CC) Item information

Description

Wireless terminal and information processing method of the wireless terminal {Wireless Terminal and Information Processing Method}

The present invention confirms that the location of the wireless terminal is located in the vehicle, converts the text information received by the wireless terminal into the voice information and outputs, and converts the voice information input through the wireless terminal into the text information to be processed will be.

In recent years, as mobile messengers become more popular, various IM (Instant Messenger) applications such as KakaoTalk and other e-mail applications, short message service (SMS) applications, etc. have been established as means for receiving text information. It has several types of text information receiving means instead of ~ 2.

However, such a number of text information receiving means has been mass-produced a problem that when the user is driving, the driver's eyes are dispersed and may act as a risk factor when driving the vehicle as the text information is sometimes received.

On the other hand, thanks to the development of the Text to Speech (TTS) engine that converts text information into voice information and the STT (Speech to Text) engine that converts voice information into text information, users can receive text information received from wireless terminals. The voice information can be output and listened to, and when the voice information is input, it can be converted into text information and transmitted.

Patent Publication No. 10-2001-0086402 (voice recognition device) describes a device and method for recognizing a user's voice, and Patent Publication No. 10-2002-0094988 (voice synthesis method and implementation thereof) Voice synthesizer) describes a device and a method for synthesizing a specific sentence into an arbitrary voice.

However, even if the TTS engine and the STT engine are provided in the wireless terminal, when receiving text information, the user must drive the corresponding TTS engine and the STT engine one by one, and drive the TTS engine and the STT engine while driving the vehicle. If you forget, it's a shameless feature.

An object of the present invention for solving the above problems, after checking whether or not the wireless terminal is located in the vehicle, when the wireless terminal is located in the vehicle, by automatically driving the TTS engine and STT engine, so that the user It solves the inconvenience of handling TTS engine and STT engine directly by boarding at the same time. At the same time, it forgets the driving of TTS engine and STT engine while driving, and blocks the dangerous situation where the driver's eyes and actions are focused on the wireless terminal when receiving text information The present invention provides a wireless terminal, a computer-readable recording medium having recorded thereon an information processing method and a program for executing information processing.

The wireless terminal according to the present invention includes a confirmation unit for confirming whether the wireless terminal is located in the vehicle, and when the identification result of the confirmation unit, the wireless terminal is located in the vehicle, the first to the first to receive the character information provided in the wireless terminal A conversion unit 1 for converting text information received through one of the N applications into voice information, a processing unit for processing the converted voice information to be output through a speaker provided in the wireless terminal, and a wireless terminal; And an input unit for receiving voice information of a user and a converting unit 2 for converting the input voice information into text information, wherein the processing unit is configured to transmit the converted text information through the text information transmitting and receiving application. Process.

According to one side, the confirmation unit may be activated at the time when the text information is received through one of the first to N-th application for transmitting and receiving the text information, the GPS (global positioning system) provided in the wireless terminal and The position movement distance of the wireless terminal per hour is calculated using a timer, and the case where the calculated position movement distance of the wireless terminal per hour is greater than or equal to a predetermined value is determined as the case where the wireless terminal is located in the vehicle, or the wireless terminal is provided. After comparing the location information of the wireless terminal using the GPS and the location information of the communication device using the GPS of the communication device provided in the vehicle, the wireless terminal is a case where the wireless terminal and the communication device is located at an adjacent distance Check if it is located inside, or through the one or more motion sensors and timer provided in the wireless terminal The case where the time information of at least one of the time when the movement of the wireless terminal stops and the time when the movement stops and then moves again is less than a predetermined time can be confirmed as the case where the wireless terminal is located in the vehicle.

According to another aspect, the wireless terminal, and the interface unit for providing an interface for selecting one or more of the first to N (N = 2,3..N) applications for transmitting and receiving text information provided in the wireless terminal; When the character information is received by the registration unit for storing and registering information of at least one character information transmission / reception application selected by the wireless terminal user through the interface unit in a memory, and the first to Nth applications for character information transmission and reception, If the text information transmission / reception application for receiving the text information is an application for transmitting / receiving text information registered in the memory, the text information received or received by the text information transmission / reception application previously stored in the memory or the It may further include an extraction unit received through the application for transmitting and receiving text information. All.

According to another aspect, the interface unit may be voice information among text information received by a selected application other than an application selection function among the first to Nth applications (N = 2,3..N) applications for transmitting and receiving text information. The item information to be converted and output may be further selected or received, and the registration unit may be further stored and registered in a memory by connecting the item information selected or input through the interface with the selected application information for transmitting and receiving text information. The extracting unit may check the item information connected to the application information for transmitting and receiving the character information on the memory, and selectively extract or receive only character information corresponding to the item information from the character information. The item information may include the short message service (SMS), In the case of a message transmission / reception application including one or more Long Message Service (LMS) and Multimedia Message Services (MMS), one or more item information among message sender information and message content information may be included.

An information processing method in a wireless terminal according to the present invention includes a confirmation step of confirming whether a wireless terminal is located in a vehicle, and a result of the confirmation through the identification step, when the wireless terminal is located in a vehicle, a character provided in the wireless terminal. A voice information conversion step of converting text information received through one of the first to N-th application for transmitting and receiving information into voice information, and processing to output the converted voice information through a speaker provided in the wireless terminal. A voice information processing step, an input step of receiving voice information of a wireless terminal user, a text information conversion step of converting the input voice information into text information, and the converted text information is used to transmit and receive the text information application. Character information processing step of processing to be transmitted through.

According to one side, the confirming step, further comprising the step of first confirming whether the text information is received through one of the first to N-th application for text information transmission and reception, in response to the first confirmation result In addition, the wireless terminal can check whether the vehicle is located in the vehicle.

According to another aspect, the checking step, using the GPS (global positioning system) and a timer provided in the wireless terminal to calculate the position movement distance of the wireless terminal per hour, the calculated position movement distance of the wireless terminal per hour The case where the set value is equal to or greater than the set value is confirmed as the case where the wireless terminal is located in the vehicle, or the location information of the wireless terminal using the GPS provided in the wireless terminal and the location information of the communication device using the GPS of the communication device provided in the vehicle. After comparing the, the case where the wireless terminal and the communication device is located in the adjacent distance is confirmed as the case that the wireless terminal is located in the vehicle, or the wireless terminal through one or more motion sensors and timers provided in the wireless terminal The time information of at least one of the time when the movement stops and the time when the movement stops and then moves again is less than the preset time. Wherein the case ganin wireless terminal can be identified as if the vehicle location.

According to another aspect, the information processing method in the wireless terminal, the interface for selecting one or more of the first to N-th (N = 2,3..N) applications for transmitting and receiving text information provided in the wireless terminal; A step of providing an interface, a registration step of storing and registering information on at least one character information transmission / reception application selected by a wireless terminal user through the interface, in a memory, and the first to Nth applications for character information transmission and reception. When text information is received, if the text information transmission / reception application for receiving the text information is previously stored in the memory and registered text information transmission / reception application, the previously stored text information transmission / reception application in the memory is received. Extract text information or transmit it through the text information transmission and reception application It may further include an extraction step.

According to another aspect, the interface providing step, the voice information of the text information received by the selected application other than the selection of one or more applications of the first to N (N = 2,3..N) applications for transmitting and receiving the text information May further select or receive item information to be converted and output, and the registration step may further include storing the item information selected or input through the interface with the application information for transmitting / receiving the selected text information, in a memory. In the extracting step, after checking the item information connected to the application information for transmitting and receiving the character information on the memory, only the character information corresponding to the item information among the character information may be selectively extracted or received. .

According to the present invention, there is also provided a computer-readable recording medium having recorded thereon a program for executing the respective steps.

In addition, according to the present invention, the text information transmission and reception application, a message transmission and reception application including one or more Short Message Service (SMS), Long Message Service (LMS), Multimedia Message Services (MMS), an email transmission and reception application, It may include an instant messenger application and one or more Social Networking Service (SNS) application, the text information, the message sender information and message content when the application is a message transmission and reception application including one or more SMS, LMS, MMS And at least one piece of information, and if the application is an email sending / receiving application, including at least one email sender information, an email subject information, and an email body content information. If the application is an instant messenger application, messenger user information and messenger content information. To Or it may include more.

According to the present invention, by checking only whether the radio terminal is located in the vehicle to automatically drive the TTS engine and STT engine, while solving the inconvenience that the user must directly handle the driving of the TTS engine and STT engine on board the vehicle one by one Forgetting the operation of the TTS engine and the STT engine while driving has the effect of blocking the dangerous situation where the driver's eyes and actions are focused on the wireless terminal at the time of receiving text information.

In addition, the wireless terminal user can set and register the application to convert the text information received from the various types of text information transmission and reception applications to the voice information and the item information to be converted through the single UI (User Interface). If the wireless terminal is located in the vehicle, it is easier and more convenient to use the voice information conversion output service of the text information, and through this, do not separately install a TTS engine or STT engine for each application for sending and receiving text information It has economic effects that do not have to.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are incorporated in and form a part of the specification, illustrate preferred embodiments of the invention and, together with the description of the invention given above, serve to further the understanding of the technical idea of the invention. And should not be construed as interpretation.
1 is a diagram illustrating a configuration of an overall communication network according to an embodiment of the present invention.
2 is a diagram illustrating a detailed configuration of a user wireless terminal according to an embodiment of the present invention.
3 is a diagram illustrating a user interface (UI) according to an embodiment of the present invention.
4 is a diagram illustrating a process of converting text information into voice information and outputting the same after confirming whether a wireless terminal is located in a vehicle according to an exemplary embodiment of the present invention.
5 is a diagram illustrating a process of confirming whether a wireless terminal is located in a vehicle according to an exemplary embodiment of the present invention.
6 is a diagram illustrating a process of selecting and registering a voice information conversion target application and item information among a plurality of text information transmission and reception applications according to an embodiment of the present invention.
7 is a diagram illustrating a process of extracting text information corresponding to pre-registered application information according to an embodiment of the present invention.
8 is a diagram illustrating a process of converting text information corresponding to pre-registered application and item information into voice information according to an embodiment of the present invention and outputting the voice information.
9 is a diagram illustrating a process of converting a user's reply voice information into text information and transmitting the same according to an embodiment of the present invention.
10 is an embodiment diagram according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings and description will be described in detail the operating principle of the preferred embodiment of the present invention. It should be understood, however, that the drawings and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention, and are not to be construed as limiting the present invention. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The terms used below are defined in consideration of the functions of the present invention, which may vary depending on the user, intention or custom of the operator. Therefore, the definition should be based on the contents throughout the present invention.

As a result, the technical spirit of the present invention is determined by the claims, and the following examples are one means for efficiently explaining the technical spirit of the present invention to those skilled in the art to which the present invention pertains. It is only.

1 is a diagram illustrating a configuration of an overall communication network according to an embodiment of the present invention.

In more detail, FIG. 1 shows that a user wireless terminal 100 is connected to at least one text information relay server 110 corresponding to a plurality of text information transmission and reception applications provided in the wireless terminal 100 through a communication network. It shows a configuration for receiving the text information transmitted through the information transmitting and receiving terminal 120, and outputs the text information as voice information through the speaker of the wireless terminal 100 itself.

The text information relay server 110 according to the present invention relays the text information transmitted through the text information transmission and reception terminal 120 to the user wireless terminal 100, and the text transmitted through the user wireless terminal 100. It relays and transmits information to the text information transmission and reception terminal 120.

According to the present invention, the text information relay server 110, the text information transmission and reception application provided in the user wireless terminal 100 is SMS (Short Message Service), LMS (Long Message Service), MMS (Multimedia Message Services) In the case of a message transmission and reception application including one or more, it may be a message service center server on the communication network, when the text information transmission and reception application provided in the user wireless terminal 100 is an email application, the email relay server 110 on the communication network If the text information transmission and reception application provided in the user wireless terminal 100 is an instant messenger application, it may be a relay server 110 for supplying and operating each messenger application, the user wireless terminal 100 If the provided text information transmission and reception application is a Social Networking Service (SNS) application, Each of the SNS application can be a relay server (110) that supplies and operations.

The text information transmission and reception terminal 120 according to the present invention transmits a message or an e-mail including one or more SMS, LMS and MMS to the user wireless terminal 100, or communicates a messenger or SNS with the user wireless terminal 100. Means the terminal to be executed, and includes all terminals capable of transmitting and receiving text such as mobile phones, smartphones, tablet PCs, PCs, telematics.

The user wireless terminal 100 according to the present invention calculates the position moving distance of the wireless terminal 100 per hour by using a GPS and a timer provided in the wireless terminal 100, and calculates the calculated wireless per hour. The case where the position movement distance of the terminal 100 is greater than or equal to a predetermined value is confirmed as the case where the wireless terminal 100 is located in the vehicle, or the GPS of the wireless terminal 100 using the GPS provided in the wireless terminal 100 is determined. After comparing the location information and the location information of the communication device using the GPS of the communication device provided in the vehicle, the wireless terminal 100 is located in the vehicle when the wireless terminal 100 and the communication device is located in the adjacent distance Check if it is located, or at least one of a time when the movement of the wireless terminal 100 is stopped and moved again through one or more motion sensors and timer provided in the wireless terminal 100 After confirming that the inter-information time is less than a predetermined time as the case where the wireless terminal 100 is located in the vehicle, when the wireless terminal 100 is located in the vehicle, the character provided in the wireless terminal 100 Converting text information received through one of the first to Nth applications for information transmission and reception into voice information, and processing the converted voice information to be output through a speaker provided in the wireless terminal 100; When the reply voice information of the user of the wireless terminal 100 is input, convert the input voice information into text information, and then convert the converted text information into the wireless terminal 100 through the text information transmission / reception application. It performs a role of processing to be transmitted to the character information transmission and reception terminal that transmitted the information.

In addition, the wireless terminal 100 provides a user with an interface for selecting one or more of the first to Nth (N = 2,3..N) applications for text information transmission and reception provided in the wireless terminal 100. And store and register information on at least one character information transmission / reception application selected by the user of the wireless terminal 100 through the interface in advance on the memory 220, and whether the wireless terminal 100 is located in the vehicle. After confirming, and determining the activation or deactivation of the extraction function of the character information received through the application for transmitting and receiving the character information, previously stored and stored in the memory 220 in response to the confirmation result, When the text information is received by the N application, the text information transmission and reception application for receiving the text information is previously stored and registered in the memory 220. If the beam for transmitting and receiving applications, and extracts or perform further serves to receive the character information transmitted through the transmitting and receiving applications for the reservoir, which is for the registered character information transmitting and receiving application receives text information in the memory 220.

In addition, the wireless terminal 100 of the text information received by the selected application other than one or more application selection function of the first to N-th (N = 2,3..N) applications for transmitting and receiving the text information through the interface; The mobile terminal 100 may further perform a role of selecting or inputting item information to be converted and outputted into voice information. In this case, the wireless terminal 100 transmits and receives the selected text information to the selected item information. Is connected to the application information for storing and registering on the memory 220, and when the character information is received in the first to N-th application for transmitting and receiving the character information, the application for transmitting and receiving the character information on the memory 220 After checking the item information connected with the information, only the character information corresponding to the item information among the text information is selected and added. Or delivery can be performed more acts recipient.

Here, the item information may be one of message sender information and message content information when the application is a message transmission / reception application including one or more Short Message Service (SMS), Long Message Service (LMS), and Multimedia Message Services (MMS). The above item information may be included. When the application is an e-mail transmission / reception application, the information may include at least one item information among e-mail sender information, e-mail subject information, and e-mail body content information. When the application is an instant messenger application, One or more item information among messenger user information and messenger content information may be included.

Here, according to the present invention, the text information transmission and reception application, a message transmission and reception application including one or more Short Message Service (SMS), Long Message Service (LMS), Multimedia Message Services (MMS), email transmission and reception application, It may include one or more instant messenger application and SNS application, wherein the text information, if the application is a message transmission and reception application including one or more SMS, LMS, MMS, and includes one or more message sender information and message content information When the application is an e-mail transmission and reception application, and includes at least one email sender information, email subject information and email body content information, if the application is an instant messenger application, and includes at least one messenger user information and messenger content information, Group may include an application SNS if the application, one or more of the user ID information and contents information.

2 is a diagram illustrating a detailed configuration of a user wireless terminal 100 according to an embodiment of the present invention.

2 is applied to the information processing according to the present invention, the wireless terminal 100 operating in a mobile communication or communication system, although not shown in detail in the drawing, the wireless terminal 100 in terms of hardware It may include an external body, a speaker, a microphone, a keypad, a liquid crystal display (LCD), an antenna, a battery, and the like, and may include all the functions and configurations of the wireless terminal 100 that can communicate now or in the future. Can be.

Preferably, the main functional configuration of the wireless terminal 100 according to the present invention with reference to the above-described hardware characteristics, as shown, the interface unit 210, the registration unit 215, the memory 220, The determination unit 225, the communication unit 230, the confirmation unit 235, the extraction unit 240, the conversion unit 245, the processing unit 250, the output unit 255, and the input unit 260 And the controller 200 for controlling the respective components and programs, and the components may be added or excluded according to the type and characteristic of the wireless terminal 100 and the embodiments of the skilled person. Can be.

For example, one of the application for text information transmission and reception, which is one of the embodiments of the present invention, is provided with a function of directly converting text information into voice information and outputting the voice information into text information. The configuration of the interface unit 210, the registration unit 215, and the extraction unit 240 may be omitted.

Referring to FIG. 2, the interface unit 210 selects one or more of the first to Nth (N = 2,3..N) applications for transmitting and receiving text information included in the wireless terminal 100. Serves to provide.

That is, the interface unit 210 confirms to the user one or more applications with a function of transmitting / receiving text information among a large number of applications provided in the wireless terminal 100 and outputs them on the interface screen. Through the user, the application converts the text information into the voice information and / or the application to convert the voice information into the text information.

In addition, the interface unit 210 may select or input an item to be output as voice information among text information received through each text information transmission / reception application selected by the user other than selection of an application for text information transmission / reception from the user. Play more roles.

Here, the item information may be one of message sender information and message content information when the application is a message transmission / reception application including one or more Short Message Service (SMS), Long Message Service (LMS), and Multimedia Message Services (MMS). The above item information, and when the application is an e-mail transmission / reception application, the e-mail sender information, the e-mail subject information, and the e-mail body content information includes one or more item information. At least one item of messenger content information is included.

3 is a temporary view of an interface screen according to the present invention. As shown in FIG. 3, the interface unit 210 includes text information transmission / reception functions among a plurality of applications currently installed in the user wireless terminal 100. Kinds of applications, that is, a message transmission / reception application, an email transmission / reception application, a messenger KakaoTalk application, an M & application, and an SNS application, a Twitter application, are output on the interface screen, so that the user can receive voice information when receiving text information among the five applications. You can select the target application to convert and output, and at the same time, it supports the function to select the item to be converted to voice from the text information received through each selected application.

For example, in the case of an SMS application, when a user receives text information such as an SMS, the user may select the sender information and the message content information to be converted to voice. In addition, the e-mail sender information and the e-mail subject information can be selected as an item to be converted into voice, and in the case of the M & Messenger application, only the sender information which is a messenger conversation partner can be selected to be converted into voice and output.

Here, the sender information may be sender name information recorded in the contact information, Calling Identification Display (CID) information, ID information, or e-mail address information.

The registration unit 215 according to the embodiment of the present invention mutually exchanges information of at least one character information transmission / reception application selected by the user of the wireless terminal 100 and item information corresponding to each selected application through the interface unit 210. It connects and stores on the memory 220.

The memory 220 according to the present invention serves to store application information for transmitting / receiving text information selected by a user stored and registered through the registration unit 215 and item information corresponding to each selected application.

Of course, the memory 220 is when a predetermined program routine (or code) and / or program data (eg, program routine (or code)) for controlling the overall operation of the wireless terminal 100 is performed A general term for a memory 220 element that stores input and output information and / or data, and includes a read only memory (ROM) corresponding to the read only memory 220 and a flash memory 220 capable of reading / writing (Flash). Memory (FM), and EEPROM (Electrically Erasable and Programmable Read Only Memory), etc., and may further serve to store a variety of applications provided in the wireless terminal (100).

The confirmation unit 235 according to the present invention serves to determine whether the wireless terminal 100 is located in a vehicle, and uses a global positioning system (GPS) and a timer provided in the wireless terminal 100. Calculate the position movement distance of the wireless terminal 100 per hour, and confirm that the case where the calculated position movement distance of the wireless terminal 100 is greater than or equal to a preset value as the case where the wireless terminal 100 is located in the vehicle; Or after comparing the position information of the wireless terminal 100 using the GPS provided in the wireless terminal 100 with the position information of the communication device using the GPS of the communication device provided in the vehicle, and the wireless terminal 100 The case where the communication device is located at an adjacent distance is confirmed as the case where the wireless terminal 100 is located in the vehicle, or the wireless terminal 100 through one or more motion sensors and a timer provided in the wireless terminal 100. Movement Wherein the stop time is stopped and if the one or more time information among the moving time period of the predetermined time period less than the wireless terminal 100 is to determine if a location within the vehicle.

In addition, according to another embodiment of the present invention, when the character information is received through the communication unit 230, the confirmation unit 235, the application for receiving the character information is pre-stored in the memory 220 It further performs the role of checking whether the registered text information transmission and reception application.

The determination unit 225 according to an embodiment of the present invention, according to the confirmation result of the confirmation unit, whether the wireless terminal 100 is located in the vehicle and the application for receiving the text information is stored in the memory 220 in advance. When it is determined whether the application is a registered text information transmission / reception application, it plays a role of determining activation or deactivation of the extraction unit 240 function of extracting text information.

That is, the determination unit 225 is a condition desired by the user in order to solve the problem (such as a problem that is automatically converted to the voice output in the public office) by converting the received text information to the voice information each time the text information is received In order to perform the role of converting the text information received only in the environment (such as the vehicle driving environment) into the voice information, after checking whether the wireless terminal 100 is located in the vehicle, the function of the extraction unit 240 It will be decided to activate or deactivate the.

The control unit according to the present invention controls to activate or deactivate the function of the extraction unit 240 according to the determination result of the determination unit 225.

The communication unit 230 according to the present invention serves to receive various text information received by the wireless terminal 100 and to transmit various text information from the wireless terminal 100.

After the extraction unit 240 according to an embodiment of the present invention is activated by the control unit, text information is received through the communication unit 230 to the first to Nth applications for transmitting and receiving text information, and the confirmation unit When it is determined whether the wireless terminal 100 is located in the vehicle through 235, it extracts the text information received by the text information transmission / reception application or receives the text information through the text transmission / reception application. do.

In addition, the extraction unit 240 is connected to the application for transmitting and receiving the text information on the memory 220, when there is previously stored and registered item information, the character information corresponding to the item information of the received text information (For example, sender information or e-mail subject information, etc.) may be extracted or received through the application for transmitting and receiving text information.

The conversion unit 245 according to the present invention serves to convert the text information extracted or received through the extraction unit 240 into voice information.

In addition, the conversion unit 245 performs a role of converting the input voice information into text information when voice information corresponding to the reply of the user is input through a microphone provided in the wireless terminal 100 in a subsequent process. do.

According to the present invention, although the configuration of the conversion unit 245 is shown as a single configuration on the drawing, the conversion unit 245 (1) and the voice information to convert the text information to the voice information according to the method of the skilled person and the text information It may be configured by dividing into a conversion unit (245) (2) to convert to.

According to the present invention, the conversion unit 245 is '^^', '~~', ');' In the case of a character that includes emotions expressed through various special characters, such as 'haha', which is voice information corresponding to the emotion, the character may be converted to 'haha'. When it is converted into character information, it can be converted into '^^', which is an emotional expression containing a special character.

Of course, the conversion unit 245 may change the size of the converted character according to the size of the voice when converting the emotional expression containing such a special character to the voice or text, the size of the voice according to the size of the received text Can be different.

Text to Speech (TTS) function for converting text information, which is the main function of the conversion unit 245, according to the present invention, and STT (Speech to Text) function for converting voice information to text information, are the same as those of the conventional TTS engine. The functions of the STT engine or the functions of the TTS engine and the STT engine that can be developed in the future may be used, and detailed descriptions thereof will be omitted since they are not the main idea of the present invention.

The processing unit 250 according to the present invention performs a function of outputting the voice information converted through the conversion unit 245 through a speaker provided in the wireless terminal 100.

In addition, the processing unit 250, if the voice information corresponding to the user's reply is input through the microphone provided in the wireless terminal 100, and the voice information input through the conversion unit 245 is converted into text information The mobile terminal further performs a process of transmitting the converted text information to the text information transmission / reception terminal 120.

The output unit 255 and the input unit 260 according to the present invention serve to process the output of the voice information and the input of the voice information of the user, respectively.

According to the present invention, all or part of the functions of the respective components provided in the wireless terminal 100 may be implemented in the form of an application which is a kind of program provided in the wireless terminal 100.

In this case, the application may include a function of providing an interface for selecting at least one of the first to Nth (N = 2,3..N) applications for transmitting and receiving text information provided in the wireless terminal 100, A function of storing and registering information on at least one character information transmitting / receiving application selected by the user of the wireless terminal 100 through the interface on the memory 220, and checking whether the wireless terminal 100 is located in the vehicle; A function for determining activation or deactivation of the extraction function of the character information received through the character information transmission / reception application previously stored and registered in the memory 220 in response to the confirmation result, and the first to Nth applications for transmission and reception of the character information; When the text information is received in response to the determination result, the text information transmission and reception application for receiving the text information is stored in the memory (2). 20) if the application for transmitting and receiving text information registered and stored in the memory 220, the text information received by the application for transmitting and receiving text information registered and stored in the memory 220 or received through the application for transmitting and receiving text information A function for converting the extracted or received text information into voice information, a function for processing the converted voice information to be output through a speaker provided in the wireless terminal 100, and the wireless terminal 100 Executes at least one of a function of receiving voice information of a user, converting the input voice information into text information, and processing the converted text information to be transmitted through the text information transmission / reception application; .

Hereinafter, each information processing process according to the present invention will be described in more detail.

4 is a diagram illustrating a process of converting text information into voice information and outputting the text information after confirming whether the wireless terminal 100 is located in a vehicle according to an exemplary embodiment of the present invention.

First, the wireless terminal 100 checks whether the wireless terminal 100 is located in the vehicle (S410).

When it is determined whether the wireless terminal 100 is located in the vehicle through the process (S410) (S420), the wireless terminal 100 corresponds to all or some item information received from the wireless terminal 100. The item is converted into voice information (S430).

If it is not determined whether the wireless terminal 100 is located in the vehicle through the process (S410) (S440), the wireless terminal 100 outputs the text information received by the wireless terminal 100 on the screen. do.

Thereafter, the wireless terminal 100 outputs the voice information converted through the process (S430) through a speaker provided in the wireless terminal 100 (S450).

5 is a diagram illustrating a process of confirming whether a wireless terminal 100 is located in a vehicle according to an exemplary embodiment of the present invention.

That is, Figure 5 is described in more detail with respect to the process (S410) of Figure 4, a method using a GPS and a timer provided in the wireless terminal 100, the GPS provided in the wireless terminal 100 and mounted in the vehicle The method of using the GPS provided in the communication device and the method of using the motion sensor and the timer provided in the wireless terminal 100 are mainly used to determine whether the wireless terminal 100 is located in the vehicle.

First, in the case of using the GPS and the timer provided in the wireless terminal 100, the wireless terminal 100 calculates the position moving distance of the wireless terminal 100 per hour using the GPS and the timer (S510).

Thereafter, the wireless terminal 100 compares the position moving distance of the wireless terminal 100 per hour calculated through the process (S510) with a preset value (for example, 20 km / h or more, which is a moving speed of the vehicle) ( S515), when the result of the comparison indicates that the calculated positional movement distance of the wireless terminal 100 exceeds the preset value (S520), the confirmation unit of the wireless terminal 100 is located in the vehicle. Confirm that (S525).

In the second method, the GPS provided in the wireless terminal 100 and the GPS provided in the communication device mounted in the vehicle, the wireless terminal 100 communicates with the GPS provided in the wireless terminal 100 and the vehicle mounted in the vehicle. Check the location information of the wireless terminal 100 and the vehicle through the GPS provided in the device (S530).

Here, the wireless terminal 100 may receive location information by GPS from a communication device mounted in a vehicle through short range communication.

The wireless terminal 100 compares the location information of the vehicle with the wireless terminal 100 confirmed through the step (S530) (S535), and as a result of the comparison, when the position of the wireless terminal 100 and the vehicle are the same or adjacent ( S540, the confirmation unit of the wireless terminal 100 confirms that the wireless terminal 100 is located in the vehicle (S545).

In the third method, which uses a motion sensor and a timer provided in the wireless terminal 100, the wireless terminal 100 uses a motion sensor and a timer provided in the wireless terminal 100 to move the movement time of the wireless terminal 100. The information (that is, time information for stopping and moving and / or time information for moving and stopping) is checked (S550).

The wireless terminal 100 compares the movement time information of the wireless terminal 100 confirmed through the step S550 with preset time information (S555), and as a result of the comparison, the movement time of the wireless terminal 100 is preset. If less than the time (S560), the confirmation unit of the wireless terminal 100 confirms that the wireless terminal 100 is located in the vehicle (S565).

6 is a diagram illustrating a process of selecting and registering a voice information conversion target application and item information among a plurality of text information transmission and reception applications according to an embodiment of the present invention.

First, in response to a user request, the user wireless terminal 100 may transmit a first application to Nth (N = 2,3) for text information transmission / reception provided in the wireless terminal 100 through a specific application or the interface unit 210. .N) Output an interface for selecting one or more of the applications on the screen (S610).

Of course, in operation S610, the interface screen may output an interface for selecting item information to be output by converting it into voice among text information received through an application selected outside of application selection through a single screen.

When the user selects an application in operation S610, the user may determine whether item information to be output is converted or output from text information received by the selected application to be further selected or input (S630).

If the user does not select an application in step S610, the interface screen ends and waits for a restart (S640).

In operation S630, when the user further selects or inputs item information to be converted and output from text information received by the selected application (S650), the wireless terminal 100 may use a specific application or registration unit 215. The information of the application for transmitting / receiving the selected character information through the interface and the item information corresponding to each application are connected and stored and registered in the memory 220 (S660).

If the separate item information is not selected or input in step S630 (S670), the wireless terminal 100 transmits the information of the text information transmitting / receiving application selected through the interface through a specific application or the registration unit 215. Is stored on the memory 220 and registered (S680).

The process (S680) may correspond to a case in which item information is previously set as a default in advance or when all text information received without separate item classification is converted into voice information.

7 is a diagram illustrating a process of extracting text information corresponding to pre-registered application information according to an embodiment of the present invention.

First, the wireless terminal 100 checks whether the wireless terminal 100 is located in the vehicle through the identification unit 235 (S710).

In operation S710, when it is determined that the wireless terminal 100 is located in a vehicle (S720), the application or control unit of the wireless terminal 100 is previously stored in the memory 220 for transmitting and receiving text information. Activate the extraction function of the text information received through the application (S730).

If, in the process (S710), it is not confirmed that the wireless terminal 100 is located in the vehicle (S740), extraction of the character information received through the application for transmitting and receiving the character information previously stored in the memory 220 Keep the function disabled.

Thereafter, the wireless terminal 100 receives various text information through the communication unit 230 (S750).

Thereafter, the wireless terminal 100 checks whether a specific application or an application that receives the text information through the identification unit 235 is an application for transmitting and receiving text information that is previously stored and registered in the memory 220 (S760).

If the application that receives the text information is an application for transmitting / receiving registered text information in the memory 220 (S770), the wireless terminal 100 may be a specific application or extraction (S760). Character information received and received by the character information transmission / reception application previously stored and registered in the memory 220 through the unit 240 is received or received through the character information transmission / reception application (S780).

If, as a result of the confirmation through the step (S760), if the application for receiving the text information is not stored in the memory 220, the application for transmitting and receiving the registered text information (S790), the process waits before the process (S750) do.

8 is a diagram illustrating a process of converting text information corresponding to pre-registered application and item information into voice information according to an embodiment of the present invention and outputting the voice information.

First, the wireless terminal 100 checks the item information connected to the application information for transmitting and receiving the character information previously stored and registered in the memory 220 by the application that receives the character information through the memory 220 (S810). ).

The process (S810) proceeds after extracting or receiving the entire text information through the process (S780), or before the process (S780) according to another embodiment of the person skilled in the art, the process in the (S780) Only text information corresponding to the item information identified through the process S810 may be selected and extracted or delivered.

If item information exists in step S810 (S820), the wireless terminal 100 converts only text information of an item corresponding to item information from the text information into voice information through a specific application or conversion unit 245. The conversion process (S830).

If item information does not exist in step S810, the wireless terminal 100 converts the entire text information into voice information through a specific application or conversion unit 245 (S850). .

Although not shown separately on the drawing, the specific application or converter 245 of the wireless terminal 100 is '^^', '~~', ');' In the case of a character containing emotions expressed through various special characters, such as 'ha ha', which is voice information corresponding to the emotions, the character may be converted. The size of the voice may vary depending on the size of the voice.

Thereafter, the wireless terminal 100 processes the converted audio information through a specific application or processing unit 250 to be output through a speaker provided in the wireless terminal 100 (S860).

9 is a diagram illustrating a process of converting a user's reply voice information into text information and transmitting the same according to an embodiment of the present invention.

9 illustrates a process for a case in which the user of the wireless terminal 100 sends a reply to the text information transmitting / receiving terminal 120 that has transmitted the text information that is the other party after the output of the voice information.

First, the wireless terminal 100 receives voice information corresponding to the reply of the user through a microphone provided in the wireless terminal 100 through a specific application or the input unit 260 (S910).

Thereafter, the wireless terminal 100 converts the input voice information into text information through a specific application or conversion unit 245 (S920).

Of course, when the conversion unit 245 includes 'haha' corresponding to the onomatopoeic word among the input voice information, the emotion is converted into a special character '^^' or the like when converting the onomatopoeia speech information into text information. The converted character information may be converted and the size of the converted character may be changed according to the size of the voice which is an onomatopoeia.

Thereafter, the wireless terminal 100 confirms an application for transmitting / receiving the text information to transmit the converted text information through a specific application or the processing unit 250, and transmits the converted text information to the confirmed text information transmitting / receiving application or the The text information transmission and reception application is controlled to process the converted text information to be transmitted to the text information transmission and reception terminal 120 (S930).

Here, the text information transmission and reception application for transmitting the converted text information may be a text information transmission and reception application for receiving text information transmitted to the user wireless terminal 100 before the user's reply.

10 is an embodiment diagram according to an embodiment of the present invention.

As shown in FIG. 10, when a friend named 'Young-seok' transmits text information through a smartphone, the wireless terminal 100 of the user driving the vehicle converts the text information into voice information and outputs it through its own speaker. The user's wireless terminal 100 converts the reply voice information into text information and transmits it to the friend's smartphone called 'Young-seok'.

100: user wireless terminal 110: text information relay server
120: text information transmission and reception terminal
200: control unit 210: interface unit
215: Register 220: Memory
225: judgment unit 230: communication unit
235 verification unit 240 extraction unit
245 conversion unit 250 processing unit
255: output unit 260: input unit

Claims (14)

In a wireless terminal,
A confirmation unit for confirming whether the wireless terminal is located in the vehicle;
As a result of the confirmation of the confirmation unit, when the wireless terminal is located in the vehicle, the conversion unit for converting the text information received through one of the application of the first to N-th application for text information transmission and reception provided in the wireless terminal into voice information (One);
A processing unit for processing the converted voice information to be output through a speaker provided in the wireless terminal;
An input unit for receiving voice information of a wireless terminal user;
And a conversion unit 2 for converting the input voice information into text information.
Wherein,
Processing the converted text information to be transmitted through the text information transmission / reception application;
Wireless terminal.
The method of claim 1, wherein the verification unit,
When the text information is received through one of the first to N-th application for the text information transmission and reception,
Wireless terminal.
The method of claim 1, wherein the verification unit,
The position movement distance of the wireless terminal per hour is calculated by using a GPS and a timer provided in the radio terminal, and the case where the calculated position movement distance of the wireless terminal per hour is greater than or equal to a predetermined value is obtained in the vehicle. Check with your location, or
After comparing the location information of the wireless terminal using the GPS provided in the wireless terminal with the location information of the communication device using the GPS of the communication device provided in the vehicle, the case where the wireless terminal and the communication device is located at an adjacent distance Confirming that the wireless terminal is located in a vehicle, or
The position of the wireless terminal in the vehicle is when the time information of at least one of the time at which the movement of the wireless terminal stops and the time when the movement of the wireless terminal stops and then moves again through the one or more motion sensors and a timer provided in the wireless terminal is less than a preset time. I confirm it when I do it,
Wireless terminal.
The method of claim 1,
An interface unit for providing an interface for selecting at least one of first to Nth applications (N = 2,3..N) applications for transmitting and receiving text information provided in a wireless terminal;
A registration unit for storing and registering information on at least one character information transmitting / receiving application selected by a wireless terminal user through the interface unit in a memory;
When text information is received by the first to Nth applications for text information transmission and reception, if the text information transmission and reception application that receives the text information is previously stored in the memory and registered application for text information transmission and reception, the text information is stored in the memory. Further comprising: an extractor for storing and extracting the text information received by the application for transmitting and receiving text information registered or transmitted through the text information transmitting and receiving application,
Wireless terminal.
5. The method of claim 4,
The interface unit includes:
Further selecting or selecting item information to be converted into voice information among text information received by a selected application other than one or more application selection functions among the first to Nth applications for transmitting / receiving text information or N (N = 2,3..N) applications; Characterized in that the input,
Wherein the registration unit comprises:
And storing and registering the item information selected or input through the interface with application information for transmitting and receiving the selected text information in a memory.
The extracting unit extracts,
After checking the item information connected to the application information for transmitting and receiving the character information on the memory, and extracts or receives only the character information corresponding to the item information from the character information,
The item information,
If the application is a message transmission and reception application including one or more Short Message Service (SMS), Long Message Service (LMS), Multimedia Message Services (MMS), includes at least one item information of the message sender information and the message content information,
When the application is an e-mail transmission and reception application, and includes one or more item information of the email sender information, email subject information and email body content information,
When the application is an instant messenger application, the application includes one or more item information of messenger user information and messenger content information.
Wireless terminal.
The method of claim 1, wherein the conversion unit 1 and the conversion unit 2,
Characterized in that the same configuration or separate configuration,
Wireless terminal.
According to claim 1, The text information transmission and reception application,
Message sending and receiving applications including one or more short message service (SMS), long message service (LMS), multimedia message services (MMS),
Email sending and receiving applications,
Instant messenger applications,
Containing one or more Social Networking Service (SNS) applications,
Wireless terminal.
The method of claim 1, wherein the text information,
When the application is a message transmission and reception application including one or more Short Message Service (SMS), Long Message Service (LMS), Multimedia Message Services (MMS), and includes one or more message sender information and message content information,
When the application is an e-mail transmission and reception application, the application includes one or more email sender information, email subject information, and email body content information.
When the application is an instant messenger application, the application includes one or more messenger user information and messenger content information.
Wireless terminal.
In the information processing method in a wireless terminal,
Confirming whether the wireless terminal is located in the vehicle;
When the wireless terminal is located in the vehicle as a result of the confirmation through the checking, converting the text information received through one of the first to N-th application for text information transmission and reception provided in the wireless terminal into voice information Voice information conversion step;
A voice information processing step of processing the converted voice information to be output through a speaker provided in the wireless terminal;
An input step of receiving voice information of a wireless terminal user;
A text information converting step of converting the input voice information into text information;
And a text information processing step of processing the converted text information to be transmitted through the text information transmission and reception application.
Information processing method in a wireless terminal.
The method of claim 9, wherein the checking step,
Confirming whether text information is received through one of the first to N-th applications for transmitting and receiving the text information;
In response to the first confirmation result, to confirm whether the radio terminal is located in the vehicle,
Information processing method in a wireless terminal.
The method of claim 9, wherein the checking step,
The position movement distance of the wireless terminal per hour is calculated by using a GPS and a timer provided in the radio terminal, and the case where the calculated position movement distance of the wireless terminal per hour is greater than or equal to a predetermined value is obtained in the vehicle. Check with your location, or
After comparing the location information of the wireless terminal using the GPS provided in the wireless terminal with the location information of the communication device using the GPS of the communication device provided in the vehicle, the case where the wireless terminal and the communication device is located at an adjacent distance Confirming that the wireless terminal is located in a vehicle, or
The position of the wireless terminal in the vehicle is when the time information of at least one of the time at which the movement of the wireless terminal stops and the time when the movement of the wireless terminal stops and then moves again through the one or more motion sensors and a timer provided in the wireless terminal is less than a preset time. I confirm it when I do it,
Information processing method in a wireless terminal.
The method of claim 9,
An interface providing step of providing an interface for selecting at least one of the first to Nth applications (N = 2,3..N) applications for transmitting and receiving text information provided in the wireless terminal;
A registration step of storing and registering information on at least one character information transmitting / receiving application selected by a wireless terminal user through a memory in a memory;
When text information is received by the first to Nth applications for text information transmission and reception, if the text information transmission and reception application that receives the text information is previously stored in the memory and registered application for text information transmission and reception, the text information is stored in the memory. Extracting the text information received by the application for transmitting and receiving text information stored, registered or received through the text information transmission and reception application; further comprising:
Information processing method in a wireless terminal.
13. The method of claim 12,
The interface providing step,
Further selecting or inputting item information to be converted into voice information among text information received by the selected application other than the selection of one or more applications among the first to Nth (N = 2,3..N) applications for transmitting and receiving the text information Characterized in receiving,
The registration step,
And storing and registering the item information selected or input through the interface with application information for transmitting and receiving the selected text information in a memory.
Wherein the extracting step comprises:
After checking the item information connected to the application information for transmitting and receiving the character information on the memory, characterized in that only the character information corresponding to the item information of the character information to extract or receive,
Information processing method in a wireless terminal.
A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 9 to 13.

Images