KR20150093024A - Mobile terminal and operation method thereof - Google Patents

Abstract

The present invention relates to an operation method of a mobile terminal including: a step of entering a text to speech (TTS) mode; a step of displaying voice output possible content in the TTS mode; a step of determining whether or not there is an area with a highlight displayed on the content; and a step of distinguishing between the area with the highlight displayed and an area where the highlight is not displayed to output the areas with distinguishing voices from each other.

Description

[0001] MOBILE TERMINAL AND OPERATION METHOD THEREOF [0002]

The present invention relates to a mobile terminal and a method of operating the same, and more particularly, to a mobile terminal for outputting a highlighted area in a text to speech (TTS) mode and a non-highlighted area in a distinctive voice and an operation method thereof will be.

A mobile terminal is a portable device having one or more functions capable of carrying out voice and video communication, capable of inputting and outputting information, and storing data, while being portable. As the function of the mobile terminal is diversified, the mobile terminal has complicated functions such as photographing and photographing of a moving picture, playback of a music file or a moving picture file, reception of a game, broadcasting, wireless Internet, etc., and a comprehensive multimedia device .

In order to implement complex functions, mobile terminals implemented in the form of multimedia devices are being applied variously in terms of hardware and software. For example, there is a user interface environment in which a user can easily and conveniently search for or select a function.

One example of such a user interface environment is TTS (Text to Speech). The TTS converts the contents including the text into a voice and outputs the voice to the user by voice, even if the user does not read out the contents directly. This TTS function can be useful in e-books.

However, in using the TTS function, when the contents are read with a certain voice, the concentration of the user may be reduced or drowsiness may be caused. Therefore, there is a need for a method of emphasizing and outputting an important part in the case of outputting a content including a text by voice using the TTS function.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal that outputs a highlighted area and a non-highlighted area in a distinct voice in a text to speech (TTS) mode.

According to another aspect of the present invention, there is provided a method of operating a mobile terminal, the method comprising: entering a text to speech (TTS) mode; displaying content capable of audio output in the TTS mode; Determining whether a highlighted region is displayed, and outputting the highlighted region as a distinctive region by distinguishing the highlighted region from the highlighted region.

The effect of the operation method of the mobile terminal according to at least one embodiment of the present invention constructed as above is as follows.

First, there is an effect of reducing eye fatigue which occurs when a user reads a content including a text for a long time by using the mobile terminal.

Secondly, there is an effect that the concentration of the user can be increased by outputting the emphasized portion and the not-emphasized portion separately from the content including the text.

Third, there is an advantage that the user can set the area to be emphasized directly by the user, and thus the user can use it effectively for learning.

Fourth, since the area to be emphasized in the automatic mode can be automatically set, user convenience is increased.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description of the claims.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
4 is a flowchart illustrating an operation of the mobile terminal according to the first embodiment of the present invention.
5 is a flowchart illustrating an operation of the mobile terminal according to the second embodiment of the present invention.
6 is a flowchart illustrating an operation of the mobile terminal according to the third embodiment of the present invention.
7 is a flowchart illustrating an operation of the mobile terminal according to the fourth embodiment of the present invention.
8 is a diagram for describing an operation of accessing a content providing server or a search server using a mobile communication network according to an embodiment of the present invention.
Figure 9 is an exemplary diagram that is referenced to illustrate the operation of entering the TTS mode, in accordance with an embodiment of the present invention.
10 is an exemplary diagram referred to explain the voice output operation of the highlighted contents according to the first embodiment of the present invention.
11 is a diagram referred to explain an operation of entering a memo mode and highlighting according to a second embodiment of the present invention.
12 is an exemplary diagram referred to explain voice output operation of highlighted contents according to the second embodiment of the present invention.
13 is an exemplary diagram referred to explain an operation of acquiring an image including a highlight display through a camera according to the third embodiment of the present invention.
Fig. 14 is an exemplary diagram for explaining a voice output operation of a highlighted content according to a third embodiment of the present invention; Fig.
Fig. 15 is an exemplary diagram referred to explain an operation of entering the automatic mode according to the fourth embodiment of the present invention. Fig.
FIG. 16 is an exemplary diagram referred to explain voice output operation of highlighted contents according to the fourth embodiment of the present invention. FIG.
17 is an exemplary diagram referred to explain the highlight portion automatic search operation in the TTS mode, according to an embodiment of the present invention.
18 is a diagram referred to explain a voice output control operation according to a touch input of a user in a TTS mode according to an embodiment of the present invention.
19 is a diagram referred to explain voice output operation in a TTS mode for a visually impaired person, according to an embodiment of the present invention.
20 and 21 are exemplary diagrams referred to in describing the TTS mode setting operation according to an embodiment of the present invention.
22 is an exemplary diagram for explaining an operation of outputting in a different language according to whether or not a highlight is displayed according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

Examples of the mobile terminal described in the present specification include a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a camera, tablet computers, e-book terminals, and the like. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 1, a mobile terminal according to an exemplary embodiment of the present invention will be described in terms of functional components.

1, a mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface 170, a controller 180, and a power supply 190. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast-related information, and a server for receiving at least one of the generated broadcast signal and broadcast-related information and transmitting the broadcast-related information to the terminal.

The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 113. Broadcast-related information can exist in various forms.

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 115 is a module for wireless Internet access, and the wireless Internet module 115 can be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and Near Field Communication (NFC) may be used as the short distance communication technology.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

An A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone (not shown). The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

A microphone (not shown) receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 when the voice data is in the call mode, and output. The microphone (not shown) may be used with various noise reduction algorithms to remove noise generated in receiving an external sound signal.

The user input unit 130 generates key input data that the user inputs to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, and a touch pad (static / static) capable of receiving commands or information by a user's pressing or touching operation. The user input unit 130 may be a jog wheel for rotating the key, a jog type or a joystick, or a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, Thereby generating a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is coupled to an external device, and the like can be handled.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The proximity sensor 141 can detect an object approaching the mobile terminal 100 or the presence or absence of an object in the vicinity of the mobile terminal 100 without mechanical contact. The proximity sensor 141 can detect a nearby object by using a change in the alternating magnetic field or a change in the static magnetic field, or a rate of change in capacitance. The proximity sensor 141 may be equipped with two or more sensors according to the configuration.

The pressure sensor 143 can detect whether or not pressure is applied to the mobile terminal 100, the magnitude of the pressure, and the like. The pressure sensor 143 may be installed at a portion where the pressure of the mobile terminal 100 is required according to the use environment. When the pressure sensor 143 is installed on the display unit 151, the touch input through the display unit 151 and the pressure applied by the touch input The pressure touch input can be identified. Also, the magnitude of the pressure applied to the display unit 151 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 143. [

The motion sensor 145 senses the position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology.

The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various kinds. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 may be an input device capable of inputting information by a user's touch in addition to the output device Can also be used.

If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel that is attached to the outside, and can be connected to the internal bus of the mobile terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be formed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is maintained even after the power is shut off, and the battery life of the mobile terminal 100 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three- (3D display). In addition, there may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, In addition, the sound output module 153 outputs sound signals related to functions performed in the mobile terminal 100, for example, call signal reception tones, message reception tones, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. Also, when the key signal is inputted, the alarm unit 155 can output the signal as the feedback to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 155. A signal for notifying the occurrence of an event in the mobile terminal 100 may also be output through the display unit 151 or the sound output module 153. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be provided with a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, The effect of stimulation through contact of the electrode (eletrode), the effect of stimulation by the electrostatic force, and the effect of reproducing the cool / warm using the device capable of endothermic or exothermic can be generated. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. The haptic module 157 may include two or more haptic modules 157 according to the configuration of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the mobile terminal 100 may operate a web storage for storing the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. Examples of the external device connected to the mobile terminal 100 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 170 may receive data from the external device or supply power to the respective components in the mobile terminal 100 and may transmit data in the mobile terminal 100 to the external device .

The interface unit 170 may be a path through which the power from the cradle connected to the mobile terminal 100 is connected to the cradle when the mobile terminal 100 is connected to the cradle, And may be a passage to be transmitted to the terminal 100.

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or separately from software in the controller 180. [

The control unit 180 may include a TTS module 182. The TTS module 182 judges whether or not text that can be converted into speech is included in a predetermined content. If the content includes text that can be converted into speech, the TTS module 182 controls the text to be converted into speech and output.

The TTS module 182 may include a TTS conversion module (not shown) and a TTS region extraction module (not shown). The TTS conversion module (not shown) and the TTS region extraction module (not shown) may be implemented by software or hardware or a combination of software and hardware. For example, the TTS conversion module may be stored in a storage unit, RTI ID = 0.0 > 182 < / RTI >

The TTS region extraction module (not shown) determines whether one or more contents displayed on the screen include text convertible to speech. The TTS conversion module (not shown) converts the text to speech when the content includes text convertible to speech.

Here, a module refers to a hardware component such as software or a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC), and the module performs certain roles. However, a module is not limited to software or hardware. The module may be configured to reside on an addressable storage medium and configured to execute one or more processors. Thus, by way of example, a module may include components such as software components, object-oriented software components, class components and task components, and processes, functions, attributes, procedures, Microcode, circuitry, data, databases, data structures, tables, arrays, and variables, as will be appreciated by those skilled in the art. The functionality provided by the components and modules may be combined into a smaller number of components and modules or further separated into additional components and modules.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The mobile terminal 100 having such a configuration can be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

FIG. 2 is a perspective view of a mobile terminal 100 according to an embodiment of the present invention, and FIG. 3 is a rear perspective view of the mobile terminal 100 shown in FIG. Hereinafter, the mobile terminal 100 related to the present invention will be described with reference to FIGS. 2 and 3 in terms of components according to the external form. Hereinafter, for convenience of description, a bar type mobile terminal having a front touch screen among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, etc. will be described as an example. However, the present invention is not limited to the bar-type mobile terminal but can be applied to all types of mobile terminals including the above-mentioned types.

Referring to FIG. 2, the case constituting the appearance of the mobile terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components are incorporated in the space formed by the front case 100-1 and the rear case 100-2.

The display unit 151, the first sound output module 153a, the first camera 121a, and the first through third user input units 130a, 130b, and 130c are connected to the main body, specifically, the front case 100-1 . A fourth user input unit 130d and a microphone (not shown) may be disposed on the side surface of the rear case 100-2.

The display unit 151 may be constructed such that the touch pad is overlapped with the layer structure so that the display unit 151 operates as a touch screen so that information can be input by a user's touch.

The first acoustic output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be implemented in a form suitable for capturing an image or a moving image of a user. The microphone (not shown) may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The first to fifth user input units 130a, 130b, 130c, 130d, and 130e may be collectively referred to as a user input unit 130. In any tactile manner in which the user operates with a tactile impression, .

For example, the user input unit 130 may be embodied as a dome switch or a touch pad capable of receiving a command or information by a user's pressing or touching operation, or may be a wheel, jog system, Or the like.

In a functional aspect, the first user input unit 130a is a menu key for inputting a command for calling a menu related to an application currently being executed, and the second user input unit 130b is a home key, The third user input unit 130c is for inputting a command for canceling the currently executing application as a back key. Also, the fourth user input unit 130d may operate as a hot-key for activating a special function in the mobile terminal 100. [

3, a second camera 121b may be further mounted on a rear surface of the rear case 100-2, and a fifth user input unit 130e may be disposed on a side surface of the rear case 100-2 .

The second camera 121b has a photographing direction substantially opposite to that of the first camera 121a, and may have pixels different from those of the first camera 121a. A flash (not shown) and a mirror (not shown) may be additionally disposed adjacent to the second camera 121b. In addition, another camera may be installed adjacent to the second camera 121b to use it for shooting a three-dimensional stereoscopic image.

The flash illuminates the subject when the subject is photographed by the second camera 121b. The mirror enables the user to illuminate the user's own face or the like when the user intends to photograph (self-photograph) himself / herself using the second camera 121b.

A second sound output module (not shown) may be further disposed in the rear case 100-2. The second sound output module may implement the stereo function together with the first sound output module 153a, and may be used for talking in the speakerphone mode.

The interface unit 170 can be used as a path for exchanging data with an external device. In addition, in one area of the front case 100-1 and the rear case 100-2, an antenna (not shown) for reception of a discharge call can be arranged in addition to an antenna for communication. The antenna may be installed to be capable of being drawn out from the rear case 100-2.

A power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the rear case 100-2. The power supply unit 190 may be a rechargeable battery, for example, and may be detachably coupled to the rear case 100-2 for charging or the like.

On the other hand, in the present embodiment, the second camera 121b and the like are disposed in the rear case 100-2, but the present invention is not limited thereto. Also, the first camera 121a may be rotatably formed so that the second camera 121b can be photographed up to the photographing direction, even if the second camera 121b is not separately provided.

In the foregoing, the configuration of the mobile terminal 100 according to the present invention has been described with reference to FIG. 1 to FIG. Hereinafter, a mobile terminal for outputting a highlighted area in a text to speech (TTS) mode and a non-highlighted area in a distinctive voice according to an embodiment of the present invention will be described.

Hereinafter, the present invention will be described on the assumption that the display unit 151 is a touch screen, since the present invention can be implemented more easily when the display unit 151 is configured as a touch screen.

In addition, the following embodiments can be applied to the mobile terminal 100 using the Android-based OS. However, it goes without saying that the following embodiments are not limited to a mobile terminal using an OS of the Android series, but may be applied to a mobile terminal using another series of OSs.

Throughout the specification, the term "object" Icons, widgets, links, pictures, text, index entries, etc. are examples of objects. A page refers to a space containing content, information, or objects. For example, a web page, a content list, a thumbnail list, a tray on which pictures are arranged, a tray on which icons are arranged, and the like are examples of pages.

The 'icon' should be set to be displayed on the display unit screen in order to facilitate the function of the mobile terminal frequently used by the user, and the displayed position may be arbitrarily designated. To perform a specific function set on the icon, the active application must be changed on the display.

On the other hand, 'Widget' is a graphical interface that supports smooth interaction with user, application / operating system and so on. It allows users to directly access desired services on the idle screen of the terminal without visiting portal service or content providing site So that it can be used. For example, it is used to receive and receive information such as weather information, traffic information, MSN messenger, security, keyword search window, and the like from the state of the mobile terminal such as the memory space of the mobile terminal,

In the present specification, the names of the components are denoted by the first, second, and so on in order to distinguish the names of the components from each other in the same relationship, and are not necessarily limited to the order in the following description.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

In the present specification, the names of the components are denoted by the first, second, and so on in order to distinguish the names of the components from each other in the same relationship, and are not necessarily limited to the order in the following description.

4 is a flowchart illustrating an operation of the mobile terminal according to the first embodiment of the present invention.

Referring to FIG. 4, the controller 180 enters a text to speech (TTS) mode in response to a user input (S450). Here, the TTS mode means a mode in which text included in the content is output by voice. For example, an e-book application may be executed to enter a TTS mode, an Internet browsing application may be executed, a TTS mode may be entered, a memo application may be executed, and a TTS mode may be entered.

In the state where the TTS mode is entered, the control unit 180 displays predetermined contents (S460). Here, the contents may be electronic books, Internet articles, documents, memos, and the like. In addition, the content may be an image including predetermined text. A description of the case where the content is an image will be described with reference to Fig.

In the present embodiment, the predetermined content is displayed (S460) after entering the TTS mode (S450). However, the present invention is not limited to this, and the TTS mode may be entered after displaying predetermined content.

In a state where predetermined contents are displayed, the controller 180 receives a user input for a TTS operation (S470). The user input for the TTS operation may be performed through the user input unit 130 or by touching a predetermined object displayed on the display unit 151. [

When a user input for the TTS operation is received, the controller 180 extracts the text included in the content (S475). The operation of extracting the text from the contents can be done through the TTS module 182. [

Meanwhile, according to the embodiment, the control unit 180 may detect the language of the text of the extracted content.

If a user input for the TTS operation is received, the controller 180 determines whether there is a region highlighted in the content (S480). Here, the highlight display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. For example, highlights include differences in text size, presence or absence of quotation marks, presence of underscores, existence of highlight color covering the text, differences in fonts of text, differences in text color, Can be displayed in any one of them.

For example, if the size of the text contained in the content is 10 points and the size of one part of the text is 12 points, the text displayed at the size of 12 points is a highlighted area.

As another example, when quoting a part of the text contained in the content, the quoted text is a highlighted area.

As another example, if a portion of the text contained in the content is underlined, the underlined text is a highlighted area.

As another example, when an emphasis color covering the text is displayed on a part of the text included in the content, the highlighted area covering the text is a highlighted area.

As another example, if the text contained in the content is a base and only a part of the text is Gothic, the text displayed in Gothic is a highlighted area.

As another example, if the text contained in the content is displayed in black and only a portion of the text is displayed in red, the text displayed in red is the highlighted area.

In another example, if the text contained in the content is displayed in a general size and only a part of the text is displayed in bold text, the text in bold is the highlighted area.

On the other hand, the type of such highlight display can be set by user input, and a description thereof will be described with reference to FIG.

If there is a region highlighted in the content, the control unit 180 converts the highlighted region into a differentiated speech region (S490). At this time, the text-to-speech conversion may be performed through the TTS module 182.

In this case, the control unit 180 distinguishes between highlighted areas and non-highlighted areas and outputs them separately according to the size of the voice, the speaking speed of the voice, the type of the voice, the language of the voice, do. At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

For example, the control unit 180 can output a highlighted area in a larger voice than an area in which no highlight is displayed. Alternatively, the control unit 180 can output a highlighted area in a smaller voice than an area in which no highlight is displayed.

As another example, the control unit 180 can output the highlighted area at a faster speaking rate than the area where the highlight is not displayed. Alternatively, the control unit 180 may output the area in which the highlight is displayed so as to be slower than the area in which the highlight is not displayed.

As another example, the control unit 180 may output a highlighted area to a male voice and a non-highlighted area to a female voice. In addition, a highlighted area can be output to a woman's voice, and a highlighted area can be output to a male voice.

As another example, the control unit 180 can output the area in which the highlight is displayed and the area in which the highlight is not displayed in another language. That is, the controller 180 detects the language of the text of the extracted content in step S475. The control unit 180 outputs the area in which the highlight is not displayed in the detected language and the area in which the highlight is displayed in the language different from the detected language. For example, when the detected language is Korean, an area in which no highlight is displayed can be output in Korean, and an area in which no highlight is displayed can be output in a foreign language.

The operation of outputting in a different language depending on whether a highlight is displayed or not will be described in detail with reference to FIG.

As another example, the control unit 180 can repeatedly output the highlighted area by a preset number of times.

On the other hand, the output of the voice distinguished according to the presence / absence of the highlight display can be set by user input, and a description thereof will be described with reference to Fig.

If there is no area highlighted in the content, the control unit 180 outputs the general voice (S495). That is, the control unit 180 converts the predetermined area into a predetermined voice without emphasizing the predetermined area and outputs the voice. At this time, the text-to-speech conversion may be performed through the TTS module 182.

5 is a flowchart illustrating an operation of the mobile terminal according to the second embodiment of the present invention.

Referring to FIG. 5, the controller 180 displays a first operation screen (S510). Here, the first operation screen includes a home screen displayed on the display unit 151, a standby screen, or an image screen on which an operation screen is captured. Here, the home screen may be a screen displayed on the touch screen for the first time when the locked state of the touch screen is released. In addition, the idle screen may be a screen on which an application icon or widgets are displayed. Also, the operation screen may be a screen on which a predetermined application operates.

In a state where the first operation screen is displayed, the control unit 180 receives the user input and enters the memo mode (S520). Here, the memo mode may be a handwriting memo mode. In the note-making mode, the control unit 180 stops the screen displayed on the mobile terminal and displays the still screen image, and receives the locus corresponding to the touch input of the user on the image. In addition, the controller 180 may capture the displayed screen, receive a user's memo on the captured image, and store the captured image and the memo together. Alternatively, the control unit 180 may separately store only memos excluding the captured image.

Here, the note can be made using a user's finger or a tool capable of touch input (for example, a stylus).

In the state where the user enters the memo mode, the control unit 180 displays a highlight on the first operation screen according to the user's input (S530).

Here, text may be included in the first operation screen. The highlight display may be an operation of displaying a quote or underlining a part of the text included in the first operation screen. In addition, the highlight display may be an action that displays an enhancement color that covers a portion of the text.

In the state where the highlight is displayed, the controller 180 receives the user input and stores the first operation screen in which the highlight is displayed (S540).

Thereafter, the control unit 180 receives the user input and enters the TTS mode (S550). Here, the TTS mode means a mode in which text included in the content is output by voice. For example, an e-book application may be executed to enter a TTS mode, an Internet browsing application may be executed, a TTS mode may be entered, a memo application may be executed, and a TTS mode may be entered.

In the state where the TTS mode is entered, the control unit 180 displays predetermined contents (S560). Here, the content may be the first operation screen in which the highlight stored in step S540 is displayed.

In the present embodiment, the predetermined content is displayed (S560) after entering the TTS mode (S550). However, the present invention is not limited to this, and the TTS mode may be entered after displaying predetermined content.

In a state where predetermined contents are displayed, the controller 180 receives a user input for the TTS operation (S570). The user input for the TTS operation may be performed through the user input unit 130 or by touching a predetermined object displayed on the display unit 151. [

If a user input for the TTS operation is received, the control unit 180 extracts the text included in the content (S575). The operation of extracting the text from the contents can be done through the TTS module 182. [

Meanwhile, according to the embodiment, the control unit 180 may detect the language of the text of the extracted content.

If a user input for the TTS operation is received, the controller 180 determines whether there is a region highlighted in the content (S580). Here, the highlight display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. For example, a highlight is displayed in one of the presence of a quote, the presence or absence of an underline, and the presence or absence of an emphasis color covering the text.

For example, when quoting a part of the text contained in the content, the quoted text is a highlighted area.

As another example, if a portion of the text contained in the content is underlined, the underlined text is a highlighted area.

As another example, when an emphasis color covering the text is displayed on a part of the text included in the content, the highlighted area covering the text is a highlighted area.

On the other hand, the type of such highlight display can be set by user input, and a description thereof will be described with reference to FIG.

If there is a region highlighted in the content, the control unit 180 converts the highlighted region into a distinctive region and outputs the converted speech (S590). At this time, the text-to-speech conversion may be performed through the TTS module 182.

In this case, the control unit 180 distinguishes between highlighted areas and non-highlighted areas and outputs them separately according to the size of the voice, the speaking speed of the voice, the type of the voice, the language of the voice, do. At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

For example, the control unit 180 can output a highlighted area in a larger voice than an area in which no highlight is displayed. Alternatively, the control unit 180 can output a highlighted area in a smaller voice than an area in which no highlight is displayed.

As another example, the control unit 180 can output the highlighted area at a faster speaking rate than the area where the highlight is not displayed. Alternatively, the control unit 180 may output the area in which the highlight is displayed so as to be slower than the area in which the highlight is not displayed.

As another example, the control unit 180 may output a highlighted area to a male voice and a non-highlighted area to a female voice. In addition, a highlighted area can be output to a woman's voice, and a highlighted area can be output to a male voice.

As another example, the control unit 180 can output the area in which the highlight is displayed and the area in which the highlight is not displayed in another language. That is, the controller 180 detects the language of the text of the extracted content in step S575. The control unit 180 outputs the area in which the highlight is not displayed in the detected language and the area in which the highlight is displayed in the language different from the detected language. For example, when the detected language is Korean, an area in which no highlight is displayed can be output in Korean, and an area in which no highlight is displayed can be output in a foreign language.

The operation of outputting in a different language depending on whether a highlight is displayed or not will be described in detail with reference to FIG.

As another example, the control unit 180 can repeatedly output the highlighted area by a preset number of times.

On the other hand, the output of the voice distinguished according to the presence / absence of the highlight display can be set by user input, and a description thereof will be described with reference to Fig.

If there is no region highlighted in the content, the control unit 180 outputs the general voice (S595). That is, the control unit 180 converts the predetermined area into a predetermined voice without emphasizing the predetermined area and outputs the voice. At this time, the text-to-speech conversion may be performed through the TTS module 182.

6 is a flowchart illustrating an operation of the mobile terminal according to the third embodiment of the present invention.

Referring to FIG. 6, the controller 180 receives the user input, and drives the camera 121 (S610). In a state in which the camera 121 is driven, the control unit 180 acquires an image including a highlight indication (S620). Here, the highlighting display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. For example, highlights include differences in text size, presence or absence of quotation marks, presence of underscores, existence of highlight color covering the text, differences in fonts of text, differences in text color, Can be displayed in any one of them. Alternatively, the highlight indication may be a display that indicates a portion of the text with the user's finger.

The acquiring operation of the image may be an operation of acquiring the subject including the predetermined text through the camera 121. [

In a state in which the image including the highlight display is acquired, the control unit 180 receives the user command and enters the TTS mode (S650). Here, the TTS mode means a mode in which text included in the content is output by voice. For example, an e-book application may be executed to enter a TTS mode, an Internet browsing application may be executed, a TTS mode may be entered, a memo application may be executed, and a TTS mode may be entered.

In the state where the TTS mode is entered, the control unit 180 displays predetermined contents (S660). Here, the contents may be electronic books, Internet articles, documents, memos, and the like. In addition, the content may be an image including predetermined text. The content may be an image containing text. If the content is an image including text, the text may be extracted from the image using an optical character recognition (OCR) method. There are many ways to recognize the text contained in an image, one of which is using the language model. The language model extracts text based on dictionaries, frequency of use, probability of use, and so on.

 The optical character recognition (OCR) scheme applies the presently used scheme (for example, Korean Patent Laid-Open Publication No. 10-2006-0046128 "low resolution OCR for camera input documents"), Therefore, detailed description is omitted for the sake of simplicity.

On the other hand, in the present embodiment, the predetermined content is displayed (S660) after entering the TTS mode (S650). However, the present invention is not limited thereto.

In a state where predetermined contents are displayed, the control unit 180 receives a user input for a TTS operation (S670). The user input for the TTS operation may be performed through the user input unit 130 or by touching a predetermined object displayed on the display unit 151. [

If a user input for the TTS operation is received, the control unit 180 extracts the text included in the content (S675). The operation of extracting the text from the contents can be done through the TTS module 182. [

Meanwhile, according to the embodiment, the control unit 180 may detect the language of the text of the extracted content.

If a user input for the TTS operation is received, the controller 180 determines whether there is a region highlighted in the content (S680). Here, the highlight display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. For example, highlights include differences in text size, presence or absence of quotation marks, presence of underscores, existence of highlight color covering the text, differences in fonts of text, differences in text color, Can be displayed in any one of them.

For example, if the size of the text contained in the content is 10 points and the size of one part of the text is 12 points, the text displayed at the size of 12 points is a highlighted area.

As another example, when quoting a part of the text contained in the content, the quoted text is a highlighted area.

As another example, if a portion of the text contained in the content is underlined, the underlined text is a highlighted area.

As another example, when an emphasis color covering the text is displayed on a part of the text included in the content, the highlighted area covering the text is a highlighted area.

As another example, if the text contained in the content is a base and only a part of the text is Gothic, the text displayed in Gothic is a highlighted area.

As another example, if the text contained in the content is displayed in black and only a portion of the text is displayed in red, the text displayed in red is the highlighted area.

In another example, if the text contained in the content is displayed in a general size and only a part of the text is displayed in bold text, the text in bold is the highlighted area.

On the other hand, the type of such highlight display can be set by user input, and a description thereof will be described with reference to FIG.

If there is a highlighted area in the content, the control unit 180 converts the highlighted area into a distinguishable area (step S690). At this time, the text-to-speech conversion may be performed through the TTS module 182.

In this case, the control unit 180 distinguishes between highlighted areas and non-highlighted areas and outputs them separately according to the size of the voice, the speaking speed of the voice, the type of the voice, the language of the voice, do. At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

For example, the control unit 180 can output a highlighted area in a larger voice than an area in which no highlight is displayed. Alternatively, the control unit 180 can output a highlighted area in a smaller voice than an area in which no highlight is displayed.

As another example, the control unit 180 can output the highlighted area at a faster speaking rate than the area where the highlight is not displayed. Alternatively, the control unit 180 may output the area in which the highlight is displayed so as to be slower than the area in which the highlight is not displayed.

As another example, the control unit 180 may output a highlighted area to a male voice and a non-highlighted area to a female voice. In addition, a highlighted area can be output to a woman's voice, and a highlighted area can be output to a male voice.

As another example, the control unit 180 can output the area in which the highlight is displayed and the area in which the highlight is not displayed in another language. That is, the control unit 180 detects in which language the text of the extracted content is formed in step S675. The control unit 180 outputs the area in which the highlight is not displayed in the detected language and the area in which the highlight is displayed in the language different from the detected language. For example, when the detected language is Korean, an area in which no highlight is displayed can be output in Korean, and an area in which no highlight is displayed can be output in a foreign language.

The operation of outputting in a different language depending on whether a highlight is displayed or not will be described in detail with reference to FIG.

As another example, the control unit 180 can repeatedly output the highlighted area by a preset number of times.

On the other hand, the output of the voice distinguished according to the presence / absence of the highlight display can be set by user input, and a description thereof will be described with reference to Fig.

If there is no region highlighted in the content, the control unit 180 converts it into a general voice and outputs it (S695). That is, the control unit 180 outputs a constant voice without emphasizing a predetermined area. At this time, the text-to-speech conversion may be performed through the TTS module 182.

7 is a flowchart illustrating an operation of the mobile terminal according to the fourth embodiment of the present invention.

Referring to FIG. 7, the controller 180 enters a text to speech (TTS) mode in response to a user input (S750). Here, the TTS mode means a mode in which text included in the content is output by voice. For example, an e-book application may be executed to enter a TTS mode, an Internet browsing application may be executed, a TTS mode may be entered, a memo application may be executed, and a TTS mode may be entered.

In the state where the TTS mode is entered, the control unit 180 enters the automatic mode in response to user input (S755). Here, the automatic mode refers to a mode for automatically searching for and highlighting a highlighted portion based on a predetermined criterion in a text included in the content.

In a state where the automatic mode is entered, the control unit 180 displays predetermined contents (S760). Here, the contents may be electronic books, Internet articles, documents, memos, and the like. In addition, the content may be an image including predetermined text.

In a state where predetermined content is displayed, the control unit 180 searches for a highlight portion based on a predetermined criterion in the content (S763), and displays the highlighted portion that has been searched (S767). Here, the criterion for searching for the highlight part may be whether or not a predetermined word or phrase is repeated a predetermined number of times or more in the content. For example, if it is set to search for a highlighted portion of a word repeated five or more times on one page, the control unit 180 searches the highlighted portion for a word that is searched five or more times on a specific page of the content, Display.

Here, the criterion for searching for the highlight part may be whether or not the size of the text included in the content is equal to or larger than a predetermined size. For example, when the text is set to be searched as a highlight portion, the control portion 180 searches the highlight portion of the text having a size of 14 points or more and highlights the searched portion.

In a state in which the highlight portion is searched and displayed, the control unit 180 receives a user input for the TTS operation (S770). The user input for the TTS operation may be performed through the user input unit 130 or by touching a predetermined object displayed on the display unit 151. [

When a user input for the TTS operation is received, the control unit 180 extracts the text included in the content (S775). The operation of extracting the text from the contents can be done through the TTS module 182. [

Meanwhile, according to the embodiment, the control unit 180 may detect the language of the text of the extracted content.

If a user input for the TTS operation is received, the controller 180 determines whether there is a region highlighted in the content (S780). Here, the highlight display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. For example, highlights include differences in text size, presence or absence of quotation marks, presence of underscores, existence of highlight color covering the text, differences in fonts of text, differences in text color, Can be displayed in any one of them.

For example, if the size of the text contained in the content is 10 points and the size of one part of the text is 12 points, the text displayed at the size of 12 points is a highlighted area.

As another example, when quoting a part of the text contained in the content, the quoted text is a highlighted area.

As another example, if a portion of the text contained in the content is underlined, the underlined text is a highlighted area.

As another example, when an emphasis color covering the text is displayed on a part of the text included in the content, the highlighted area covering the text is a highlighted area.

As another example, if the text contained in the content is a base and only a part of the text is Gothic, the text displayed in Gothic is a highlighted area.

As another example, if the text contained in the content is displayed in black and only a portion of the text is displayed in red, the text displayed in red is the highlighted area.

In another example, if the text contained in the content is displayed in a general size and only a part of the text is displayed in bold text, the text in bold is the highlighted area.

On the other hand, the type of such highlight display can be set by user input, and a description thereof will be described with reference to FIG.

If there is a highlighted area in the content, the control unit 180 distinguishes between highlighted areas and highlighted areas, and outputs the distinguished area as a distinct sound (S790). At this time, the text-to-speech conversion may be performed through the TTS module 182.

In this case, the control unit 180 distinguishes between highlighted areas and non-highlighted areas and outputs them separately according to the size of the voice, the speaking speed of the voice, the type of the voice, the language of the voice, do. At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

For example, the control unit 180 can output a highlighted area in a larger voice than an area in which no highlight is displayed. Alternatively, the control unit 180 can output a highlighted area in a smaller voice than an area in which no highlight is displayed.

As another example, the control unit 180 can output the highlighted area at a faster speaking rate than the area where the highlight is not displayed. Alternatively, the control unit 180 may output the area in which the highlight is displayed so as to be slower than the area in which the highlight is not displayed.

As another example, the control unit 180 may output a highlighted area to a male voice and a non-highlighted area to a female voice. In addition, a highlighted area can be output to a woman's voice, and a highlighted area can be output to a male voice.

As another example, the control unit 180 can output the area in which the highlight is displayed and the area in which the highlight is not displayed in another language. That is, the control unit 180 detects the language of the text of the content extracted in step S775. The control unit 180 outputs the area in which the highlight is not displayed in the detected language and the area in which the highlight is displayed in the language different from the detected language. For example, when the detected language is Korean, an area in which no highlight is displayed can be output in Korean, and an area in which no highlight is displayed can be output in a foreign language.

The operation of outputting in a different language depending on whether a highlight is displayed or not will be described in detail with reference to FIG.

As another example, the control unit 180 can repeatedly output the highlighted area by a preset number of times.

On the other hand, the output of the voice distinguished according to the presence / absence of the highlight display can be set by user input, and a description thereof will be described with reference to Fig.

If there is no area highlighted in the content, the control unit 180 outputs the general voice (S795). That is, the control unit 180 outputs a constant voice without emphasizing a predetermined area. At this time, the text-to-speech conversion may be performed through the TTS module 182.

8 is a diagram for describing an operation of accessing a content providing server or a search server using a mobile communication network according to an embodiment of the present invention.

Referring to FIG. 8, the mobile terminal 100 may access the mobile communication network 820 through the wireless communication unit 110. The mobile terminal 100 may access the content providing server 830 through the mobile communication network 820 and receive the content. Here, the content providing server 830 may include a server providing e-book contents, a server providing Internet articles, and a cloud providing service providing server providing a storage space for a user to upload and download contents It can be either.

Meanwhile, according to the embodiment, the mobile terminal 100 may provide an automatic search function in the TTS mode. The automatic search function in the TTS mode will be described with reference to FIG.

When the automatic search function is provided, the mobile terminal 100 can access the search server 840 through the mobile communication network 820. The mobile terminal 100 can receive a search result from the search server 840 with a predetermined search word requested by the user while the search server 840 is connected to the mobile communication network 820. [

Figure 9 is an exemplary diagram that is referenced to illustrate the operation of entering the TTS mode, in accordance with an embodiment of the present invention.

9 (a), the control unit 180 executes an e-book application corresponding to the touch input of the e-book application icon 910 of the user. When the e-book application is executed, the control unit 180 displays the e-book application screen on the display unit 151 as shown in FIG. 9 (b). At this time, one or more contents 931, 932, 933, 934, 935, and 936 may be displayed on the e-book application screen. 9 (c), when the controller 180 receives the touch input for the setting icon 920 from the e-book application screen, the controller 180 sets the e-book application And displays the screen 940 on the display unit 151. When the TTS mode 950 is selected by user input, the controller 180 enters the TTS mode.

In the present embodiment, the operation of entering the TTS mode by executing the e-book application has been described, but it is not limited thereto. That is, according to the embodiment, the mobile terminal 100 may enter the general setting mode and enter the TTS mode. In addition, another application capable of the TTS function can be executed to enter the TTS mode.

10 is an exemplary diagram referred to explain the voice output operation of the highlighted contents according to the first embodiment of the present invention.

10 (a), in a state in which an e-book application screen is displayed, the control unit 180 selects one of the plurality of electronic books 1031, 1032, 1033, 1034, 1035, According to the touch input, an e-book called "Ryomo goes to" is selected. In this case, as shown in Fig. 10 (b), the control unit 180 displays a predetermined page of "Going Rumor" on the display unit 151. [ At this time, "Sakamoto Ryuumo" part included in the page is highlighted. On the other hand, in the present embodiment, the highlight is represented by the highlight color covering the text, but it is not limited thereto. That is, the highlight can be displayed by any one of a difference in size of a text, existence of a quotation mark, existence of an underline, difference of font of text, difference of color of text, and difference of thickness of text.

When the touch input to the TTS operation icon 1050 is received while a predetermined page of "REMOTE GO" is displayed, as shown in FIG. 10C, the control unit 180 sets the " And outputs the contents of the voice as a voice. At this time, the control unit 180 outputs the highlighted "Sakamoto Ryuumo" portion as a voice distinguished from the portion not highlighted. That is, the control section 180 divides the "Sakamoto Ryuumo" area marked with a highlight from the area where the highlight is not displayed, and determines whether the highlight is displayed in accordance with any one of voice size, voice speaking speed, voice type, And outputs them separately. At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

For example, the control unit 180 can output the "Sakamoto Ryuumo" area in which the highlight is displayed in a larger voice than in the area in which the highlight is not displayed. Alternatively, the control unit 180 can output the "Sakamoto Ryuumo" area in which the highlight is displayed in a smaller voice than the area in which the highlight is not displayed.

As another example, the control unit 180 can output the highlighted "Sakamoto Ryuumo" area at a faster speaking speed than an area where the highlight is not displayed. Alternatively, the control unit 180 can output the "Sakamoto Ryuumo" area in which the highlight is displayed in a slow speaking manner as compared with the area in which the highlight is not displayed.

As another example, the control unit 180 may output the "Sakamoto Ryuumo" area indicated by the highlight to the male voice and output the area where the highlight is not displayed to the female voice. In addition, it is possible to output the "Sakamoto Ryuumo" area in which the highlight is displayed to the woman's voice, and the area in which the highlight is not displayed in the male voice.

As another example, the control unit 180 may output the highlighted "Sakamoto Ryomo" region in English, and the highlighted region may be displayed in Korean.

As another example, the control unit 180 can repeatedly output the "Sakamoto Ryuumo" area indicated by the highlight by a preset number of times (for example, three times).

10 (c), the control unit 180 may display the TTS operation control bar 1070 in a region of the display unit 151. In this case, as shown in FIG. The TTS operation control bar 1070 may include a scroll box 1071 that can display the current voice output portion for the entire voice data. In addition, the TTS operation control bar 1070 may include a time 1072 that indicates the amount of audio data remaining. The TTS operation control bar 1070 also includes a rewind icon 1073, a stop icon 1074, a playback icon 1075, a fast forward icon 1076, a volume up icon 1077, and a volume down icon 1078 can do. The user can control various operations of voice output using the TTS operation control bar 1070. [

11 is a diagram referred to explain an operation of entering a memo mode and highlighting according to a second embodiment of the present invention.

As shown in FIG. 11 (a), in a state where the Internet article screen 1110 is displayed, the control unit 180 receives a touch and drag input for the notification bar 1120 to enter the memo mode. In this case, a notification screen 1130 is displayed as shown in FIG. 11 (b). When the notification screen 1130 is displayed, the touch input for the note mode icon 1135 is received and the note mode is entered. Here, the memo mode may be a handwriting memo mode. In the note-making mode, the control unit 180 stops the screen displayed on the mobile terminal and displays the still screen image, and receives the locus corresponding to the touch input of the user on the image. In addition, the controller 180 may capture the displayed screen, receive a user's memo on the captured image, and store the captured image and the memo together. Alternatively, the control unit 180 may separately store only memos excluding the captured image.

Here, the note can be made using a user's finger or a tool capable of touch input (for example, a stylus).

11 (c), the control unit 180 responds to the user input by inputting an underline 1140 to the "Minister of Economy, Trade and Industry" And displays a circle (1141) on the "current deputy prime minister" to display a highlight. Thereafter, the touch input to the storage icon 1150 is received, and the highlighted Internet article is stored in the memory 160. [

12 is an exemplary diagram referred to explain voice output operation of highlighted contents according to the second embodiment of the present invention.

As shown in FIGS. 12A and 12B, when a touch input to the application icon 1210 capable of performing the TTS operation is received, the TTS operation performing application screen is displayed on the display unit 151 do. Here, the application capable of performing the TTS operation may be any one of an e-book application, an Internet browsing application, and a memo display application stored in the memory 160. [

12 (c), when the user selects the content 1237 including the highlight display according to the user input, the control unit 180 displays the Internet content 1240 including the highlight display input in the note mode, Is displayed on the display unit 151. The Internet article (1240) is marked with an underline (1241) in the "Minister of Employment and Economic Affairs and the Minister of Employment and Finance," and a circle (1242) is displayed in the "Current Deputy Prime Minister". Here, the underline 1241 and the circle 1242 display correspond to a highlight display.

On the other hand, the Internet article including the highlight indication input in the memo mode may be an image file. In this case, text can be extracted from the image by an optical character recognition (OCR) method to perform a TTS operation.

On the other hand, in the present embodiment, the highlight is displayed using underlines and circles, but it is not limited thereto. The highlight can be displayed in any one of a difference in size of text, existence of quotation mark, existence of highlight color covering text, difference of font of text, difference of color of text, and difference of thickness of text.

When receiving a touch input for the TTS operation icon 1250 while a predetermined page of the Internet article 1240 is displayed, as shown in (d) of FIG. 12, the control unit 180 displays the content of the Internet article And outputs it as a voice. At this time, the control unit 180 outputs the highlighted "Ministry of Economy, Finance and Finance Minister" and the Ministry of Planning and Finance as a voice distinguished from the portion not highlighted. That is, the control unit 180 divides the highlighted area from the area where the highlight is not displayed, and displays the size of the voice, the speaking speed of the voice, the type of the voice, the language of the voice, And outputs them in a manner distinguishable from each other according to any one of the repetitions of FIG.

For example, the control unit 180 can output a region with a larger voice than a region in which the highlight is displayed, as compared to the region where the highlight is not displayed. Alternatively, the control unit 180 may output a region with a voice smaller than that of a region where the highlight is not displayed.

As another example, the control unit 180 can output the highlighted area of "Dae Sang-Suk Economy Minister and the Minister of Planning and Finance" at a faster speaking speed than the area not highlighted. Alternatively, the control unit 180 may output the "highlighted" "Dae Sang Suk Economy Minister and the Minister of Strategy and Finance" as a slow talk phrase compared to the area not highlighted.

As another example, the control unit 180 may output a voice of a male voice and a voice of a female voice in which the highlight is not displayed. In addition, the highlighted "Ministry of Economy and Finance Minister Shosha Stone" can output the area as a woman's voice and the area without a highlight as a male voice.

As another example, the control unit 180 may output the area of the highlighted "Dae Sang Suk Economy Minister and the Minister of Planning and Finance" in English, and output the highlighted area in Korean.

As another example, the control unit 180 may repeatedly output the area indicated by the highlighted "Daesan Stone Economic Deputy Prime Minister and the Minister of Strategy and Finance" by a predetermined number of times (for example, three times).

12 (d), the control unit 180 may display the TTS operation control bar 1270 in a region of the display unit 151. In this case, as shown in FIG. The TTS operation control bar 1270 may include a scroll box 1271 that can display the current voice output portion for the entire voice data. In addition, the TTS operation control bar 1270 may include a time 1272 indicating the amount of audio data remaining. The TTS operation control bar 1270 also includes a rewind icon 1273, a stop icon 1274, a playback icon 1275, a fast-forward icon 1276, a volume up icon 1277, and a volume down icon 1278 can do. The user can control various operations of the audio output using the TTS operation control bar 1270. [ At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

13 is an exemplary diagram referred to explain an operation of acquiring an image including a highlight display through a camera according to the third embodiment of the present invention.

As shown in FIG. 13A, the control unit 180 receives a touch input to the camera application 1310, and drives the camera 121.

13 (b), the control unit 180 receives the touch input to the photographing button 1315 and displays the image 1320 including the highlighting indication in the state of the camera 121 being driven . At this time, the image to be obtained may be a predetermined document image 1320. Here, the highlighting display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. The acquired image 1320 includes a highlight indication 1330 indicating with a finger the "REQUESTCODE ". Also, the acquired image includes a highlight indication 1340 in which an emphasis color that covers the text is "probably have recognized this time ".

Fig. 14 is an exemplary diagram for explaining a voice output operation of a highlighted content according to a third embodiment of the present invention; Fig.

As shown in Figs. 14A and 14B, when a touch input to the application icon 1410 capable of performing the TTS operation is received, the TTS operation performing application screen is displayed on the display unit 151 do. Here, the application capable of performing the TTS operation may be any one of an e-book application, an Internet browsing application, and a memo display application stored in the memory 160. [

14 (c), when the user selects the content 1437 including the highlight display according to the user input, the control unit 180 displays the document including the highlight display obtained through the camera 121 1440 on the display unit 151. [ Here, the highlighting display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. The document 1440 including the highlight indication includes a highlight indication 1441 indicating with a finger the "REQUESTCODE ". Also, the acquired image includes a highlight indication 1442 in which an emphasis color covering text is displayed in "probably have recognized this time ".

On the other hand, the document 1440 including the highlight display obtained through the camera 121 corresponds to the image. In this case, text can be extracted from the image by an optical character recognition (OCR) method to perform a TTS operation.

On the other hand, in the present embodiment, emphasis is highlighted by a finger or an emphasis color covering text, but it is not limited thereto. The highlight can be displayed in any of the size of the text, the presence or absence of quotation marks, the difference in the font of the text, the difference in the color of the text, and the difference in the thickness of the text.

When the touch input to the TTS operation icon 1450 is received while the document image 1440 is displayed, as shown in FIG. 14D, the control unit 180 outputs the contents of the document by voice . At this time, the control unit 180 outputs the highlighted "REQUESTCODE" and "probably have recognized this time" portions as a voice distinguished from a portion not highlighted. That is, the control unit 180 distinguishes the "REQUESTCODE" and "probably have recognized this time" areas, which are highlighted, from the non-highlighted areas and determines the size of the voice, the speaking speed of the voice, the type of the voice, And outputs them in a manner distinguishable from each other according to any one of the repetitions of FIG.

For example, the control unit 180 can output the "REQUESTCODE" and "probably have recognized this time" areas, which are highlighted, with a louder voice than the area where no highlight is displayed. Alternatively, the control unit 180 may output the "REQUESTCODE" and "probably have recognized this time" areas in which the highlight is displayed with a smaller voice than the area in which the highlight is not displayed.

As another example, the control unit 180 may output the highlighted "REQUESTCODE" and "probably have recognized this time" areas at a faster speaking rate than an area not highlighted. Alternatively, the control unit 180 may output the highlighted "REQUESTCODE" and "probably have recognized this time" areas to a slow talk tune relative to an area not highlighted.

As another example, the control unit 180 may output a "REQUESTCODE" and a "probably have recognized this time" area, which are highlighted, to a male voice, and a non-highlighted area may be output to a female voice. It is also possible to output the "REQUESTCODE" and "probably have recognized this time" areas, which are highlighted, to the woman's voice, and the area where the highlight is not displayed, to the male voice.

As another example, the control unit 180 may output the highlighted "REQUESTCODE" and "probably have recognized this time" regions in English and the highlighted regions may be output in the Korean language.

As another example, the control unit 180 may repeatedly output the " REQUESTCODE "and" probably have recognized this time "areas indicated by the highlight by a preset number of times (for example, three times).

On the other hand, according to the embodiment, when the TTS operation is performed, the controller 180 can display the TTS operation control bar 1470 in a region of the display unit 151, as shown in (d) of FIG. The TTS operation control bar 1470 may include a scroll box 1471 that can display the current voice output portion for the entire voice data. In addition, the TTS operation control bar 1470 may include a time 1472 that indicates the amount of audio data remaining. The TTS operation control bar 1470 includes a rewind icon 1473, a stop icon 1474, a playback icon 1475, a fast forward icon 1476, a volume up icon 1477, and a volume down icon 1478 can do. The user can control various operations of the audio output using the TTS operation control bar 1470. [ At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

Fig. 15 is an exemplary diagram referred to explain an operation of entering the automatic mode according to the fourth embodiment of the present invention. Fig.

As shown in Fig. 15A, the control unit 180 displays an e-book application screen on the display unit 151. Fig. When receiving a touch input for the setting icon 1520 in the e-book application screen, the control unit 180 sets the e-book application setting 1520 as shown in FIG. 15 (b) And displays the screen 1540 on the display unit 151. [ When the automatic mode 1550 is selected by user input, the control unit 180 enters the automatic mode. Here, the automatic mode refers to a mode for automatically searching for and highlighting a highlighted portion based on a predetermined criterion in a text included in the content.

The criterion for searching for the highlight part may be whether or not a predetermined word or phrase is repeated a predetermined number of times or more in the content. For example, if it is set to search for a highlighted portion of a word repeated five or more times on one page, the control unit 180 searches the highlighted portion for a word that is searched five or more times on a specific page of the content, Display.

Here, the criterion for searching for the highlight part may be whether or not the size of the text included in the content is equal to or larger than a predetermined size. For example, when the text is set to be searched as a highlight portion, the control portion 180 searches the highlight portion of the text having a size of 14 points or more and highlights the searched portion.

FIG. 16 is an exemplary diagram referred to explain voice output operation of highlighted contents according to the fourth embodiment of the present invention. FIG.

As shown in FIG. 16A, in a state in which an e-book application screen is displayed, the control unit 180 controls the plurality of electronic books 1631, 1632, 1633, 1634, 1635, 1636, and 1637, The user selects an e-book 1637 called "young child"

In this case, as shown in FIG. 16B, the control unit 180 displays the predetermined page 1640 of the "young child" on the display unit 151. In a state in which the predetermined page 1640 of the "young child" is displayed, the control unit 180 searches the content for the highlighted portion based on a predetermined criterion. Here, the criterion for searching for the highlighted portion may be whether or not a predetermined word or phrase is repeated a predetermined number or more (for example, four times or more) in the content. When the "young beggar" and "sultry" are repeated four or more times in a predetermined page 1640 of "young beggar", the control unit 180 searches for "young beggar" and "sultry" as highlight portions.

When the highlight search is completed, as shown in FIG. 16C, the control unit 180 highlights the searched "young child" and "sultry". At this time, the highlight indication is indicated by the highlight color covering "young beggar" and "drunkard".

Here, the criterion for searching for the highlight part may be whether or not the size of the text included in the content is equal to or larger than a predetermined size. For example, when the text is set to be searched as a highlight portion, the control portion 180 searches the highlight portion of the text having a size of 14 points or more and highlights the searched portion.

On the other hand, in the present embodiment, the highlight is represented by the highlight color covering the text, but it is not limited thereto. That is, the highlight can be displayed by any one of a difference in size of a text, existence of a quotation mark, existence of an underline, difference of font of text, difference of color of text, and difference of thickness of text.

When the touch input to the TTS operation icon 1650 is received while a predetermined page of the "young beggar" is displayed, as shown in (d) of FIG. 16, As a voice. At this time, the control unit 180 outputs the highlighted "young child" and "sultry" In other words, the control unit 180 divides the "young child" and "sultry" areas indicated by the highlighting from the area where the highlight is not displayed and displays the size of the voice, the speaking speed of the voice, the type of the voice, And outputs them separately according to any one of them. At this time, the voice may be outputted through the first sound output module 153a. If an ear microphone (not shown) is connected to the interface unit 170, the voice may be output through a speaker (not shown) of the ear microphone.

For example, the control unit 180 can output the "Young Beggar" and "Bulgarian" areas, which are highlighted, with a louder voice than the area where the highlight is not displayed. Alternatively, the control unit 180 can output the "young child" and "sultry" areas, which are highlighted, with a smaller voice than the area where the highlight is not displayed.

As another example, the control unit 180 can output the highlighted "young child" and "sultry" areas at a faster speaking rate than areas where no highlight is displayed. Alternatively, the control unit 180 may output the "young child" and "sultry" areas indicated by the highlight to a slow speaking manner as compared to an area not highlighted.

As another example, the control unit 180 may output a "young child" and a "sorehero" area, which are highlighted, to a male voice, and a non-highlighted area may be output to a female voice. In addition, a "young beggar" and a "sorehero" area in which the highlight is displayed can be output to the female voice, and a region in which the highlight is not displayed can be output to the male voice.

As another example, the control unit 180 may output the highlighted "young beggar" and "sultry" areas in English, and output highlighted areas in Korean.

As another example, the control unit 180 may repeatedly output the "young child" and "sore" areas indicated by the highlight by a preset number of times (for example, three times).

16 (d), the control unit 180 may display the TTS operation control bar 1670 in a region of the display unit 151. In this case, as shown in FIG. The TTS operation control bar 1670 may include a scroll box 1671 that can display the current voice output portion for the entire voice data. In addition, the TTS operation control bar 1670 may include a time 1672 indicating the amount of audio data remaining. The TTS operation control bar 1670 also includes a rewind icon 1673, a stop icon 1674, a playback icon 1675, a fast forward icon 1676, a volume up icon 1677, and a volume down icon 1678 can do. The user can control various operations of the audio output using the TTS operation control bar 1670. [

17 is an exemplary diagram referred to explain the highlight portion automatic search operation in the TTS mode, according to an embodiment of the present invention.

17 (a), in a state in which a predetermined page 1640 of "young beggar" is displayed, the control unit 180 searches for the highlight portion in the content, and searches for the "young beggar" and " " The control unit 180 receives a touch input for the search icon 1745. [

17B, when the touch input to the search icon 1745 is received, the control unit 180 displays the highlighted "young child" 1746 and the highlighted " And displays the "drunkard" 1747 in one area of the display unit 151. [

When the "young child" 1746 is selected by the user input, the control unit 180 accesses the search server (840 of FIG. 8) through the mobile communication network. 8) of the search server (840 of FIG. 8) via the mobile communication network, the control unit 180 receives a search result using the search term "young person" At this time, as shown in (c) of FIG. 17, the control unit 180 displays the provided search result 1750 on the display unit 151.

18 is a diagram referred to explain a voice output control operation according to a touch input of a user in a TTS mode according to an embodiment of the present invention.

As shown in FIG. 18A, when the touch input 1810 is received while the content screen is displayed, the control unit 180 can output the content of the document included in the content screen by voice. In this case, the speaking speed of the voice is a default or a speed preset by the user.

When the double-touch input 1811 is received while the content screen is displayed, the controller 180 can output the content of the document included in the content screen at a speed higher than a preset speaking speed.

When the long-touch input 1812 is received while the content screen is displayed, the controller 180 may output the content of the document included in the content screen at a speed lower than a predetermined speaking rate.

18B, when a touch and drag input 1820 is received in a state that a content screen is displayed, the control unit 180 instructs the control unit 180 to select "Sakamoto Ryuumo " to receive the touch and drag input As shown in FIG. At this time, the speaking speed of the audio output corresponding to the drag input speed can be adjusted. That is, the speaking speed of the audio outputted in proportion to the drag input speed can be adjusted.

As shown in FIG. 18C, when the multi-touch input 1830 is received while the content screen is being displayed, the control unit 180 simultaneously outputs the multi-touch areas "Sakamoto & do.

On the other hand, when the touch input is received while the contents screen is displayed, the pressure sensor 143 can sense the touch pressure and adjust the volume. That is, when a strong touch pressure is detected in the size of the volume currently output, the volume can be raised by one level. In addition, when a weak touch pressure is detected in the volume of the current output volume, the volume can be lowered by one level.

19 is a diagram referred to explain voice output operation in a TTS mode for a visually impaired person, according to an embodiment of the present invention.

Referring to FIG. 19, when a predetermined message 1910 is output during the operation of the mobile terminal 100 while entering the TTS mode for the visually impaired, the controller 180 may output the message by voice . In this case, the message 1910 may include a message type 1920, a message content 1930, and an area 1940 for receiving a user's touch input. At this time, the controller 180 controls each of the areas to be able to distinguish the type of the message 1920, the content of the message 1930, and the area 1940 for receiving the touch input of the user, It is possible to output differently.

For example, "Warning" may be output as the voice of a male voice, and "Turning on developer options might result in irregular behavior in your device, . In addition, "Do not show this again" and "OK" can output audio with a volume size larger than the volume size of the default audio.

Depending on the embodiment, the type of message 1920, the content of the message 1930, and the area 1940 for receiving the touch input of the user may include the size of the voice, the speaking speed of the voice, the type of voice, It is possible to output them separately from each other according to any one of the repetition of speech.

20 and 21 are exemplary diagrams referred to in describing the TTS mode setting operation according to an embodiment of the present invention.

As shown in FIG. 20A, in a state where the general setting screen 2010 of the mobile terminal is displayed, the controller 180 selects the language and the input setting 2015 corresponding to the user input.

20B, in a state in which the language and input setting screen 2020 is displayed, the control unit 180 selects the TTS setting 2025 in response to the user input.

20 (c), in a state in which the TTS setting screen 2030 is displayed, the controller 180 sets the "LG TTS +" setting icon 2035 among the plurality of TTS mode types corresponding to the user input Touch input is received.

In this case, as shown in (d) of FIG. 20, a screen 2040 for setting a sound to be output is displayed on the display unit 151. The screen 2040 for setting a sound to be output may include a menu 2045 for setting a highlight emphasized sound. When receiving the touch input to the menu 2045 for setting the highlight emphasized voice, as shown in (e) of FIG. 20, the control unit 180 sets the highlight emphasized voice to the voice size ( 2051, speech speed 2052, speech type 2053, speech language 2054, and speech repetition 2055 can be set.

For example, when the voice size 2051 is selected, the control unit 180 can output a highlighted area in a larger voice than an area in which no highlight is displayed. Alternatively, the control unit 180 can output a highlighted area in a smaller voice than an area in which no highlight is displayed.

As another example, when the speech speed 2052 is selected, the control unit 180 can output the highlighted area at a faster speaking rate than the area where the highlight is not displayed. Alternatively, the control unit 180 may output the area in which the highlight is displayed so as to be slower than the area in which the highlight is not displayed.

As another example, when the type of voice 2053 is selected, the control unit 180 can output a highlighted area to a male voice and a non-highlighted area to a female voice. In addition, a highlighted area can be output to a woman's voice, and a highlighted area can be output to a male voice.

As another example, when the language of the voice 2054 is selected, the control unit 180 can output the highlighted area in English, and the highlighted area in Korean.

As another example, when the repetition of voice 2055 is selected, the control unit 180 can repeatedly output the highlighted area a predetermined number of times.

On the other hand, as shown in FIG. 21 (a), a screen 2140 for setting a sound to be output may include a menu 2145 for setting a highlight display. The highlight display means a display for distinguishing between an area requiring emphasis and an area not requiring emphasis. 21 (b), when the touch input to the menu 2145 for setting the highlight display is received, the control unit 180 sets the highlight display to the text size difference 2151 Presence or absence of quotation marks 2152 presence of underscores 2153 presence or absence of highlighting color covering text 2154 difference in font 2155 text color difference 2156 text, And a difference 2157 of the thickness of the light-emitting layer.

For example, if the difference in text size 2151 is selected, if the size of the text contained in the content is 10 points and the size of one part of the text is 12 points, the text displayed at the size of 12 points is highlighted Area.

In another example, if the presence or absence of quotation marks 2152 is selected, the quoted text is a highlighted area when quoting a part of the text included in the content.

As another example, when the presence / absence of underline 2153 is selected, underlined text is shown in a part of the text included in the content, and the underlined text is highlighted area.

As another example, when presence / absence of highlight color (2154) covering the text is selected, an emphasis color covering the text is displayed in a part of the text included in the content, It is a highlighted area.

As another example, when the font difference 2155 of the text is selected, the text included in the content is the background, and when only a part of the text is Gothic, the text displayed in Gothic is the highlighted area.

As another example, if the text color difference 2156 is selected, if the text contained in the content is displayed in black and only a portion of the text is displayed in red, the text displayed in red is the highlighted area .

As another example, when the difference in text thickness (2157) is selected, if the text included in the content is displayed in a general size and only a part of the text is displayed in bold, the text in bold is highlighted Area.

22 is an exemplary diagram for explaining an operation of outputting in a different language according to whether or not a highlight is displayed according to an embodiment of the present invention.

Referring to FIG. 22 (a), the control unit 180 displays the content on the display unit 151. In the present embodiment, the content is exemplified as "Rumo goes." Among the contents, the "miracle of history" 2210 is a highlighted area. In this case, the control unit 180 extracts the text included in the content through the TTS module 182, and detects the language in which the extracted text is composed. The language detected in this embodiment is Korean. In the case of outputting the content as a voice by user input, the control unit 180 controls the output of the highlighted area in Korean. The control unit 180 controls the highlighted area to be output in a language other than Korean. If the content is a translated document, the control unit 180 may output the highlighted area in the language of the original document. In the present embodiment, "Ryomo goes to" is a Korean translation, and the language constituting the application is Japanese.

Meanwhile, when receiving the content, the controller 180 may receive information about the content together with the content. That is, if the content is a predetermined book, the control unit 180 can receive information on the artist, translator, title, price, language of the application, and the like. Accordingly, when the content is a translator, the control unit 180 can determine the language constituting the application based on the information about the content. For example, when content is received from a content providing server (830 of FIG. 8), the controller 180 may receive information about the content from the content providing server (830 of FIG. 8). In this case, the controller 180 can determine a language constituting the application from information on the content.

The control unit 180 outputs the highlighted area "miracle of history" to the Japanese word "rekishinokiseki" (the miracle of history) 2220 which constitutes the application. The control unit 180 outputs the area not highlighted in Korean.

Referring to FIG. 22 (b), the control unit 180 displays the content on the display unit 151. In this embodiment, the content is illustrated as "The big prince ". Among the contents, the "boa constrictor" area 2230 is a highlighted area. In this case, the control unit 180 extracts the text included in the content through the TTS module 182, and detects the language in which the extracted text is composed. The language detected in this embodiment is English. In this case, in the case of outputting the content as a voice by user input, the control unit 180 controls to output the area in which the highlight is not displayed in English. The control unit 180 controls the highlighted area to be output in a language other than English.

Meanwhile, the control unit 180 can determine the country where the mobile terminal 100 is located through the GPS module 119. Alternatively, the control unit 180 can determine the country providing the mobile communication service based on the mobile communication service provider providing the mobile communication service through the mobile communication module 113. In this embodiment, the country where the mobile terminal 100 is located is assumed to be Korea.

In this case, the control unit 180 controls to translate the highlighted area into the language of the country where the mobile terminal 100 is located and output it. That is, in this embodiment, the control unit 180 can output "boa constrictor" 2230, which is a highlighted area, as a Korean "Boa constrictor".

The above-described Korean, Japanese, and English are only examples, and the present invention is not limited thereto. It is obvious to those skilled in the art that other languages other than Korean, Japanese, and English can be used when displaying highlighted areas and highlighted areas.

On the other hand, unlike the case described with reference to FIGS. 22 (a) and 22 (b), the control unit 180 may set a language for outputting a highlighted area by user input. In this case, the control unit 180 outputs the area in which the highlight is displayed and the area in which no highlight is displayed in the language set by the user.

Meanwhile, the present invention can be implemented as a processor-readable code in a processor-readable recording medium provided in a portable terminal. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also a carrier wave such as transmission over the Internet. In addition, the processor readable recording medium may be distributed over networked computer systems so that code readable by the processor in a distributed manner can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

110:
120: A / V input unit
130: user input section
140: sensing unit
150:
151:
160: Memory
170:
180:

Claims (11)

Entering a text to speech (TTS) mode;
Displaying contents capable of audio output in the TTS mode;
Determining whether a highlighted region exists in the content; And
The method of claim 1, further comprising: outputting a highlighted region and a non-highlighted region as a distinctive voice. The method according to claim 1,
Wherein the content is an operation screen in which a highlight is displayed in correspondence with a user input memo when the user enters the memo mode. The method according to claim 1,
Wherein the content is an image screen input through a camera and including a highlight. The method according to claim 1,
Entering an automatic mode; And
And searching for and displaying a highlight portion based on a predetermined criterion in the content. 5. The method of claim 4,
Wherein the criterion is whether a predetermined word or phrase is repeated a predetermined number of times or more in the content. 5. The method of claim 4,
Wherein the criterion is whether the size of the text included in the content is greater than or equal to a predetermined size. The method according to claim 1,
Wherein the outputting step comprises:
A region in which the highlight is displayed and an area in which the highlight is not displayed may be classified into at least one of a difference in size of the text included in the content, presence or absence of a quote, presence or absence of an underline, presence or absence of an emphasis color covering the text, The difference of the color of the text, and the difference of the text thickness of the text, based on at least one of the differences. The method according to claim 1,
Wherein the outputting step comprises:
Wherein the highlight is distinguished from an area in which the highlight is not displayed and is output in a distinguishable manner according to at least one of a voice size, a voice speaking speed, a voice type, and a voice repeat. The method according to claim 1,
Receiving a predetermined user input and setting one area of the content as a highlight area. The method according to claim 1,
Wherein the content is provided from a content providing server using a mobile communication network. The method according to claim 1,
Further comprising the steps of: detecting a language constituting the content;
Wherein the outputting step comprises:
And outputting the area in which the highlight is displayed in a language different from the language.

Images