KR20160039830A

KR20160039830A - multimedia apparatus and method for providing voice guide thereof

Info

Publication number: KR20160039830A
Application number: KR1020140133004A
Authority: KR
Inventors: 허승현
Original assignee: 엘지전자 주식회사
Priority date: 2014-10-02
Filing date: 2014-10-02
Publication date: 2016-04-12

Abstract

The present invention relates to a multimedia device capable of providing a voice guidance that reflects latest trends and popular contents, and a method of providing voice guidance of the multimedia device, including collecting content related keywords displayed on a screen of the multimedia device and input search keywords, The method includes the steps of: classifying and storing classified keywords into categories; determining a priority of each of the stored keywords; generating a spoken sentence for each item using a keyword having the highest priority for each item; And displaying the voice guide provided with the generated utterance sentences.

Description

[0001] The present invention relates to a multimedia apparatus and method for providing the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia apparatus, and more particularly, to a multimedia apparatus and a method for providing a voice guide in which a latest trend and popular contents are reflected.

Generally, a multimedia device is a device having a function of receiving and processing a broadcast image that a user can view.

In addition, the multimedia device can display a broadcast selected by the user among the broadcast signals transmitted from the broadcasting station on the display.

Currently, broadcasting is changing from analog broadcasting to digital broadcasting around the world.

Here, digital broadcasting refers to a broadcasting for transmitting digital video and audio signals. Compared with analog broadcasting, digital broadcasting is strong against external noise and has a small data loss, is advantageous for error correction, has a high resolution, and provides a clear screen can do.

Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.

Recently, a multimedia device has been improved in performance and versatility in comparison with existing multimedia devices in order to use digital broadcasting, and various services available in multimedia devices such as Internet service, VOD (Video On Demand), and electronic album service are diversified .

The multimedia device may be equipped with a speech recognition engine to perform a user's command through the voice of the user. The voice guidance may be provided so that the user can easily and conveniently use the speech recognition engine.

The voice guide provides a variety of utterance guides for the user to voice commands.

For example, the voice guide, as a speech guide for search and recommendation, presents a representative speech such as finding a program name, searching for a movie title, searching for an actor name, and the like.

Therefore, if the user desires to find a program called Infinite Challenge, the user can change the program name to Infinite Challenge instead of finding the program name, which is an example of the utterance guide.

However, the existing speech guide can not provide various voice guide information to the user, and can reduce the interest in using the speech recognition engine because the speech guides shown in the example sentences do not reflect the latest trend and popular contents.

In addition, since the existing speech guide only shows one example of the representative speech, it can be mistaken to read the representative speech presented by the user equally.

That is, when a user wants to search for a predetermined program, the existing speech guide can induce false speech, just as it suggests a suggestion to find a program name, which is a representative speech presented in the voice guide.

In addition, existing voice guides provide UX (User experience) that is not friendly to the user, so that there are problems that the user hurts interest and interest in using voice guidance.

SUMMARY OF THE INVENTION The present invention is directed to a multimedia device capable of generating a speech guide sentence using a keyword having a high priority and providing a voice guide that is friendly to a user, I want to provide a way to provide his voice guide.

According to another aspect of the present invention, there is provided a method of providing a voice guidance of a multimedia device, the method comprising: collecting content-related keywords and input search keywords displayed on a screen of the multimedia device; Determining a priority of the stored keywords for each item; generating a speech sentence for each item using a keyword having the highest priority for each item; And displaying the information.

The multimedia device according to an embodiment of the present invention includes a communication module for receiving contents, a storage module for storing received contents, a display module for displaying contents, and a controller for controlling operation of the multimedia device The controller collects content-related keywords and input search keywords displayed on the display module, classifies the collected keywords according to items, stores them in the storage module, determines the priority of stored keywords for each item, The utterance sentence for each item can be generated using the highest priority keyword, and the voice guide provided with the generated utterance sentences can be displayed on the display module.

According to an embodiment of the present invention, a speech guide sentence of a voice guide is generated by using a keyword having a high priority, thereby providing a voice guidance that is friendly to a user, thereby inducing voice commands of a user.

Further, the present invention exposes the keyword used by the user himself / herself and generates a speech tag of the voice guide, so that the interest and friendliness of the speech recognition function can be enhanced.

Further, the present invention has the effect of exposing the latest trend and the help sentence reflecting the popularity, thereby increasing the satisfaction of the content search by the user.

Next, the present invention has the effect of minimizing the maintenance cost since it is unnecessary to update the voice guide.

Next, the present invention exposes the content being watched by the user, the genre of the content having the retrieved experience, the actor and the related contents by using the contents details of the EPG and the search server, The guide can be exposed to maximize the use induction.

1 is a view schematically showing a broadcasting system including a multimedia apparatus according to the present invention;
2 is a block diagram illustrating the multimedia device of FIG.
FIG. 3 is a block diagram showing the control unit shown in FIG. 2 in more detail;
4 is a view schematically showing an appearance of a remote controller according to an embodiment of the present invention;
5 is a block diagram showing in detail the components of the remote controller shown in FIG.
6 is a block diagram illustrating in detail a configuration module of a multimedia device according to another embodiment of the present invention.
7 is a view showing a speech sentence of a voice guide provided on a screen on which content is displayed
8 is a view showing a voice guide according to the first embodiment of the present invention
9 is a view showing a voice guide according to a second embodiment of the present invention
10 is a view showing a voice guide according to the third embodiment of the present invention
11 is a view showing a voice guide according to a fourth embodiment of the present invention
12 is a view showing a voice guide according to a fifth embodiment of the present invention
13 is a view showing a voice guide according to a sixth embodiment of the present invention
14 is a schematic view for explaining a method of providing a voice guide of a multimedia device according to an embodiment of the present invention
15 and 16 are flowcharts for explaining a method of providing a voice guide in a multimedia device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for ease of description, and the" module "and" part "

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. In addition, in certain cases, there may be a term arbitrarily selected by the applicant, in which case the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

Meanwhile, the multimedia device described in this specification is an intelligent multimedia device that adds a computer support function to a broadcast reception function, for example, and is equipped with an Internet function while being faithful to a broadcast reception function. The multimedia device includes a handwriting input device, A remote control device, and the like.

In addition, a wired or wireless Internet function can be connected to the Internet and a computer to perform functions such as e-mail, web browsing, banking, or games. A standardized general-purpose OS can be used for these various functions.

Therefore, the multimedia device described in the present invention can freely add or delete various applications, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed.

More specifically, the multimedia device may be, for example, a network TV, an HBBTV, a smart TV, or the like, and may be applicable to a smartphone in some cases.

1 is a schematic view of a broadcasting system including a multimedia device according to the present invention.

1, a broadcasting system including a multimedia device includes a content provider (CP) 10, a service provider (SP) 20, a network provider (NP) 30 and HNED 40, respectively.

Here, the HNED 40 may correspond to the client 100, which is a multimedia device, and the client 100 corresponds to a multimedia device, and the multimedia device may be, for example, a network TV, a smart TV, an IPTV,

Then, the content provider 10 can produce and provide various contents.

Here, the content provider 10 may include a terrestrial broadcaster, a cable SO (System Operator) or an MSO (Multiple System Operator), a satellite broadcaster, an Internet broadcast sender Internet broadcaster).

In addition, the content provider 10 may provide various applications in addition to the broadcast content.

Then, the service provider 20 can provide the contents provided by the contents provider 10 in a service package.

For example, the service provider 20 can package the first terrestrial broadcast, the second terrestrial broadcast, the cable MSO, the satellite broadcast, various Internet broadcasts, applications, and the like to provide the package to the user.

Meanwhile, the service provider 20 can provide a service to the client 100 using a unicast or multicast method.

Here, the unicast method is a method of transmitting data 1: 1 between one sender and one receiver.

For example, in a unicast method, when a receiver requests data from a server, the server can transmit data to the receiver upon request.

The multicast method is a method of transmitting data to a plurality of receivers of a specific group.

For example, the server can transmit data to a plurality of receivers registered in advance. An Internet Group Management Protocol (IGMP) protocol can be used for multicast registration.

Next, the network provider 30 may provide a network for providing services to the client 100.

Here, the client 100 may be provided with a service by building a home network end user (HNED).

The broadcast system including the multimedia device may be used as conditional access or content protection as a means for protecting transmitted contents.

As an example of such restriction reception or content protection, a scheme such as a cable card (CableCARD) and a DCAS (Downloadable Conditional Access System) may be used.

On the other hand, the client 100 may also be able to provide the content through the network. In this case, conversely, conversely, the client 100 may be a content provider, And may receive the content from the mobile terminal 100.

In this case, there is an advantage that an interactive content service or a data service is possible.

FIG. 2 is a block diagram illustrating the multimedia device of FIG. 1. FIG.

2, the multimedia device 100 includes a broadcast receiving unit 105, an external device interface unit 135, a storage unit 140, a user interface unit 150, a control unit 170, a display unit 180, an audio output unit 185, and a power supply unit 190.

Here, the broadcast receiver 105 may include a tuner 110, a demodulator 120, and a network interface 130.

Of course, the tuner 110 and the demodulator 120 may be provided, but the network interface 130 may not be included. Alternatively, the tuner 110 and the demodulator 120 may be included, It is also possible to design the demodulation unit 120 not to include it.

At this time, the tuner 110 can select an RF broadcast signal corresponding to a channel selected by the user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through the antenna, Frequency signal or a baseband image or a voice signal.

The tuner 110 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Next, the demodulation unit 120 can output the stream signal TS after demodulation and channel decoding.

The stream signal output from the demodulation unit 120 may be input to the control unit 170. The control unit 170 may perform demultiplexing and video / And output audio to the audio output unit 185. [

Next, the external device interface unit 135 can connect the multimedia device 100 with the external device.

The external device interface unit 135 may be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook)

The external device interface unit 135 can transmit external video, audio, or data signals to the control unit 170 of the multimedia device 100 through the connected external device, Video, audio, or data signals to the connected external device.

To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

Here, the A / V input / output unit includes a USB terminal, a Composite Video Banking Sync (CVBS) terminal, a component terminal, an S-video terminal (analog) A DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices.

Next, the multimedia device 100 may be a Bluetooth (registered trademark), a radio frequency identification (RFID), an infrared data association (IrDA), an ultra wideband (UWB), a ZigBee, Alliance), and the like.

Also, the external device interface unit 135 may be connected to the various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

The network interface unit 130 may provide an interface for connecting the multimedia device 100 to a wired / wireless network including the Internet network. The network interface unit 130 may connect the wired network to the wired / For example, a WLAN (Wireless LAN) (Wi-Fi), a Wibro (Wireless broadband), a Wimax (World Interoperability for Microwave Access (HSDPA), and High Speed Downlink Packet Access (HSDPA) communication standards.

The network interface unit 130 can then transmit or receive data to another user or another electronic device via the network to which it is connected or another network linked to the connected network.

Next, the storage unit 140 may store a program for each signal processing and control in the control unit 170, or may store a signal-processed video, audio, or data signal.

The storage unit 140 may perform a function of temporarily storing video, audio, or data signals input from the external device interface unit 135 or the network interface unit 130, May store information on a predetermined broadcast channel through a channel memory function.

Here, the storage unit 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD Or XD memory), RAM, ROM (EEPROM, etc.), and the like.

The multimedia device 100 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

FIG. 2 illustrates an embodiment in which the storage unit 140 is provided separately from the controller 170, but the present invention is not limited thereto. The storage unit 140 may be included in the controller 170. FIG.

The user interface unit 150 may transmit a signal input by the user to the control unit 170 or may transmit a signal from the control unit 170 to the user.

For example, the user interface unit 150 may be configured to turn on / off the power, select the channel, and set the screen from the remote control device 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared And the gesture and voice input through the remote control device 200 or may transmit the control signal from the control unit 170 to the remote control device 200. [

Also, for example, the user interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170.

The user interface unit 150 may receive or process a cursor display signal for displaying a cursor on the screen from the remote control device 200 or may transmit the signal to the control unit 170. [

Next, the control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110 or the demodulation unit 120 or the external device interface unit 135 to output video or audio output And generate and output a signal for output.

The video signal processed by the controller 170 is input to the display unit 180 and can be displayed as an image corresponding to the video signal.

The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed in the control unit 170 may be output to the audio output unit 185 and the audio signal processed in the control unit 170 may be input to the external output device through the external device interface unit 135 .

The control unit 170 collects content-related keywords and input search keywords displayed on the display unit 180, classifies the collected keywords according to items, stores the classified keywords in the storage unit 140, Ranking can be determined for each item, the utterance sentence for each item can be generated using the highest priority keyword for each item, and the voice guide provided with the generated utterance sentences can be displayed on the display unit 180 .

Here, when collecting the content related keywords and the input search keywords, the controller 170 may further collect the extended keywords for the content related keywords and the extended keywords for the search keywords.

In some cases, when collecting the content related keywords and the input search keywords, the controller 170 analyzes the voice characteristics of the received user when the voice command of the user is received, It can also be collected.

Next, when determining the priority of the stored keywords, the control unit 170 determines whether or not the keyword is included in the keyword according to at least one of the search frequency, the popularity degree, the latest degree, the exposure time, Can be determined.

In other cases, when the priority of the stored keywords is determined for each item, the control unit 170 sets the priority of the keyword for each item according to at least one of the search frequency, popularity degree, latest degree, and exposure time of the keyword And secondarily determine the priority of the first determined keyword according to the voice characteristic of the user.

In addition, when one of the uttered sentences in the voice guide is selected, the control unit 170 generates a help sentence corresponding to the selected utterance sentence and displays it on the display unit 180.

The control unit 170 provides the speech guide with a previous speech history including the previous speech sentences of the user and recognizes one of the user's previous speech sentences as the speech command of the user when the speech sentence is selected And execute commands related to the selected spoken sentence.

In some cases, the control unit 170 provides a previous speech history including the user's previous speech sentences on the displayed content, and when one of the user's previous speech sentences is selected, And can execute a command related to the selected spoken sentence.

Next, the display unit 180 converts the video signal, the data signal, the OSD signal processed by the control unit 170, the video signal and the data signal received from the external device interface unit 135 into R, G, and B signals, respectively And generates a driving signal.

Then, the audio output unit 185 receives a signal processed by the control unit 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as a voice. The voice output unit 185 may be implemented by various types of speakers.

Next, the power supply unit 190 may supply the corresponding power supply throughout the multimedia device 100. [

The remote control device 200 is a device for transmitting a user input to the user interface unit 150 such as a cursor display input or the like. The remote control device 200 may be Bluetooth, RF (Radio Frequency) communication, infrared (IR) (Ultra Wideband), ZigBee (ZigBee) or the like.

Also, the remote control device 200 may receive the video, audio, or data signal output from the user interface unit 150 and display it on the remote control device 200 or output sound or vibration.

In this way, the multimedia device 100 configured as described above can be used as a fixed digital broadcast of the ATSC system (8-VSB system), digital broadcast of the DVB-T system (COFDM system), digital broadcast of the ISDB- Broadcasting, and the like.

The multimedia device 100 does not include the tuner 110 and the demodulation unit 120 shown in FIG. 2 and transmits the image contents < RTI ID = 0.0 > And reproduce it.

The multimedia device 100 is a video signal processing apparatus that performs signal processing of an image stored in a device or an input image. The multimedia device 100 includes a display unit 180 and an audio output unit 185, A box, a DVD player, a Blu-ray player, a game machine, a computer, and the like.

FIG. 3 is a block diagram showing the control unit shown in FIG. 2 in more detail.

3, the control unit 306 of the multimedia apparatus includes a demultiplexing unit 310, an image processing unit 320, an OSD generating unit 340, a mixer 350, a frame rate converting unit 355, A formatter 360, and the like.

It is also within the scope of the present invention to further design a voice processing unit (not shown) and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream, for example, when an MPEG-2 TS is input, demultiplexes it into video, audio, and data signals, respectively.

The image processing unit 320 may include a video decoder 325 and a scaler 335. The video decoder 325 may be connected to the video decoder 325 and the scaler 335,

Next, the video decoder 325 decodes the demultiplexed video signal. The scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the video output unit, and the video processor 320 Is input to the mixer 350. The mixer 350 mixes the video signal and the video signal.

The OSD generating unit 340 generates an OSD signal according to a user input or by itself.

Accordingly, the mixer 350 can mix the OSD signal generated by the OSD generating unit 340 and the decoded video signal processed by the image processing unit 320.

The mixed signal is supplied to the formatter 360. The OSD is overlaid on the broadcast image or the external input image because the decoded broadcast image signal or the external input signal and the OSD signal are mixed.

Next, a frame rate converter (FRC) 355 can convert the frame rate of an input image. For example, the frame rate converter 605 converts a frame rate of 60 Hz to 120 Hz or 240 Hz.

The formatter 360 receives the output signal of the frame rate conversion unit 355 and changes the format of the signal so as to be suitable for the video output unit. For example, the formatter 360 outputs the R, G, and B data signals And these R, G, and B data signals may be output as low voltage differential signaling (LVDS) or mini-LVDS.

Particularly, the following description will be given in connection with the embodiment of the present invention.

An OSD for selecting an electronic device and a function to be controlled by the remote controller according to an embodiment of the present invention is generated by the OSD generation unit 340 described above.

The mixer 350 described above is additionally designed to make the general broadcast screen and the OSD overlaid.

4 is a view schematically showing an appearance of a remote controller according to an embodiment of the present invention.

A pointer 401 corresponding to the movement of the remote controller 410 is displayed on the screen of the multimedia device 400 as shown in FIG.

The user can move or rotate the remote controller 410 left and right (FIG. 4 (b)) or up and down (FIG. 4 (c)).

Since the pointer 401 is moved and displayed according to the movement in the 3D space, the remote controller 410 may be referred to as a spatial remote controller.

4B, when the user moves the remote controller 410 to the left, the pointer 401 displayed on the screen of the multimedia device 400 also moves to the left.

Information on the motion of the remote controller 410 sensed through the sensor of the remote controller 410 is transmitted to the multimedia device 400. The multimedia device 400 receives information on the motion of the remote controller 410 And the multimedia device 400 can display the pointer 401 so as to correspond to the calculated coordinates.

4 (c), when the user moves the remote controller 410 downward, the pointer 401 displayed on the screen of the multimedia device 400 also moves downward.

Therefore, it is possible to quickly select a specific area in the screen of the multimedia device 400 using the remote controller 410 according to an embodiment of the present invention.

5 is a detailed block diagram of the components of the remote controller shown in FIG.

5, the remote controller 510 includes a wireless communication unit 514, a user input unit 515, a sensor unit 517, an output unit 516, a power supply unit 511, a storage unit 512, And a control unit 513, and the like.

According to an embodiment of the present invention, the RF module 514a is designed to perform data communication with the multimedia device 500, and the IR Module 514b is designed to allow infrared communication with external electronic device 530 (e.g., STB).

Accordingly, it is possible to implement the remote controller 510 to perform the role of a repeater for forwarding the IR infrared code value received from the multimedia device 500 to the STB 530.

Further, according to an embodiment of the present invention, the remote controller 510 transmits a signal containing information on the motion of the remote controller 510 to the multimedia device 500 through the RF module 514a.

The remote controller 510 can receive a signal transmitted by the multimedia device 500 through the RF module 514a and the remote controller 510 can receive the multimedia device 500 via the IR module 514b 500, the power on / off, channel change, volume change, and the like.

The user input unit 515 may be a keypad, a button, a touchpad, a touch screen, or the like.

Next, the sensor unit 517 may include a gyro sensor 517a or an acceleration sensor 517b.

Here, the gyro sensor 517a may sense information about the motion of the remote controller 510. For example, the gyro sensor 517a may acquire information about the operation of the remote controller 510 on the x, y, and z axes It is possible to sense by reference.

The acceleration sensor 517b can sense information on the moving speed of the remote controller 510 and the like.

In some cases, a distance measuring sensor can be further provided, thereby enabling the distance to the multimedia device 500 to be sensed.

The output unit 516 may output an image or a voice signal corresponding to an operation of the user input unit 515 or a signal transmitted from the multimedia device 500. For example, An LED module 516a1 that is turned on when the input unit 5155 is operated or a signal is transmitted and received with the multimedia device 500 through the wireless communication unit 514, a vibration module 516b that generates vibration, and an audio output module 516c, or a display module 516d that outputs an image.

Next, the power supply unit 511 supplies power to the respective components of the remote controller 510. When the remote controller 510 does not move for a predetermined time, the power supply unit 511 stops power supply, Can be reduced.

The storage unit 512 may store various kinds of programs and application data required for the control or operation of the remote controller 510 and the control unit 513 may store various items related to the control of the remote controller 510 .

For example, the control unit 513 sends a signal corresponding to a predetermined key operation of the user input unit 515 or a signal corresponding to the motion of the remote controller 510 sensed by the sensor unit 517 to the wireless communication unit 514 To the multimedia device 500 or to the STB 530 via the network.

6 is a detailed block diagram of a configuration module of a multimedia device according to another embodiment of the present invention.

1 to 5, it is possible to add or change some of the modules of the multimedia apparatus of Fig. 6, and the scope of the present invention is not determined by the elements described in Figs. 1 to 5 and the like, But should be construed in accordance with what is stated in the claims.

6, the multimedia device 600 includes a controller 610, a communication module 620, a storage module 630, a display module 640, and the like.

Herein, the communication module 620 receives the content, the storage module 630 stores the received content, the display module 640 displays the content, and the controller 610 controls the multimedia device 600 Can be controlled.

At this time, the controller 610 may collect content related keywords and input search keywords displayed on the display module 640, classify the collected keywords by items, and store the classified keywords in the storage module 630.

The controller 610 determines the priority of the stored keywords for each item, generates a speech sentence for each item using the keyword having the highest priority for each item, and outputs the speech The guide can be displayed on the display module 640.

The controller 610 may further collect the extended keyword for the content related keyword and the extended keyword for the search keyword when collecting the content related keywords and the inputted search keywords.

That is, the content displayed on the display module 640 of the multimedia device may include a program currently being watched, a reserved program, a recorded program, and a content displayed by a search keyword.

Accordingly, the controller 610 may collect the content-related keywords and their extended keywords displayed on the display module 640, and collect the search keywords and the extended keywords thereof input to the display module 640.

Here, the controller 610 is connected to a plurality of external servers, and can collect various keywords from a plurality of external servers.

If the user's voice command is received, the controller 610 analyzes the voice characteristic of the received user to collect a recommended keyword corresponding to the voice characteristic of the user It can also be collected.

Here, the voice characteristics of the user may include the age, sex, and health status of the user.

Accordingly, the controller 610 may analyze the voice characteristics of the user, grasp the age range of the user, and collect keywords that are mainly interested or frequently used in the age range.

Optionally, the controller 610 may analyze the voice characteristics of the user, determine the gender of the user, and collect keywords that the male or female are primarily interested in or frequently using.

Alternatively, the controller 610 can analyze the voice characteristics of the user, grasp the health status of the user, collect the keywords that are mainly interested or frequently used by the user who is in good health or poor health have.

In addition, when the collected keywords are classified and stored by items, the collected keywords are classified into a channel name item, a channel number item, a content name item, a content genre item, a character name item, a search engine name item, And the like.

Here, each keyword can be redundantly stored in a plurality of items.

Each item is an item to be provided in the audio guide, and items provided to the audio guide may be different depending on creation and deletion of the item.

Next, the controller 610, when determining the priorities of the stored keywords on the basis of each item, searches for keywords according to at least one of the search frequency, popularity degree, latest degree, exposure time, Can be determined.

As described above, the controller 610 sets a ranking criterion such as a search frequency, a popularity degree, a latest degree, an exposure time, and a voice characteristic of a user of the keyword in advance and sets the priority of the keyword for each item You can decide.

Here, since the ranking criterion may vary according to the characteristics of the user, the multimedia device existing in each home may provide various speech utterances of the voice guide according to the characteristics of the user.

Thus, the speech guide can be provided differently for each assumption, depending on the characteristics of the user, the utterance sentences.

When determining the priority of the stored keywords, the controller 610 may set the priority of the keyword to 1 in accordance with at least one of the search frequency, popularity degree, latest degree, and exposure time of the keyword. And secondarily determine the priority of the first determined keyword according to the voice characteristic of the user again.

In this case, since the controller 610 determines the priority order twice, it is possible to generate a spoken sentence of the voice guide by using a keyword that is more friendly to the user.

Next, the controller 610 may generate a help sentence corresponding to the selected utterance sentence and display it on the display module 640 when one of the uttered sentences of the voice guide is selected.

In this case, the controller 610 can provide a convenient and easy environment in which the user can frequently use the voice recognition function of the multimedia device by inducing utterance to the user.

In addition, the controller 610 provides the speech guide with a previous speech history including the user's previous speech sentences, and when any one of the previous speech words of the user is selected, it is recognized as a voice command of the user You can also execute commands related to the selected spoken sentence.

That is, the controller 610 provides the utterance sentences previously used by the user, so that the user can perform commands of corresponding utterance sentences immediately with one selection without additional voice commands, can do.

Optionally, the controller 610 may provide a previous speech history containing the user's previous speech sentences over the displayed content, and if any one of the user's previous speech sentences is selected, And execute the selected spoken sentence related command.

Here, the controller 610 may directly provide the previous speech history on the screen of the content displayed on the display module 640. [

In this case, the user can activate the voice guide to view the previous speech history immediately on the screen on which the content is displayed, without viewing the previous speech history provided in the voice guide. Therefore, An utterance sentence included in the utterance history can be selected and the command can be inputted in the same manner as the voice command conveniently.

As described above, according to the present invention, by generating a spoken sentence of a voice guide using a keyword having a high priority, a voice instruction that is friendly to the user can be provided to guide the voice command of the user.

Further, according to the present invention, the keyword used by the user himself / herself is exposed, and the speech guide sentence is generated, so that the interest and friendliness of the speech recognition function can be enhanced.

In addition, the present invention exposes the latest trends and help sentences reflecting the popularity, thereby enhancing the user's satisfaction with the contents retrieval and minimizing the maintenance cost because the updating of the voice guide is unnecessary.

Next, the present invention exposes the content being watched by the user, the genre of the content having the retrieved experience, the actor and the related contents by using the contents details of the EPG and the search server, The guide can be exposed to maximize the induction of use.

7 is a diagram showing a speech sentence of a voice guide provided on a screen in which contents are displayed.

As shown in FIG. 7, when a user searches for predetermined content such as a broadcast program through a search application, the multimedia device 700 collects a user's search keyword, Can be collected through an external server.

Then, the multimedia device 700 classifies and stores the collected keywords according to items, determines the priority of the stored keywords for each item, and then uses the keyword having the highest priority for each item, And display the speech guide provided with the generated speech sentences.

7A, a user visits a predetermined content store 712 through a search application 710 of the multimedia device 700 to search for a broadcast program called a doctor alien, The user can input the search term 714 from the doctor-stranger 711 to search for the doctoral-related program contents 716.

In this case, the multimedia device 700 collects keywords related to broadcast program content, the doctor alien, classifies the keyword " Doctor alien " as a search and recommendation item, If it is high, the doctor uses the keyword "foreigner" to generate a spoken sentence.

7B, the multimedia device 700 may provide an audio guide 730 on the content when displaying predetermined content such as a search application 720 and the like. In the audio guide 730, The foreigner can display the sentence "Find a doctor stranger", which is the utterance sentence 734 generated using the keyword.

Further, in the voice guide 730, a help 732 for guiding a user's voice command and a microphone mark 736 for voice input are displayed.

Therefore, if the multimedia device 700 provides the user with a utterance sentence of "Find Doctor Aliens ", using the most recently searched Doctor alien, the user can search for the same doctor as the utterance sentence Enter a voice command or apply a utterance sentence to find a doctor or stranger, you can enter a voice command to find a movie.

As described above, the multimedia device 700 reflects the interest of the user and the latest popular trend in the voice guide by utilizing information such as a keyword, a popular keyword such as a web or a contents store, an EPG, etc. through a search application by a user, It is possible to induce the user to easily feel the convenience of the voice recognition function by appealing to the user.

In addition, the multimedia device 700 can increase the utilization of the speech recognition function through an immediate search function that replaces only a specific keyword, and a method of immediately exposing the previous search result without searching, in an example utterance sentence.

FIG. 8 is a view showing a voice guide according to a first embodiment of the present invention, and FIG. 9 is a view showing a voice guide according to a second embodiment of the present invention.

8, the multimedia device 800 provides a voice guide 810 to assist the user when using the voice recognition app, and the voice guide 810 includes a representative speech sentence for each item .

For example, when the user wants to use the voice recognition function and uses the voice guidance function, the multimedia device 800 transmits the voice guidance request signal through the remote control device, (810).

Here, the audio guide 810 may include a TV viewing item 822, a search and recommendation item 824, and an information item 826.

At this time, the TV viewing item 822 provides various utterance sentences 832 such as channel up / down, volume up / down, previous channel, sound on / off, setting, channel name, channel number, instant recording, .

The search and recommendation items 824 are provided by the search words 834, such as searching for a search word in the search engine, searching for a program name, searching for a movie title, finding an actor name, and searching for a content name on YouTube .

Also, the information item 826 is provided with utterance sentences 836 such as showing the weather today, showing headline news, informing a baseball game, informing LGE stock prices, and the like.

The multimedia device 800 of FIG. 8 provides only the main speech sentence of "channel name" in the channel name sub-item in the TV viewing item 822 and the speech sentence of the channel number sub- Only the main spoken sentence is provided.

In addition, the multimedia device 800 may be configured such that, in the search and recommendation item 824, the utterance sentence of the search engine sub-item is provided only with a representative utterance sentence called "search engine ", and the utterance sentence of the search word sub- Only the main spoken sentence is provided, and only the representative spoken sentence of "program name" is provided in the spoken sentence of the program name sub-item, and the spoken sentence of the movie title sub-item is provided only the representative spoken sentence " The actor name sub-item is provided with only the main spoken sentence "actor name", and the spoken sentence of the content name sub-item is provided with only the main spoken sentence "content name".

In the voice guide 810, a help 842 for guiding a voice command of the user and a microphone mark 844 for voice input are displayed.

8 provides only a representative speech phrase to the voice guide 810 while the multimedia device 900 of FIGURE 9 provides the voice guide 910 with the user's interests and the latest popular trends Are provided to provide user-friendly utterance sentences.

As shown in Fig. 9, the audio guide 910 may include a TV viewing item 922, a search and recommendation item 924, and an information item 926. Fig.

At this time, the TV viewing item 922 displays a variety of utterance sentences 932 such as channel up / down, volume up / down, previous channel, sound on / off, setting, SBS 6-1, instant recording, .

In addition, search and recommendation items (924) are provided with utterance sentences (934) such as finding a girl on Naver, finding a running man, finding a quantity, searching for a movie coming out of Jang Dong-gun, searching for a dance in Youtube .

Also, the information item 926 is provided with utterance sentences 936 such as showing today's weather, showing headline news, informing a baseball game, informing LGE's stock price, and the like.

The multimedia device 900 provides a speech sentence of "SBS" in the channel name sub-item and a speech sentence of "6-1" in the channel number sub- .

Here, the utterance sentence "SBS" and the utterance sentence "6-1 " are the channel names most recently used most frequently and may be channel numbers.

As described above, the multimedia device 900 collects keywords used by the user, determines a priority for each item based on the collected keywords, and generates a speech sentence according to the priority, and provides the speech guide to the speech guide.

Accordingly, the utterance sentences provided in the voice guide of Fig. 9 may be utterance sentences reflecting the user's interests and the latest popular trends.

In addition, the multimedia device 900 may provide a keyword having the highest priority of "Naver " among the keywords of the search engine sub-item in the search and recommendation item 924 as an utterance sentence, , A keyword having the highest priority of "Girl's Day" is provided as a spoken sentence. Among the keywords of the program name sub-item, a keyword having the highest priority of "running man" is provided as a spoken sentence, Among the keywords of the item, a keyword having the highest priority of "quality" is provided as a spoken sentence. Among the keywords of the actor name sub-item, a keyword having the highest priority of "Jang Dong Gun" Among the keywords of the name sub-item, a keyword having the highest priority called " cy-dance "is provided as a spoken sentence.

Accordingly, since the keyword used by the user himself / herself is provided as a spoken sentence of the voice guide, the user has an interest in and familiarity with the voice recognition function, and the satisfaction of the content search is high.

Therefore, the present invention can minimize the maintenance cost since it is unnecessary to periodically update the spoken sentence of the voice guide.

FIG. 10 is a view showing a voice guide according to a third embodiment of the present invention, and FIG. 11 is a view showing a voice guide according to a fourth embodiment of the present invention.

As shown in FIG. 10, the multimedia device provides a voice guide 1010 to assist the user when using the voice recognition app, and can provide a representative voice message for each item in the voice guide 1010 have.

For example, when the user wants to use the voice recognition function, the user may transmit the voice guidance request signal via the remote control device. In this case, Can be displayed.

Here, the audio guide 1010 may include TV viewing items, search and recommendation items, and information items.

In the voice guide 1010, a help 1030 for guiding a voice command of the user is displayed.

At this time, the TV viewing item provides various utterance sentences 1020 such as channel up / down, volume up / down, previous channel, sound on / off, setting, channel name, channel number, instant recording,

In addition, search and recommendation items are provided with utterance sentences (1020) such as a search engine search word, a program name search, a movie title search, an actor name search, and a content name search on YouTube.

In addition, the information items are provided with utterance sentences (1020) such as showing the weather today, showing headline news, reporting baseball games, and informing LGE stock prices.

The speech guide 1010 providing the utterance sentences 1020 corresponds to the selected utterance sentence 1020 when one of the utterance sentences 1020 of the voice guide 1010 is selected (1030) sentence can be generated and displayed.

For example, as shown in FIG. 10, when the user selects the utterance sentence "Search program name" in the search and recommendation items, the help 1030 of the voice guide 1010 is a half sentence corresponding to the corresponding utterance sentence For example, by providing a sentence such as "Which program should be searched, press a voice key and say a desired sentence ", the user can induce utterance.

Accordingly, the user speaks the desired program name in voice command in response to the help 1030, so that the multimedia device can find the user's program in accordance with the voice command and provide the corresponding program content .

11, the audio guide 1110 may include TV viewing items, search and recommendation items, and information items.

In the voice guide 1110, a help 1130 for guiding a voice command of the user is displayed.

At this time, the TV viewing item provides various utterance sentences 1120 such as channel up / down, volume up / down, previous channel, sound on / off, setting, SBS 6-1, instant recording, stop recording .

In addition, search and recommendation items are provided in the firing sentences (1120) such as searching for Girls Day on Naver, finding a running man, searching for a song, searching for a movie coming out of Jang Dong Gun, searching for a dance in Youtube, and so on.

Also, the information items are provided with utterance sentences 1120, such as showing the weather today, showing headline news, informing a baseball game, informing LGE stock prices, and the like.

The speech guide 1110 providing the utterance sentences 1120 corresponds to the selected utterance sentence 1120 when one of the utterance sentences 1120 of the voice guide 1110 is selected (1130) sentence can be generated and displayed.

For example, as shown in FIG. 11, when the user selects the utterance sentence "search for running man" in the search and recommendation items, the help 1130 of the voice guide 1110 is a half sentence corresponding to the corresponding utterance sentence For example, by providing a sentence such as "How many times do you want to search the running man, press the voice key and tell the desired sentence ", the user can induce utterance.

Accordingly, the user speaks the turn of the running man program desired by himself / herself in response to the help 1130, so that the multimedia device finds the user's program in accordance with the voice command and provides the corresponding program content can do.

FIG. 12 is a view showing a voice guide according to a fifth embodiment of the present invention, and FIG. 13 is a view showing a voice guide according to the sixth embodiment of the present invention.

As shown in Fig. 12, the multimedia device provides a voice guide 1210 to help the user when using the voice recognition app, and can provide a representative voice message for each item in the voice guide 1210 have.

For example, when the user wants to use the voice recognition function and wants the voice guidance function, the multimedia device transmits the voice guidance request signal through the remote control device, Can be displayed.

Here, the audio guide 1210 may include TV viewing items, search and recommendation items, and information items.

At this time, the TV viewing item provides various utterance sentences such as channel up / down, volume up / down, previous channel, sound on / off, setting, SBS, 6-1, instant recording, stop recording.

And, search and recommendation items are being provided such as finding a girl on Naver, finding a running man, finding a quantity, searching for a movie coming out of Jang Dong - gun, searching for a dance in Youtube, etc.

In addition, the information items are provided with utterance sentences such as showing the weather today, showing headline news, telling a baseball game, and telling LG's stock price.

These audio guides 1210, which provide firing sentences, may provide a previous firing history 1220 that includes the user's previous firing sentences.

When the user selects one of the previous utterance sentences, the multimedia device recognizes the uttered utterance as a voice command of the user and executes the selected utterance related command.

Here, the previous speech history 1220 may include at least one previous speech sentence, control key information of a remote control device for selecting a previous speech sentence, and the like.

12, based on the control key information of the remote control device provided to the previous speech history 1220 of the voice guide 1210, the user can select, from among the previous speech sentences, an utterance sentence " The multimedia device recognizes the user as a voice command to find an infinite challenge, finds the program content as an infinite challenge, and provides contents related to the infinite challenge program have.

13, the multimedia device may provide an audio guide on the content when displaying predetermined content such as the search application 1310 or the like as shown in FIG. 13, Quot; headline news show ", which is a spoken sentence 1330, can be displayed.

In addition, a help guide for guiding a voice command of the user and a microphone mark for voice input are displayed on the voice guide. The microphone indicator is superimposed on the search application 1310 on one side of the voice guidance. The voice guidance includes a previous speech history 1320 ). &Lt; / RTI >

Here, the previous speech history 1320 may include at least one previous speech sentence, control key information of a remote control device for selecting a previous speech sentence, and the like.

13, based on the control key information of the remote control device provided to the previous speech history 1320 of the voice guide, the user selects the utterance sentence "find infinite challenge" among the previous utterance sentences When the left direction key of the remote control device is pressed once, the multimedia device recognizes the user's voice command to find an infinite challenge, and the infinite challenge can find the broadcast program content and provide the infinite challenge program related contents.

As described above, the multimedia device utilizes the information such as the keyword that has been searched through the search application, the popular keyword such as the web or the content store, the EPG, etc. to reflect the interest of the user and the latest trend in the voice guide, It is possible to induce the user to easily feel the convenience of the voice recognition function.

In addition, the multimedia device can increase the utilization of the speech recognition function through an immediate search function that replaces only a specific keyword, and a method that immediately exposes the previous search result without searching, in an example speech phrase.

14 is a schematic diagram for explaining a method of providing a voice guide of a multimedia device according to an embodiment of the present invention.

14, when the user searches for a program called infinite challenge in the content store 1410, the multimedia device confirms whether the search result is one or more (S10). (S13)

Then, if the search result is one or more, it is possible to store the search keywords by classifying the keyword " Infinite Challenge " and the related extended keywords, for example, characters in the infinite challenge, into a content title, )

If the number of search results is one or less, keywords having low importance can be ignored because the keywords have low importance.

As described above, the multimedia device can classify, store, and store the corresponding search keyword and its related extended keywords for each item whenever the user searches for the item.

Next, when the user executes speech recognition and inputs a voice command through the speech recognition application 1420, the multimedia apparatus displays the title of the program currently being watched, the program scheduled to be watched, the program recorded, etc. (S19), requests the user to search for the keywords retrieved from the external server, and collects additional information and keywords such as title, genre, actor, and related contents from the keywords . (S21)

In addition, the multimedia device analyzes the tone of the user and analyzes the characteristics of the user such as age, sex, and health condition to generate the recommended keywords (S23)

Then, the multimedia device can classify and store the collected keywords by items through the keyword generation module 1430, and transmit the keywords corresponding to the request (S25)

The multimedia device can determine the exposure priorities of the keywords based on the retrieval frequency, popularity, age and sex of the collected keywords through the voice recognition application 1420. (S27)

Next, the multimedia device can generate a speech sentence for each item such as a person's name, a genre, a title, and the like, and provide the generated speech to the user through the speech guide (S29)

15 and 16 are flowcharts for explaining a method of providing a voice guide of a multimedia device according to an embodiment of the present invention.

15 and 16, the multimedia device collects content-related keywords and input search keywords displayed on the screen of the multimedia device (S101)

Here, the multimedia device may collect the extended keyword for the content-related keyword and the extended keyword for the search keyword.

At this time, the content displayed on the screen of the multimedia device may include a program currently being viewed, a reserved program, a recorded program, and content displayed by the search keyword.

In some cases, the multimedia device may receive a voice command of the user, analyze the voice characteristics of the received user, and collect the recommended keywords according to the voice characteristics of the user.

Next, the multimedia device may classify and store the collected keywords by items (S103)

Here, when the collected keywords are classified and stored according to the items, the multimedia device stores the collected keywords in at least one of a channel name item, a channel number item, a content name item, a content genre item, a character name item, a search engine name item, It can be classified into any one item and stored.

At this time, each keyword can be redundantly stored in a plurality of items.

Then, the multimedia device may determine the priority of the stored keywords for each item (S105)

Here, when the priority of the stored keywords is determined for each item, the multimedia device sets priority of the keyword on the basis of at least one of the search frequency, popularity degree, latest degree, exposure time, and voice characteristic of the keyword Ranking can be determined.

As shown in FIG. 16, when determining the priority of each of the stored keywords, the multimedia device may search for keywords by keyword according to at least one of a search frequency, a popularity degree, a latest degree, (S1051), the priority of the keyword determined first may be determined secondarily according to the voice characteristic of the user. (S1052)

Here, the voice characteristic of the user may be at least one of the age, sex, and health state of the user.

Then, the multimedia device can generate the utterance sentence for each item by using the keyword having the highest priority for each item (S107)

Next, the multimedia device can display the voice guidance in which the generated utterance sentences are provided (S109)

Here, when displaying the voice guidance provided with the generated utterance sentences, the multimedia device generates a help sentence corresponding to the selected utterance sentence and generates a help sentence corresponding to the selected utterance sentence, You may.

In another case, the multimedia device provides a previous speech history including the user's previous speech sentences in the speech guide when displaying the speech guide provided with the generated speech sentences, If one speech sentence is selected, it may be recognized as a voice command of the user to perform a command related to the selected speech sentence.

In addition, the present invention exposes the latest trend and the help sentence reflecting the popularity, and the user can increase the satisfaction of content search.

Next, the present invention minimizes the maintenance cost because the update of the voice guide is unnecessary.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

600: Multimedia device
610: Controller
620: Communication module
630: storage module
640: Display module

Claims

A method of providing an audio guide of a multimedia device,
Collecting content related keywords displayed on a screen of the multimedia device and input search keywords;
Sorting the collected keywords by items and storing them;
Determining a priority of the stored keywords for each item;
Generating an utterance sentence for each item using a keyword having the highest priority for each item; And,
And displaying the voice guide provided with the generated utterance sentences. &Lt; Desc / Clms Page number 19 >

The method of claim 1, wherein the step of collecting content-related keywords and input search keywords displayed on the screen of the multimedia device comprises: collecting an extended keyword for the content related keyword and an extended keyword for the search keyword Wherein the voice guidance is provided to the multimedia device.

The multimedia device according to claim 1, wherein the content displayed on the screen of the multimedia device includes a currently viewed program, a reserved program, a recorded program, and content displayed by the search keyword How to provide a guide.

The method of claim 1, wherein the step of collecting content-related keywords and input search keywords displayed on the screen of the multimedia device includes receiving a voice command of the user, analyzing voice characteristics of the received user, And collecting the recommended keywords according to the voice characteristics.

5. The method of claim 4, wherein the voice characteristic of the user includes an age, a gender, and a health state of the user.

The method according to claim 1, wherein the step of classifying and storing the collected keywords by items comprises: storing the collected keywords as a channel name item, a channel number item, a content name item, a content genre item, a character name item, And the search term is classified and stored in at least one of the items.

The method as claimed in claim 6, wherein each keyword is redundantly stored in a plurality of items.

The method according to claim 1, wherein the step of determining the priorities of the stored keywords for each item further comprises the step of determining, based on at least one of a search frequency, a popularity degree, a latest degree, an exposure time, Wherein the priority of the keyword is determined based on the priority of the keyword.

The method according to claim 1, wherein the step of determining the priorities of the stored keywords for each item comprises the steps of: determining, based on at least one of a search frequency, a popularity degree, a latest degree, Priority is firstly determined,
Wherein the priority of the first determined keyword is secondarily determined according to the voice characteristic of the user.

10. The method of claim 9, wherein the voice characteristic of the user is at least one of an age, a gender, and a health state of the user.

2. The method of claim 1, wherein, in the step of displaying the voice guide provided with the generated utterance sentences,
And generating and displaying a help sentence corresponding to the selected utterance sentence when any one of the uttered sentences of the voice guide is selected and displaying the help sentence corresponding to the selected utterance sentence.

2. The method of claim 1, wherein, in the step of displaying the voice guide provided with the generated utterance sentences,
The speech guide providing a previous speech history comprising the user's previous speech sentences,
And when the user selects one of the previous utterance sentences, recognizes the utterance as the voice command of the user and executes the selected utterance related command.

In a multimedia device,
A communication module for receiving content;
A storage module for storing the received content;
A display module for displaying the contents; And
And a controller for controlling the operation of the multimedia device,
The controller comprising:
The display module collects content related keywords and input search keywords, classifies the collected keywords according to items, stores the classified keywords in the storage module, determines the priority of the stored keywords for each item, And generating the utterance sentence for each item using the highest priority keyword, and displaying the voice guide provided with the generated utterance sentences on the display module.

14. The apparatus of claim 13, wherein the controller further collects an extended keyword for the content related keyword and an extended keyword for the search keyword when collecting the content related keywords and the input search keywords Multimedia device.

14. The method of claim 13, wherein, in collecting the content-related keywords and the input search keywords, the controller analyzes the voice characteristics of the received user when the voice command of the user is received, And collects a recommended keyword.

14. The method according to claim 13, wherein, when the priority of the stored keywords is determined for each item, the controller searches for a priority of each keyword based on at least one of a search frequency, a popularity degree, a latest degree, Wherein the priority of the keyword is determined for each item.

14. The method of claim 13, wherein the controller, when determining the priority of the stored keywords for each item, further comprises a step of determining, based on at least one of a search frequency, a degree of popularity, The priority of the keyword is determined first,
And secondarily determines the priority of the keyword determined in accordance with the voice characteristic of the user.

14. The method according to claim 13, wherein the controller generates a help sentence corresponding to the selected speech sentence, when a speech sentence is selected from the speech guide sentences of the voice guide, and displays the generated help sentence on the display module Lt; / RTI >

14. The apparatus of claim 13, wherein the controller is further operable to provide the speech guide with a prior speech history comprising the user's previous speech sentences,
And when the user selects one of the previous utterance sentences, recognizes the utterance as the voice command of the user and executes the selected utterance related command.

14. The apparatus of claim 13, wherein the controller is further operable to provide, on the displayed content, a previous speech history comprising the user's previous speech sentences,
And when the user selects one of the previous utterance sentences, recognizes the utterance as the voice command of the user and executes the selected utterance related command.