KR20120046988A - Method and computer readable recording medium for controlling multimedia display device and voice recorder - Google Patents

Abstract

PURPOSE: An image display device controlling method is provided to rapidly control an image display device including various functions by a user voice. CONSTITUTION: A voice recognition device requests conversion of a text corresponding to a received voice to a server(S13). The voice recognition device requests the control information to the server(S15). The voice recognition unit obtains the control information(S16). The voice recognition device converts the obtained control information into an image display device and the control signal(S17).

Description

TECHNICAL AND COMPUTER READABLE RECORDING MEDIUM FOR CONTROLLING MULTIMEDIA DISPLAY DEVICE AND VOICE RECORDER}

The present invention relates to a method of controlling a video display device, and more particularly, to a video display device corresponding to a voice received from a peripheral device when a user desired function is transmitted as a voice through a peripheral device capable of recognizing a voice. The present invention relates to a method for controlling a video display device in such a manner that the control information is obtained and a remote controller controls the video display device.

The image display device is, for example, a device having a function of receiving and processing a broadcast image that a user can watch. The image display device displays, for example, a broadcast selected by a user on a display among broadcast signals transmitted from a broadcasting station. Currently, broadcasting is shifting from analog broadcasting to digital broadcasting worldwide.

Digital broadcasting refers to broadcasting for transmitting digital video and audio signals. Digital broadcasting is more resistant to external noise than analog broadcasting, so it has less data loss, is advantageous for error correction, has a higher resolution, and provides a clearer picture. In addition, unlike analog broadcasting, digital broadcasting is capable of bidirectional services.

Meanwhile, with the expansion of the bidirectional data transmission and reception function and the development of technology, the functions of the video display device have been diversified and complicated. As a result, the functions of the remote controller controlling the video display device have also been diversified. However, the method of using a remote controller is also complicated, and the situation of using a wide range of remote controllers is not properly used. In addition, most users of the video display device use only extremely limited functions such as power on / off, channel up / down, and volume up / down, so that the use of the video display device having various functions becomes practically meaningless.

The present invention provides a method of utilizing a peripheral device to more easily control a video display device that provides a complex and various functions.

The present invention connects a peripheral device that provides a voice recognition function and an image display device to control the image display device only by transmitting a voice of a user.

According to an embodiment of the present invention, a method of controlling an image display device using a voice recognition device includes: starting a voice control mode capable of controlling the image display device using a voice recognition device; Receiving a voice by the voice recognition device; Obtaining control information for controlling the image display device based on the received voice; Transmitting the control information to the video display device.

According to an aspect of the present invention, there is provided a voice recognition apparatus for controlling a video display device, the voice receiving unit receiving a voice when a voice control mode capable of controlling the video display device using the voice recognition device is started; A control unit obtaining control information for controlling the video display device based on the received voice; It includes a network interface for transmitting the control information to the video display device.

A method of controlling an image display device using a voice received from a voice recognition device according to the present invention includes: receiving a request for converting a voice and a text corresponding to the voice from the voice recognition device; Converting the speech into text; Transmitting the converted text; Retrieving control information for controlling the video display device upon receiving a request for control information based on the converted text; And transmitting the control information to the speech recognition apparatus.

In a computer-readable storage medium including a command code for controlling a video display device by using the voice recognition device according to the present invention, the command code is displayed by a control unit of the voice recognition device using a voice recognition device. Code for starting a voice control mode capable of controlling a device, receiving voice, obtaining control information for controlling the video display device based on the received voice, and transmitting the control information to the video display device It includes.

A computer-readable storage medium including command codes for controlling a video display device using a server that receives a voice from a voice recognition device according to the present invention, wherein the command code is controlled by the control unit of the server. Receiving a request to convert the voice and the text corresponding to the voice from the recognition device, converts the voice to text, transmits the converted text, and receives a request for control information based on the converted text, And code for retrieving control information for controlling the display device and transmitting the control information to the speech recognition apparatus.

According to the present invention, a video display device including complex and various functions can be easily and quickly controlled with only user voice.

According to the present invention, by controlling the video display device through a peripheral device that provides a voice recognition function such as a smart phone, it is possible to increase the utilization of the peripheral device.

1 is a view schematically showing an example of an entire broadcasting system including a video display device according to an embodiment of the present invention.
2 is a diagram schematically showing another example of an entire broadcasting system including a video display device according to another embodiment of the present invention.
FIG. 3 is a diagram illustrating a step in which the video display device illustrated in FIG. 1 or 2 receives channel information and the like by accessing a service provider.
4 is a diagram illustrating an example of data used in the steps illustrated in FIG. 3.
FIG. 5 illustrates an example of the image display apparatus shown in FIG. 1 or 2 in more detail.
6 is a diagram illustrating a system configuration of a method of controlling a video display device according to an exemplary embodiment.
7 is a block diagram illustrating a configuration of a video display device according to an embodiment of the present invention.
8 is a block diagram of a configuration of a speech recognition apparatus according to an embodiment of the present invention.
9 is a flowchart illustrating a method for controlling a video display device according to an embodiment of the present invention.
10 is a flowchart of a method of controlling a video display device according to an embodiment of the present invention.
11 illustrates a flow of data transmitted and received between an image display device, a voice recognition device, and a server according to an embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The suffix "module" and " part "for components used in the following description are given merely for ease of description, and the" module "and" part "

On the other hand, the video display device described in the present specification is, for example, an intelligent video display device that adds a computer support function to the broadcast reception function, and is faithful to the broadcast reception function, but the Internet function, etc. are added, the handwriting type input device, touch screen Or it can be equipped with a more convenient interface, such as a space remote control. In addition, by being connected to the Internet and a computer with the support of a wired or wireless Internet function, it is possible to perform functions such as e-mail, web browsing, banking or gaming. A standardized general-purpose OS can be used for these various functions.

Therefore, in the image display device described in the present invention, various applications can be freely added or deleted, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed. In more detail, the image display device may be, for example, a network TV, an HBBTV, a smart TV, or the like, and may be applicable to a smartphone in some cases.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. In addition, in certain cases, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in the corresponding description of the invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

1 is a view schematically showing an example of an entire broadcasting system including a video display device according to an embodiment of the present invention.

As shown in FIG. 1, an entire broadcasting system including a video display device according to an embodiment of the present invention includes a content provider (CP) 10, a service provider (SP) 20, It may be divided into a network provider (NP) 30 and an HNED 40. The HNED 40 corresponds to, for example, the client 100 which is a video display device according to an embodiment of the present invention. The client 100 corresponds to an image display device according to an embodiment of the present invention, and the image display device is, for example, a network TV, a smart TV, an IPTV, or the like.

The content provider 10 produces and provides various contents. As shown in FIG. 1, the content provider 10 includes a terrestrial broadcaster, a cable system operator or a multiple system operator, a satellite broadcaster, and an internet broadcaster. An internet broadcaster and the like can be exemplified.

The service provider 20 may provide a service package of contents provided by the content provider 10. For example, the service provider 20 of FIG. 1 may package and provide a first terrestrial broadcast, a second terrestrial broadcast, a cable MSO, satellite broadcast, various internet broadcasts, applications, and the like to a user.

Meanwhile, the service provider 20 may provide a service to the client 100 using a unicast or multicast scheme. The unicast method is a method of transmitting data 1: 1 between one sender and one receiver. For example, in the unicast method, when a receiver requests data from a server, the server may transmit data to the receiver according to the request. Multicasting is a method of transmitting data to a plurality of recipients of a specific group. For example, the server can send data to multiple pre-registered receivers at once. For such multicast registration, the Internet Group Management Protocol (IGMP) protocol may be used.

The network provider 30 may provide a network for providing a service to the client 100. The client 100 may establish a home network end user (HNED) to receive a service.

As a means for protecting the content transmitted from the video display device system, a conditional access or a content protection may be used. As one example for such a restriction reception or content protection, a scheme such as a cable card or a downloadable conditional access system (DCAS) may be used.

On the other hand, the client 100 can also provide content through the network. In this case, unlike the above, the client 100 may be a content provider, and the content provider 10 may receive content from the client 100. In the case of designing as described above, an interactive content service or a data service is possible.

2 is a diagram schematically showing another example of an entire broadcasting system including a video display device according to another embodiment of the present invention.

As shown in FIG. 2, the video display device 100 according to another embodiment of the present invention is connected to a broadcast network and an internet network. The image display device 100 is, for example, a network TV, a smart TV, an HBBTV, or the like.

In addition, the video display device 100 may include, for example, a broadcast interface 101, a section filter 102, an AIT filter 103, an application data processor 104, a broadcast data processor 111, and a media player 106. ), An internet protocol processor 107, an internet interface 108, and a runtime module 109.

Through the broadcast interface 101, application information table (AIT) data, real-time broadcast content, application data, and stream events are received. Meanwhile, the real-time broadcast content may be referred to as linear ave content (Linear A / V Content).

The section filter 102 performs section filtering on four pieces of data received through the broadcast interface 101 to transmit AIT data to the AIT filter 103, and the linear AV content is broadcast data processing unit 111. The stream event and the application data are transmitted to the application data processor 104.

On the other hand, through the Internet interface 108, non-linear AV content (Non-Linear A / V Content) and application data is received. The non-linear AV content may be, for example, a Content On Demand (COD) application.

The non-linear AV content is sent to a media player 106 and the application data is sent to a runtime module 109.

Further, the runtime module 109 includes, for example, an application manager and a browser as shown in FIG. 2. The application manager controls the life cycle for the interactive application using, for example, AIT data. The browser, for example, performs a function of displaying and processing the interactive application.

FIG. 3 is a diagram illustrating a step in which the video display device illustrated in FIG. 1 or 2 receives channel information and the like by accessing a service provider. Of course, Figure 3 is an embodiment, and the scope of the present invention is not limited only to the method of Figure 3.

The service provider performs a service provider discovery operation (S301). The video display device transmits an SP connection request signal (S302). When the SP connection is completed, the video display device receives provisioning information (S303). Furthermore, the video display device receives a master SI table from the service provider (S304), receives a Virtual Chnnanel Map table (S305), receives a Virtual Channel Description table (S306), and receives a Source table ( S307).

More detailed description is as follows.

The service provider discovery may refer to a process in which service providers providing services related to IPTV find a server providing information on their services.

There are three ways to find an address list that can receive information (eg, SP discovery information) about an SD (service discovery) server. First, an address set in the image display device or an address set by a user's manual operation may be used. Second, DHCP-based SP discovery can be used. Third, the DNS SRV-based SP discovery method may be used. In addition, the video display device accesses the server of the address obtained by any one of the above three methods, and receives a service provider discovery record containing information required for service discovery for each SP. And, using this, the service search step is performed. These processes are available in either push mode or pull mode.

Access the SP attachment server designated as the SP attachment locator of the SP discovery record and perform a registration procedure (or service attachment procedure).

Furthermore, after accessing the authentication service server of the SP designated as the SP authentication locator and performing a separate authentication procedure, a service authentication procedure may be performed.

Meanwhile, data transmitted from the server to the video display device after the service attachment procedure is successful may be in the form of provisioning information table.

In the service attachment process, the video display device includes its ID and location information in the data transmitted to the server, and the service attachment server may specify a service subscribed to by the video display device based on this. Furthermore, address information for obtaining service information that the video display device wants to receive is provided in the form of a provisioning information table. The address information corresponds to connection information of the master SI table. When using such a method, it is easy to provide a customized service for each subscriber.

The service information may include a master SI table record managing access information and a version of a virtual channel map, a virtual channel map table providing a list of services in a package form, and virtual channel description including detailed information of each channel. tables, and source tables that contain access information to access the actual services.

4 is a diagram illustrating an example of data used in the steps illustrated in FIG. 3.

FIG. 4 is a diagram showing FIG. 3 in more detail. Hereinafter, the relationship between the data in the SI will be described with reference to FIG. 4.

The Master SI table includes location information for receiving each virtual channel map and version information of each virtual channel map.

Each virtual channel map is uniquely identified by a virtual channel map identifier, and the virtual channel map version indicates version information of the virtual channel map. When any one of all tables connected in the direction of the arrow starting from the master SI table shown in FIG. 4 is changed, the version of all upper tables (up to the master SI table) increases with the version increase of the corresponding table. Therefore, by monitoring the master SI table, there is an advantage that can immediately see the change on the entire SI table.

For example, when a change occurs in the source table, the version of the source table increases, and the version of the virtual channel description table that references the source table also changes. Therefore, the change of the lower table causes the change of the upper table, and ultimately the version of the master SI table is changed.

There may be one Master SI table for each service provider. However, when the service configuration is different for each region or subscriber (or subscriber group), the service provider is designed to have a plurality of master SI tables to provide customized services for each unit. In this case, it is possible to efficiently provide a customized service according to the subscriber's region and subscription information through the master SI table.

The virtual channel map table may have one or more virtual channels, and does not include detailed information of the channels in the virtual channel map, but includes location information from which the detailed information may be obtained. The virtual channel description location of the virtual channel map table informs the location of the virtual channel description table including channel detail information.

The virtual channel description table includes detailed information of the virtual channel and can access the virtual channel desctiprion table using the virtual channel description location of the virtual channel map table.

The source table provides connection information (eg, IP address, port, AV codec, transmission protocol, etc.) necessary for accessing a real service by service.

The above-described master SI table, virtual channel map table, virtual channel description table, and source table are logically transmitted through four separate flows, and both a push mode and a pull mode are possible. Meanwhile, the master SI table may be transmitted by multicast for version management, and monitors version change by receiving a multicast stream.

FIG. 5 illustrates an example of the image display apparatus shown in FIG. 1 or 2 in more detail. 5 is only an example, and the scope of the present invention should be determined by the claims rather than the principles of FIG. 5.

The video display device 700 includes a network interface unit 701, a TCP / IP manager 702, a service delivery manager 703, and a demultiplexer (Demux). 705, PSIP and / or SI decoder 704, audio decoder 706, video decoder 707, display A / V and OSD module 708 , Service Control Manager (709), Service Discovery Manager (710), Metadata Manager (712), SI & Metadata DB (711), UI Manager (714), and Services Manager 713 and the like.

The network interface unit 701 receives packets received from the network and transmits the packets to the network. That is, the network interface unit 701 receives a service, content, and the like from a service provider through a network.

The TCP / IP manager 702 is involved in the packet transmission from the source to the destination for the packet received by the video display device 700 and the packet transmitted by the video display device 700. The TCP / IP manager 702 classifies the received packet to correspond to an appropriate protocol, and classifies the packet into a service delivery manager 705, a service discovery manager 710, a service control manager 709, and a metadata manager 712. Output the printed packet.

The service delivery manager 703 is responsible for controlling the received service data. For example, RTP / RTCP can be used to control real-time streaming data. When transmitting the real-time streaming data using the RTP, the service delivery manager 703 parses the received data packet according to the RTP and transmits it to the demultiplexer 705 or under the control of the service manager 713. Accordingly stored in the SI & Metadata DB (711). Then, the RTCP is used to feed back the network reception information to a server that provides a service.

The demultiplexer 705 demultiplexes the received packet into audio, video, program specific information (PSI) data, and the like, and transmits the demultiplexer 705 to the audio / video decoders 706 and 707 and the PSIP and / or SI decoder 704, respectively. do.

PSIP and / or SI Decoder 704 decodes service information such as, for example, Program Specific Information (PSI). That is, the PSIP and / or SI Decoder 704 receives and decodes the demultiplexed PSI section, the Program and Service Information Protocol (PSIP) section, or the Service Information (SI) section from the demultiplexer 705.

In addition, the PSIP and / or SI Decoder 704 decodes the received sections to create a database of service information, and stores the database of service information in the SI & Metadata DB 711.

An audio / video decoder 706/707 decodes the video data and the audio data received at the demultiplexer 705. The audio data decoded by the audio decoder 706 and the video data decoded by the video decoder 707 are provided to the user through the display unit 708.

The UI manager 714 and the service manager 713 manage the overall state of the video display device 700, provide a user interface, and manage other managers.

The UI manager 714 provides a Graphic User Interface (GUI) for a user by using an OSD (On Screen Display) and the like, and receives a key input from the user to perform a receiver operation according to the input. For example, upon receiving a key input related to channel selection from a user, the key input signal is transmitted to the service manager 713.

The service manager 713 controls a manager associated with a service, such as a service delivery manager 703, a service discovery manager 710, a service control manager 709, and a metadata manager 712.

In addition, the service manager 713 creates a channel map and selects a channel using the channel map according to a key input received from the user interface manager 714. The service manager 713 receives service information of a channel from a PSSI and / or SI Decoder 704 and sets an audio / video PID (packet identifier) of the selected channel to the demultiplexer 705.

The service discovery manager 710 provides information necessary for selecting a service provider providing a service. Upon receiving a signal for channel selection from the service manager 713, the service discovery manager 710 finds a service using the information.

The service control manager 709 is in charge of selecting and controlling a service. For example, if a user selects a live broadcasting service like the conventional broadcasting method, IGMP or RTSP is used. If a user selects a service such as VOD (Video On Demand), RTSP is used to select and control the service. Perform The RTSP protocol may provide a trick mode for real time streaming. In addition, the service control manager 709 may initialize and manage a session through the IMC gateway using an IP multimedia subsystem (IMS) or a session initiation protocol (SIP). The protocols are one embodiment, and other protocols may be used depending on implementation.

The metadata manager 712 manages metadata associated with the service and stores the metadata in the SI & Metadata DB 711.

The SI & Metadata DN 711 selects service information decoded by the PSIP and / or SI Decoder 704, metadata managed by the metadata manager 712, and service providers provided by the service discovery manager 710. Save the necessary information. In addition, the SI & Metadata DB 711 may store setup data for the system.

The SI & Metadata DB 711 may be implemented using nonvolatile memory (NVRAM) or flash memory.

The IG 750 may be a gateway that collects functions necessary for accessing an IMS-based IPTV service.

6 is a diagram illustrating an example of a system configuration for providing a video display device control method according to an embodiment of the present invention. Referring to FIG. 6, a system according to an embodiment of the present invention may include a video display device 100, a server 200, and a voice recognition device 300.

The video display device 100 may receive a control signal from the voice recognition apparatus 300 and operate according to the corresponding function. The image display device 100 may include an IR (infrared) processor or an RF (radio frequency) processor capable of receiving a specific radio frequency signal for data transmission and reception with the voice recognition apparatus 300.

 The video display device 100 may include a network TV, an HBBTV, a smart TV, an Internet TV, a personal PC, and a portable PC.

The server 200 may communicate with the voice recognition apparatus 300 through a network and include at least one of the above-described content provider, service provider, and network provider. In addition, the server 200 according to the present invention may be operated by a manufacturer of the video display device 100 as a separate entity for controlling the video display device through a voice recognition function.

The server 200 may include a voice recognition module to control the video display device according to the present invention. The server 200 may further include a keyword matching module for matching the converted text with control information of the video display device corresponding thereto. In the system shown in FIG. 1, although a single server 200 is connected to the speech recognition apparatus 300, a keyword matching server including a speech recognition server (not shown) including a speech recognition module and a keyword matching module (not shown) May be separately connected to the voice recognition apparatus 300. The speech recognition apparatus 300 may request text conversion by transmitting a voice received by the user to a speech recognition server, and request conversion of the converted text into corresponding control information by transmitting the converted text to a keyword matching server.

The voice recognition module may convert the input voice into text. The converted text may be configured in a format that can be exchanged between the speech recognition apparatus 300 and the server 100.

The keyword matching module may convert the converted text into control information for controlling the video display device corresponding thereto. The control information may include a keyword regarding a specific function capable of controlling the video display device. The keyword matching module may use a keyword database included in the server 100 to match the converted text with keywords related to a specific function. The keyword database may be composed of a set of control keywords according to the model of the video display device. In addition, the keyword matching module may be operated by a specific algorithm for searching the keyword database for control information corresponding to the converted text.

The speech recognition apparatus 300 may receive and store the voice transmitted from the user. The speech recognition apparatus 300 may transmit the received speech to the server 200 to request the text to be converted. In addition, the speech recognition apparatus 300 may request the server 200 to convert control information corresponding to the converted text. The voice recognition apparatus 300 may acquire the control information and transmit the control information to the video display device 100 as a control signal. In addition, the speech recognition apparatus 300 may include a signal processor that can convert control information into a control signal, for example, an IR processor and an RF processor.

The voice recognition apparatus 300 may be a device capable of receiving and storing voice, and may include a smart phone, a mobile phone, and a wired / wireless phone.

7 is a block diagram of a video display device 100 controlled according to a video display device control method according to the present invention. Referring to FIG. 7, the image display device 100 according to an embodiment of the present invention may include a network interface unit 105, an external device interface unit 135, a storage unit 140, a user interface unit 150, The controller 170 may include a display unit 180 and an audio output unit 185.

The broadcast receiver 105 may include a tuner (not shown), a demodulator (not shown), and a network module (not shown). Of course, if necessary, it is also possible to design the tuner and the demodulator without including the network module, and conversely, it is possible to design the network interface without the tuner and the demodulator.

The tuner selects an RF broadcast signal corresponding to a channel selected by a user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner can process both digital broadcast signals or analog broadcast signals. The analog baseband video or audio signal CVBS / SIF output from the tuner may be directly input to the controller 170.

In addition, the tuner may receive a single carrier RF broadcast signal according to the Advanced Television System Committee (ATSC) scheme or a multi-carrier RF broadcast signal according to the Digital Video Broadcasting (DVB) scheme.

The tuner may sequentially select RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna and convert the RF broadcast signals into intermediate frequency signals or baseband video or audio signals.

The demodulator receives a digital IF signal DIF converted by the tuner and performs a demodulation operation.

For example, when the digital IF signal output from the tuner is an ATSC scheme, the demodulator performs 8-VSB (8-Vestigal Side Band) demodulation, for example. In addition, the demodulator may perform channel decoding. To this end, the demodulator includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, and reed soloman decoding. Can be done.

For example, when the digital IF signal output from the tuner is a DVB scheme, the demodulator performs Coded Orthogonal Frequency Division Modulation (COFDMA) demodulation, for example. The demodulator may also perform channel decoding. To this end, the demodulator may include a convolution decoder, a deinterleaver, a reed-soloman decoder, and the like to perform convolutional decoding, deinterleaving, and reed soloman decoding.

The demodulator may output a stream signal TS after performing demodulation and channel decoding. In this case, the stream signal may be a signal multiplexed with a video signal, an audio signal, or a data signal. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

On the other hand, the demodulation unit described above can be provided separately according to the ATSC system and the DVB system. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulator may be input to the controller 170. After performing demultiplexing, image / audio signal processing, and the like, the controller 170 outputs an image to the display unit 180 and outputs an audio to the audio output unit 185.

The external device interface unit 135 may connect the external device to the image display device 100. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 135 may be connected to an external device such as a digital versatile disk (DVD), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), or the like by wire / wireless. The external device interface unit 135 transmits an externally input image, audio or data signal to the controller 170 of the image display device 100 through a connected external device. In addition, the controller 170 may output an image, audio, or data signal processed by the controller 170 to a connected external device. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

In addition, the external device interface unit 135 according to the present invention may receive a control signal from the voice recognition device 300 and transmit and receive data.

The A / V input / output unit may use a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), and a DVI to input video and audio signals from an external device to the video display device 100. (Digital Visual Interface) terminal, HDMI (High Definition Multimedia Interface) terminal, RGB terminal, D-SUB terminal and the like.

The wireless communication unit may perform short range wireless communication with a peripheral device such as the voice recognition device 300. The image display device 100 may include, for example, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Digital Living Network Alliance (DLNA). The voice recognition apparatus 300 may be network-connected according to a communication standard such as).

In addition, the external device interface unit 135 may be connected to various set top boxes and at least one of the various terminals described above to perform input / output operations with the set top box.

Meanwhile, the external device interface unit 135 may receive an application or a list of applications in a neighboring external device and transmit the received application or list to the controller 170 or the storage 140.

The external device interface unit 135 according to an embodiment of the present invention is configured to transmit / receive data with the voice recognition device 300, and may include Bluetooth, Radio Frequency Identification (RFID), infrared communication (IrDA), Communication modules such as ultra wideband (UWB), ZigBee (Digital Living Network Alliance), and the like may be included. In addition, data transmission and reception with the voice recognition device 300 may be performed by a wired method, and may be connected to the voice recognition device 300 through a wired LAN, a connection terminal, and a cable.

The network interface unit 105 provides an interface for connecting the video display device 100 to a wired / wireless network including an internet network. The network interface unit 130 may include, for example, an Ethernet terminal for connection with a wired network, and for example, for connection with a wireless network, for example, a wireless LAN (WLAN) (Wi-). Fi, Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, and the like can be used.

The network interface unit 105 may transmit or receive data with another user or another electronic device through the connected network or another network linked to the connected network. In particular, some content data stored in the image display apparatus 100 may be transmitted to a user selected from another user or another electronic apparatus registered in the image display apparatus 100 or a selected electronic apparatus.

On the other hand, the network interface unit 105 can access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through the network, it is possible to send or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 105 may select and receive a desired application from among applications that are open to the public through the network.

The storage 140 may store a program for processing and controlling each signal in the controller 170, or may store a signal processed video, audio, or data signal.

In addition, the storage 140 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface 135 or the network interface 130. In addition, the storage 140 may store information on a predetermined broadcast channel through a channel storage function.

In addition, the storage 140 may store an application or a list of applications input from the external device interface 135 or the network interface 130.

The storage unit 140 may be, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD). Memory, etc.), RAM, ROM (e.g., EEPROM, etc.) at least one type of storage medium. The video display device 100 may provide a user with a content file (video file, still image file, music file, document file, application file, etc.) stored in the storage 140.

7 illustrates an embodiment in which the storage unit 140 is provided separately from the control unit 170, but the scope of the present invention is not limited thereto. The storage unit 140 may be included in the control unit 170.

The user interface unit 150 transmits a signal input by the user to the controller 170 or transmits a signal from the controller 170 to the user.

For example, the user interface unit 150 may be powered on / off from a remote control device such as a remote controller according to various communication methods, such as a radio frequency (RF) communication method and an infrared (IR) communication method. Control signals such as selection and screen setting may be received and processed, or may be processed to transmit control signals from the controller 170 to the remote controller.

In addition, for example, the user interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170.

In addition, for example, the user interface unit 150 may transmit a control signal input from a sensing unit (not shown) that senses a user's gesture to the controller 170 or may transmit a signal from the controller 170. (Not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

In the above-described embodiment, the image display device 100 transmits / receives data to / from the voice recognition device 300 through the external device interface unit 135, but may transmit / receive data via the user interface unit 15. .

The user interface unit 150 according to the present invention may include an IR processor or an RF processor capable of communicating with the voice recognition apparatus 300. In addition, the user interface 150 may be a port setting for data transmission and reception with the voice recognition device.

The controller 170 may generate and output a signal for video or audio output by demultiplexing an input stream or processing demultiplexed signals through a tuner, a demodulator, or an external device interface.

The image signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the image signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. In addition, the voice signal processed by the controller 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 7, the controller 170 may include a demultiplexer, an image processor, and the like.

In addition, the controller 170 may control overall operations of the image display device 100. For example, the controller 170 may control the tuner to control selecting of an RF broadcast corresponding to a channel selected by a user or a pre-stored channel.

In addition, the controller 170 may control the image display device 100 by a user command or an internal program input through the user interface unit 150. In particular, the user may access the network to download the desired application or application list into the video display device 100.

For example, the controller 170 controls the tuner so that a signal of a selected channel is input according to a predetermined channel selection command received through the user interface 150. Then, video, audio, or data signals of the selected channel are processed. The controller 170 allows the channel information selected by the user to be output through the display unit 180 or the audio output unit 185 together with the processed image or audio signal.

As another example, the controller 170 may receive an external device image playback command from the external device, for example, a camera or a camcorder, according to an external device image playback command received through the user interface unit 150. The video signal or the audio signal may be output through the display unit 180 or the audio output unit 185.

The controller 170 may control the display 180 to display an image. For example, the display unit may include a broadcast image input through a tuner, an external input image input through the external device interface unit 135, an image input through a network interface unit, or an image stored in the storage unit 140. The control may be displayed at 180. In this case, the image displayed on the display unit 180 may be a still image or a video, and may be a 2D image or a 3D image.

In addition, the controller 170 may control to reproduce the content. In this case, the content may be content stored in the video display device 100, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

The controller 170 according to the present invention can set a port with the voice recognition apparatus 300. The port setting may be set from the user interface unit 150.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the controller 170, or an image signal, data signal, etc. received from the external device interface unit 135 into R, G, and B signals, respectively. Generate a drive signal.

The display unit 180 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

The display unit 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the controller 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs a voice signal. The voice output unit 185 may be implemented by various types of speakers.

Meanwhile, in order to detect a gesture of a user, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the image display apparatus 100. have. The signal detected by the sensing unit (not shown) may be transmitted to the control unit 170 through the user interface unit 150.

The video display device 100 described above is a fixed type of ATSC (8-VSB) digital broadcasting, DVB-T (COFDM) digital broadcasting, ISDB-T (BST-OFDM) digital broadcasting, and the like. It may be a digital broadcast receiver capable of receiving at least one.

8 is a block diagram illustrating a configuration of a voice recognition apparatus 300 that provides a method for controlling a video display device according to an embodiment of the present invention. Referring to FIG. 8, the voice recognition apparatus 300 may include a user interface 301, a voice receiver 302, a controller 303, a storage 304, a network interface 305, a display 306, and the like. The sound output unit 307 may be included.

The user interface unit 301 may transmit a signal input by the user to the controller 170 or transmit a signal from the controller 170 to the user. The user interface unit may be configured of a button, a touch screen, a key, and the like capable of receiving a user's control command, and may transmit an input control signal to the controller 303.

In addition, the user interface unit 301 may receive a selection of a voice control mode according to the present invention. In selecting the voice control mode, a separate button or key may be provided on the voice recognition apparatus 300 to switch to the voice control mode. In addition, the voice recognition apparatus 300 may be switched to the voice control mode by entering the user menu.

The voice receiver 302 may receive a voice in a voice control mode state. In addition, the voice receiver 302 can wait to receive voice from the start of the voice control mode. The voice receiver 302 may operate a microphone (not shown) and / or a voice recorder (not shown) for waiting to receive voice. The voice receiver 302 may include any voice recorder capable of receiving and storing voice.

The controller 303 may acquire control information for controlling the image display device 100 based on the voice received by the voice receiver 302. In detail, the controller 303 may request the server 200 to convert the text corresponding to the received voice. In addition, the controller 303 may request and obtain control information based on the converted text from the server 200. The controller 303 obtaining the control information may transmit the control information to the speech recognition apparatus 300.

Meanwhile, although the controller 303 according to an embodiment of the present invention requests and acquires an external server 200 in obtaining text conversion and control information of a voice, the controller 303 according to another embodiment of the present invention. ) Itself may perform at least one of text conversion of speech and acquisition of control information. To this end, the controller 303 may include at least one of a speech recognition module and a keyword matching module.

The storage unit 304 may store the received voice. In addition, the storage unit 304 according to an embodiment of the present invention may include port setting information for transmitting and receiving data with the image display device 100.

The storage unit 304 may include frequency band and channel information of a radio signal for transmitting and receiving data with the server 100. In addition, the storage unit 304 may store an internet address for connection with the server 100.

The received voice may be stored in the storage 304, but may be stored in a voice recorder (not shown) included in the voice receiver 302.

The storage unit 304 may include, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD). Memory, etc.), RAM, ROM (e.g., EEPROM, etc.) at least one type of storage medium.

The network interface unit 305 may provide an interface for connecting the image display device 100 to a wired / wireless network including an internet network. The network interface unit 305 may include, for example, an Ethernet terminal for connection with a wired network, and for example, for connection with a wireless network, for example, a wireless LAN (WLAN) (Wi-). Fi, Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, and the like can be used.

The network interface unit 305 according to the present invention may perform data transmission / reception with the server 100. In a system in which the server 100 is composed of a voice recognition server and a keyword matching server, the network interface unit 305 may transmit and receive data with each server. The network interface unit 305 may be connected to the server 100 through a wireless Internet or a wired Internet.

The display unit 306 generates a driving signal by converting an image signal, a data signal, an OSD signal, etc. processed by the controller 303 into R, G, and B signals, respectively.

The display unit 306 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

In addition, the display unit 306 may be configured as a touch screen and used as an input device in addition to the output device. In this case, the display unit 306 may be configured together with the user interface unit 301. In addition, the display unit 306 may receive a user's selection of a voice control mode.

The display unit 306 according to the present invention may display a screen indicating entry information into the voice control mode. In addition, the display unit 306 may display the voice transmitted by the user as the converted text for the user to confirm. In addition, the display unit 306 may display information for transmitting control information for controlling the image display device 100 on the screen based on the user's voice. In addition, the display unit 306 may display information indicating that the image display device 100 is operated according to the control information.

The sound output unit 307 receives a signal processed by the controller 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs a voice signal. The voice output unit 185 may be implemented by various types of speakers.

In addition, the sound output unit 307 according to the present invention may output the entry into the voice control mode as voice. In addition, the sound output unit 307 may replay the stored voice to confirm the voice transmitted by the user. In addition, the sound output unit 307 may output information for transmitting control information for controlling the image display device 100 based on a user's voice as voice. Also, the sound output unit 307 may output as a sound that the image display device 100 is operated according to the control information.

9 is a flowchart illustrating a method for controlling a video display device executed on the speech recognition apparatus 300 according to an embodiment of the present invention.

In step S11, the voice control mode is started. In the voice control mode, the selection may be input through the user interface unit 301 of the voice recognition apparatus 300. The voice recognition apparatus 300 may operate the voice receiver or the voice recorder when the voice control mode is started.

In operation S12, the voice recognition apparatus 300 receives a voice. In addition, the received voice may be stored in the voice recognition apparatus 300.

In operation S13, the speech recognition apparatus 300 may request the server 200 to convert the text corresponding to the received speech. Any speech recognition technique may be used to convert text corresponding to the received speech.

In step S14, the converted text is obtained. The converted text may be configured in rtf (rich text format) format. In addition, the converted text may be configured in a data format that can be transmitted and received between the server 200 and the speech recognition apparatus 300.

In operation S15, the speech recognition apparatus 300 may request control information based on the converted text from the server 100.

In operation S16, the speech recognition apparatus 300 may obtain control information. The control information may include a command regarding a specific function of the video display device 100. In addition, the control information may include a value relating to a specific function of the video display device 100.

For example, a case in which channel name 'MBC' corresponds to channel number 11 will be described. After the user enters the voice control mode, the user inputs "MBC" into the voice recognition device 300. The speech recognition apparatus 300 obtains the text converted into "MBC" (step S14), and acquires corresponding control information (step S16). The command related to a specific function included in the control information may be a command meaning 'channel change'. In addition, the value related to a specific function included in the control information may be 'MBC'. That is, the voice recognition apparatus 300 may obtain control information indicating 'change of channel to MBC' through the voice input by the user. In addition, even when a user inputs a voice of “11” into the speech recognition apparatus 300, the same control information may be obtained.

The user may not input a specific channel name or channel number into the speech recognition apparatus 300. For example, when a user inputs "channel up" to the speech recognition apparatus 300. The server 100 recognizes a channel change to a channel one step above the currently displayed channel, and the control information transmitted to the voice recognition apparatus 300 includes a command meaning 'channel change' and a value of '+1'. You can include commands that mean '.

In addition, the user may enter "channel up". In this case, the control information transmitted to the voice recognition apparatus 300 may include a command meaning 'channel change' and a command meaning '+3' as its value.

When the user inputs "volume down down", the control information may include a command regarding a specific function meaning 'volume adjustment' and a command meaning '-2'.

In operation S17, the voice recognition apparatus 300 may convert the obtained control information into a control signal that can communicate with the video display device 100 and transmit the converted control information. The data path for transmitting control information may be preset between the voice recognition apparatus 300 and the image display device 100. The control signal may be transmitted through the user interface 15 of the video display device or through the external device interface 135.

10 is a flowchart illustrating a method of controlling a video display device on the server 100 according to an embodiment of the present invention.

In step S21, the server 200 receives a request for text conversion of speech. The text conversion request may be received together with the voice of the conversion target.

In step S22, the received voice is converted into text. The server 200 may include a separate speech recognition module for conversion to text.

In operation S23, the converted text is transmitted to the speech recognition apparatus 300.

In step S24, it is determined whether the server 200 receives a request for control information based on the converted text. If it does not receive a request for control information, it terminates. In this case, the control information based on the text converted by the speech recognition apparatus 300 itself may be determined and transmitted to the image display device 100.

In step S25, upon receiving a request for control information, control information is retrieved. The server 200 may use a keyword matching module to retrieve control information.

In operation S26, the server 200 may transmit the retrieved control information to the image display device 100.

FIG. 11 illustrates a method of controlling a video display device executed on a system for controlling the flow of data transmitted and received between a video display device, a voice recognition device, and a server according to an embodiment of the present invention, and a video display device according to the present invention.

In step S31, the voice recognition apparatus 300 starts the voice control mode.

In operation S32, the voice recognition apparatus 300 receives a voice.

In operation S33, the voice recognition apparatus 300 requests the server 200 to convert text corresponding to the received voice. The text information request signal may include the received voice, a text conversion command, and identification information of the corresponding speech recognition apparatus 300.

In operation S34, the server 200 may transmit text information corresponding to the received voice to the speech recognition apparatus 300.

In operation S35, the speech recognition apparatus 300 requests the server 200 for control information based on the converted text. The data regarding the text information request may include the converted text, the control information request command, and the speech recognition apparatus 300 identification information.

In operation S36, the server 200 transmits control information to the speech recognition apparatus 300. The control information may include a command regarding a specific function of the video display device 100 and its value.

In operation S37, the voice recognition apparatus 300 may transmit a control signal for controlling the image display device 100 to the image display device 100 according to the control information.

In operation S38, the video display device 100 executes a control command according to the received control signal.

In the above, the method for controlling an image display device and an apparatus therefor according to an embodiment of the present invention have been described.

The method and the voice recognition apparatus for controlling a video display device according to the present invention are not limited to the configuration and method of the above-described embodiments, but the above embodiments may be modified in various ways so that various modifications can be made. Or some may be selectively combined.

On the other hand, the video display device control method of the present invention can be implemented as a processor-readable code on a processor-readable recording medium provided in the video display device. The processor-readable recording medium includes all kinds of recording devices that store data that can be read by the processor. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet. . The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

100: video display device
105: broadcast receiving unit
130: network interface unit
135: external device interface
140: storage unit
150: user interface unit
170: control unit
180: display unit
185: audio output
200: server
300: speech recognition device

Claims (19)

In the method for controlling the video display device using a speech recognition device,
Starting a voice control mode capable of controlling an image display device using a voice recognition device;
Receiving a voice by the voice recognition device;
Obtaining control information for controlling the image display device based on the received voice;
And transmitting the control information to the video display device. The method of claim 1,
And requesting conversion of text corresponding to the received voice. The method of claim 2,
And requesting control information based on the converted text. The method of claim 1,
And receiving a selection of a voice control mode. The method of claim 1,
And storing the received voice. The method of claim 1,
And the control information includes a command regarding a specific function of the video display device, and includes a command regarding the specific function and a value of the specific function. The method of claim 1,
The transmitting may include converting the control information into a control signal that can communicate with the video display device. In the voice recognition device for controlling a video display device,
A voice receiver configured to receive a voice when a voice control mode capable of controlling a video display device using a voice recognition device is started;
A control unit obtaining control information for controlling the video display device based on the received voice;
And a network interface unit for transmitting the control information to the video display device. The method of claim 8,
The control unit is a speech recognition device for obtaining a text by requesting the conversion of the text corresponding to the received voice. 10. The method of claim 9,
The controller is a voice recognition device for requesting control information based on the converted text. The method of claim 8,
And a user interface unit configured to receive a selection of a voice control mode. The method of claim 8,
And a storage unit for storing the received voice. The method of claim 8,
The control information includes a command regarding a specific function of the video display device, and includes a command regarding the specific function and a value of the specific function. The method of claim 8,
And a wireless signal processor configured to convert the control information into a control signal that can communicate with the video display device. In the method for controlling the video display device using the voice received from the voice recognition device,
Receiving a request for converting a voice and a text corresponding to the voice from the speech recognition apparatus;
Converting the speech into text;
Transmitting the converted text;
Retrieving control information for controlling the video display device upon receiving a request for control information based on the converted text; And
And transmitting the control information to the speech recognition apparatus. 16. The method of claim 15,
And storing the received voice or the converted text. The method of claim 1,
And the control information includes a command regarding a specific function of the video display device. A computer-readable storage medium including command codes for controlling an image display device using a voice recognition device,
The command code, the control unit of the speech recognition device,
Initiate the voice control mode to control the video display device using the voice recognition device,
Receive voice,
Obtaining control information for controlling the video display device based on the received voice;
And a code for transmitting the control information to the video display device. A computer-readable storage medium including command code for controlling a video display device by using a server receiving a voice from a voice recognition device, the computer-readable storage medium comprising:
The command code, the control unit of the server,
Receiving a request for converting a voice and a text corresponding to the voice from the speech recognition apparatus;
Convert the voice into text,
Send the converted text,
Upon receiving a request for control information based on the converted text, the control information for controlling the video display device is retrieved.
And code for transmitting the control information to the speech recognition device.

Images