KR101387928B1 - Home media device, system and method using it - Google Patents

Abstract

According to the present invention, it is possible to provide a home network service using a second communication network such as Wi-Fi (Wi-Fi) in addition to the mobile communication network in the home network service. The present invention provides a home media device, a home network system using the same, and a method for providing convenience to a user through multiple control.

Description

Home media device and home network system and method using same {HOME MEDIA DEVICE, SYSTEM AND METHOD USING IT}

The present invention relates to a home media device and a home network system and method using the same, and more particularly, a home network service provided only at home can be extended to an external server using a local area network such as Wi-Fi (Wi-Fi) in addition to a mobile communication network. It is possible to provide a variety of services, the home media device and a home network system and method using the same to provide a user's convenience by the user can control a plurality of multimedia devices in the home through a voice command without a separate button operation It is about.

A home network is a technology that literally connects and controls PCs, peripherals, and mobile phone appliances at home. In other words, it is possible to control all home appliances such as computers, televisions, video players, air conditioners, and the like by accessing a network established in a home through the Internet or a telephone line, both inside and outside.

To do this, a protocol is needed in the home to control all devices in one device. Therefore, Ethernet, HomePNA, and Eye Triple 1394 are applied as wired home network technologies in the home, and Bluetooth, Ultra Wide Band (UWB) and ZigBee are used as wireless home network technologies. ), Wireless 1394, Home RF technology, etc. are being applied.

In recent years, HANA (High Definition Audio Video) is a standardized research that integrates wired / wireless networks in the home centering on DTV / PC in conjunction with home network technology and freely plays digital contents by automatically connecting various multimedia devices in the home network. Network Alliance (DLNA), Digital Living Network Alliance (DLNA), and Universal Plug and Play (UPnP) are being actively promoted.

As such, a function of providing multimedia contents in a home network system is emerging as a main function. Accordingly, a means for a user to easily play and control multimedia contents distributed in various multimedia devices on a home network is provided. It is required.

However, the home network system developed to date has a method of displaying the multimedia content information stored in the multimedia device when the user selects the corresponding multimedia device through a controller such as a remote controller. That is, the user performs a separate key operation to search for multimedia content distributed in each multimedia device. In this method, if the user cannot know which device the multimedia content is stored in, the user has to search for the multimedia content by pressing a button one by one. Also, when playing the searched multimedia content, the screen switching and display must be repeated as well. There are very cumbersome inconveniences due to multiple button operations.

In order to solve the inconvenience of the user, a method of controlling some devices on the home network and home automation methods using the voice recognition technology have been proposed, but these methods are all used for independent home appliances such as channel adjustment or volume adjustment. Limited to a single function. It simply replaces the button functions installed in home appliances with voice commands, which provides convenience to users compared to the existing ones.However, multimedia is stored and distributed in various multimedia devices on the home network using only user's voice commands without any button operation. Techniques for integrated search, playback and control of content have not been proposed yet.

In addition, the existing home network system is connected to a plurality of multimedia devices connected to one network in the home to provide a home networking service only in the home. That is, the existing home network system is limited to providing a service in the home.

The present invention was devised to solve the above problems, and the home network service, which was provided only in the home, can be extended to an external server using a local area network of Wi-Fi in addition to the mobile communication network, thereby providing various services. It is an object of the present invention to provide a home media device, a home network system and a method using the same, which provide a user's convenience by controlling a plurality of multimedia devices through a voice command without a separate button manipulation.

To this end, according to a first aspect of the present invention, a home network system according to the present invention is a home network system that communicates with a plurality of multimedia devices through a wired / wireless network in a home, and controls the plurality of multimedia devices in the home. A wireless access device for connecting to a device through short-range communication; A voice recognition server that recognizes a voice signal received from the device in the home and converts the voice signal into a text form; A plurality of external servers each providing various multimedia or life information and related services; When a voice signal is input from the device in the home through the wireless access device, the voice signal is transmitted to the voice recognition server, and when the text information is received from the voice recognition server, the voice signal is transferred to the wireless access device to the device in the home. And a digital hub (HUB) linking the devices in the home to the corresponding external server when a request is made for predetermined information stored in the plurality of external servers from the devices in the home.

According to a second aspect of the present invention, a home media device capable of home networking according to the present invention is connected to an external server while communicating with a plurality of multimedia devices through a wired / wireless network in a home to provide various multimedia services in a home. A device, comprising: a communication interface configured to communicate with a plurality of multimedia devices in the home and to be connected to the external server through a wired / wireless internet network or a local area communication, and to receive a user's voice command in the home to perform preprocessing. Device control to perform a voice signal receiving unit and a function to register and cancel the plurality of multimedia devices in the home, to generate and transmit a control signal for controlling the operation thereof, and to interpret the control signals received from the multimedia devices in the home. / Management module, and a plurality of multimedia registered in the home A memory unit storing information about the device, contents stored in the plurality of multimedia devices, and various kinds of information; and when a voice signal is input from the voice signal receiver, the voice signal is transmitted to a home media server through the communication interface unit. When the voice information in the form of text is received, the information stored in the memory unit is checked to extract detailed information corresponding to the voice information in the form of text, and the extracted detailed information is transmitted to the multimedia device control / management module. It characterized in that it comprises a control unit for controlling the operation of.

According to a third aspect of the present invention, a service method according to the present invention provides a home networking service for providing various multimedia services in connection with an external server while communicating with a plurality of multimedia devices through a wired / wireless network in a home. The voice recognition server may be wirelessly connected to a voice recognition server through a wired / wireless internet network or a short-range communication when a request for a service to be provided from a user is input by voice in a device for controlling and controlling a plurality of multimedia devices in the home. Transmitting a voice input signal to the terminal; (b) upon receiving text voice information corresponding to the voice input signal from the voice recognition server, the device operating the multimedia device corresponding to the service to execute a service corresponding to the received text voice information; (c) receiving and playing from the multimedia apparatus or an external server where the information is located when a request for desired information is received from a user while the corresponding service is being executed by the operation; (d) providing an additional service related to the information.

According to a fourth aspect of the present invention, a service method according to the present invention corresponds to the service for executing the service when a request for a desired service to be provided from a user is input in a device for controlling and controlling a plurality of multimedia devices in a home. Operating a multimedia device; (b) receiving and playing from the multimedia apparatus or an external server where the information is located when a request for desired information is received from a user while a corresponding service is being executed by the operation; (c) providing an additional service related to the information.

According to the present invention, by providing a home-based service centered on a feature phone, it can be extended to an external server by using short-range communication such as Wi-Fi to provide useful and various services in the home, and by utilizing voice recognition technology. When providing my various services, there is an effect that can provide UI convenience to the user.

In addition, by developing a home media device to replace Internet telephony, it is effective to secure in-house services and to acquire new customers such as housewives.

In addition, it can be used as a smart shopping service and local advertising model through corporate alliances such as Homeplus and card readers, and can expand the wireless service channels of mobile operators into the home and secure new content distribution channels. It works.

1 is a block diagram schematically illustrating a home network system using a home media device according to an exemplary embodiment of the present invention.
2 is a block diagram of a home media device according to an exemplary embodiment of the present invention.
3 to 7 are flowcharts illustrating a method of providing various services in a home by using a home media device according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The configuration of the present invention and the operation and effect thereof will be clearly understood through the following detailed description. Before describing the present invention in detail, the same components are denoted by the same reference symbols as possible even if they are displayed on different drawings. In the case where it is judged that the gist of the present invention may be blurred to a known configuration, do.

In the present embodiment, the communication between the device in the home and the external server can be performed through local area communication, and the user can control the home networking by selecting an arbitrary multimedia device in the home to play and control the content based on voice recognition. It aims to provide an integrated system configuration and control method that can be easily managed and managed.

Here, the short-range communication is a Wi-Fi communication network that is established in each office or home nowadays, there is an advantage that the service according to the present embodiment can be immediately applied to all subscribers using the Internet without changing the working environment. This means that you can use your home networking system without paying the cost of using the Internet.

1 is a block diagram schematically illustrating a home network system using a home media device according to an exemplary embodiment of the present invention.

Home network system according to an embodiment of the present invention is connected through the home media device 100, the home media device 100 and the wired and wireless Internet network 300 that can be integrated control of a plurality of multimedia devices (10 to 50) in the home It may include a home media server 400 to provide a variety of services.

The home media device 100 may be provided in each home, and may be shared with a plurality of multimedia devices 10 to 50 in the home through an interface such as a digital living network alliance (DLNA) and a converged personal network service (CPNS).

Here, the plurality of multimedia devices 10 to 50 may include a location-based service module for providing a location-based service, an information providing service module for providing life information such as traffic, weather, news, securities, and travel; Manages and provides announcements at bank ATMs, financial service modules that provide card payment services, shopping service modules that provide shopping-related services for goods, community centers, municipal offices, and apartment management offices. At least one of a public institution service module, a broadcast service module for providing terrestrial broadcasting, cable broadcasting, satellite broadcasting, and IPTV broadcasting service, and a multimedia service module for providing radio, movie, music video, music, and game related services; It may include one or more. For example, an audio 10 including a multimedia service module, a PC 20 including a financial service module and a public institution service module, a TV 30 including a broadcast service module, a multimedia service module and a broadcast service module simultaneously It may be a PMP 40 including, or a wired or wireless terminal 50 including a location based service module.

The home media device 100 may input a control command for controlling the multimedia devices 10 to 50 when it is desired to acquire information from the predetermined multimedia devices 10 to 50. The control command may be a signal of a key button manipulated by the user, or may be a voice signal of the user. According to this, the home media device 100 may include an operation panel provided with a key button on a main body or in a remote control form. In addition, it may be provided with a mechanism for processing the user's voice signal input through the microphone. The detailed configuration thereof will be described in detail with reference to FIG. 2.

The home media device 100 according to an embodiment of the present disclosure may communicate with the home media server 400 by accessing the wired / wireless internet network 300 through the wireless access device 200 in the home. Alternatively, the home media server 400 may communicate with the wired / wireless Internet network 300 directly.

The wireless access device 200 may be an access point (AP) for short-range communication connection. That is, in the case of Wi-Fi, which is a wireless LAN, the short-range wireless access device 200 becomes a Wi-Fi access point, and in the case of short-range communication using Bluetooth, a Bluetooth access point and a zigbee access in the short-range communication using Zigbee. It can be a point.

The wired / wireless internet network 300 connects the wireless access device 200, the home media server 400, and the backbone network 600 connected to the internet telephone network 700 to perform data communication therebetween. The wired / wireless Internet network 300 is a network that exists in the TCP / IP protocol and its upper layer, that is, Hypertext Transfer Protocol (HTTP), Telnet, File Transfer Protocol (FTP), Domain Name Server (DNS), and SMTP (Simple). Mail Transfer Protocol (STP), Simple Network Management Protocol (SNTP), Network File Service (NFS), and Network Information Service (NIS).

The home media server 400 is a digital hub 410 for linking to the external server 500 in response to a request from the home media device 100 and a voice recognition for reading a voice signal input from the home media device 100. It may be implemented including a server 420 and the like.

Here, the external server 500 is a web site that provides information and contents related to various multimedia services, and the location-based server 510 that provides location-based services as shown, traffic, weather, news, securities, travel and Information providing server 520 to provide information of life together, bank ATM, financial server 530 to provide card payment service, shopping server 540 to provide shopping-related services for goods, community center, Public institution server (550) that manages and provides announcements in public offices including ward offices, apartment management offices, broadcast servers (560) providing terrestrial broadcasting, cable broadcasting, satellite broadcasting, and IPTV broadcasting services, radio, movies, and music. It may include a multimedia server 570 that provides video, music, game-related services.

In detail, the digital hub 410 transmits a request of the home media device 100 to the voice recognition server 420 or the external server 500, and receives data from the voice recognition server 420 or the external server 500. When the home media device 100 is relayed.

That is, the digital hub 410 transmits the voice signal from the home media device 100 to the voice recognition server 420, and receives the textual voice information from the voice recognition server 420. To be transmitted to the home media device 100. In addition, when the digital hub 410 receives a request for predetermined information stored in an external server from the home media device 100, the digital hub 410 requests the desired information and receives the information.

The voice recognition server 420 recognizes a voice signal received from the home media device 100, converts the voice signal into text information, and provides the voice signal.

Therefore, the home network system of the present invention configured as described above forms a home network service by integrating and controlling a multimedia device in the home using the home media device 100, as well as a home based on wired / wireless Internet network or local area communication. By performing communication between the media device 100 and the home media server 400, various multimedia services and life information services are provided from an external server.

The home media device 100 for implementing this is configured as follows.

Referring to FIG. 2, the home media device 100 according to an exemplary embodiment of the present invention may include a communication interface 110, a voice signal receiver 120, a controller 130, a multimedia device control / management module 140, The memory unit 150 may be included.

The communication interface 110 is connected to the wired / wireless internet network 300 or the wireless access device (200 of FIG. 1) to communicate with an external server, and simultaneously with a plurality of multimedia devices (10 to 50 of FIG. 1) in a home. Interface to send and receive communication. The communication interface 110 applies short-range communication, that is, Wi-Fi communication, for communication connection with an external server, and DLNA (Digital Living Network) for communication with a plurality of multimedia devices (10 to 50 of FIG. 1) in a home. Interfaces such as Alliance and Converged Personal Network Service (CPNS) can be applied.

The voice signal receiver 120 receives a voice command of a user in the home and performs preprocessing. In fact, various noises may exist in the home, and the voice signal, which may be noise other than the user's voice signal, may be removed to emphasize only the voice signal of the user.

The multimedia device control / management module 140 registers / cancels a multimedia device newly installed or removed from the home network, generates and transmits a control signal for controlling the operation of the registered multimedia device, and receives the control received from the multimedia device. Functions such as interpreting signals.

The memory unit 150 stores information on a multimedia device registered in a home network, contents and various information stored in the multimedia device, an address book including a name / telephone number, schedule information of a user, memo information, and the like.

The controller 130 controls the operation of each component as a whole, and when a voice signal is input from the voice signal receiver 120, transmits it to the home media server through the communication interface 110, and text for the voice signal. When the voice information in the form is received, the information stored in the memory unit 150 is checked to extract information corresponding to the text information in the form of text. Then, the extracted information is transmitted to the multimedia device control / management module 140 to control the operation of the corresponding multimedia device.

Next, a method of providing a home network service using the home media device configured as described above will be described.

In the service method according to the present invention, when a user requests a desired service to be provided by voice using a home media device that controls a plurality of multimedia devices in a home, the home media device receives a voice recognition server through a wired / wireless internet network or a local area communication. And transmitting a voice input signal to the home media device, receiving a text voice information corresponding to the voice input signal from a voice recognition server, and executing the service corresponding to the received text voice information. Operating a corresponding multimedia device; if a request for desired information is received from a user on a service executed by the operation of the multimedia device, receiving and playing the corresponding multimedia device or an external server where the desired information is located; Added to affect the information may be implemented by a method comprising: providing a service.

Here, only the case where the request for service and information from the user is performed by voice input is described, but the present invention is not limited thereto and may be performed by touch input.

In addition, although an example of a process of transmitting and receiving data regarding voice by directly connecting a home media device to a voice recognition server has been described, the present invention is not limited thereto, and a digital hub is separately provided between the home media device and the voice recognition server. It can be implemented to send and receive data to and from the voice recognition server via.

In addition, the service method according to the present invention enables multiple control to enable simultaneous use by executing a multimedia device having a different function even while using one multimedia device through a home media device. For example, you can perform a memo while on the phone and perform financial tasks at the same time.

Various embodiments will be described by way of example.

3 is a process illustrating an example of providing a location based service using a home media device.

Location-based services according to an embodiment of the present invention is a service that provides a convenient search for the location of the family in the kitchen or living room, using the address book of the home media device 100 'second', 'honey', 'mom It is possible to search by personalized name such as'.

The location-based service is a service that can be additionally performed while using a plurality of multimedia devices in the home through the home media device 100. For example, you can use your home audio to find a family location while washing dishes in the kitchen while listening to music.

As shown in FIG. 3, first, when a 'find family location' menu is selected for a location-based service from a user on a menu screen displayed on the home media device 100, the screen is switched to a detailed screen to find whose location. Ask the user to enter the target person (S1, S2).

Menu selection is generally possible through manipulation of a key panel, but in the case of a touch screen, selection can be made using a touch. In particular, in an embodiment of the present invention, the user may select by inputting a voice command corresponding to the menu. For example, in the case of the 'Family Location Finding' menu, when the user says "No. 1" or "Family Location Finding", the user may receive a voice signal and select a corresponding menu.

Subsequently, when the user inputs an object to be searched for as "second" or "second position", the home media device 100 transmits a voice signal to the voice recognition server 420 of the home media server 400. A read request for a voice signal is requested (S3).

In this case, the voice signal received through the home media device 100 may be directly transmitted to the voice recognition server 420, but may be transmitted to the voice recognition server 420 via the home media server 400. That is, the digital hub of the home media server 400 first receives all signals transmitted from the home media device 100 and according to the type of the received signals, refers to the voice recognition server 420 or an external server (here, means a location-based server). Can optionally be delivered.

Accordingly, the speech recognition server 420 reads the speech signal and converts the speech signal into text information "second" or "second second".

The home media device 100 receives voice information recognized by the voice recognition server 420, that is, voice information in text form (S4), and retrieves a phone number corresponding to the received voice information in text form through the internal memory unit. (S5).

After the search, the home media device 100 requests a location and a map of the phone number from the location-based server 510 with the searched phone number, and in response thereto, retrieves the location information and the map information from the location-based server 510. Receive (S6, S7).

The home media device 100 displays the received location information and the map information through its own screen of the multimedia device or the home media device currently used (S8), and connects to the corresponding phone number on the displayed screen or makes a video call. , An additional service such as location information transfer may be provided (S9).

4 is a process illustrating an example of providing a traffic information service using a home media device.

Similar to the location-based service, the traffic information service may be additionally performed while using a desired multimedia device through the home media device 100 in the home.

That is, while using a predetermined multimedia device through the home media device 100 in the home, a menu screen is requested to the home media device 100 in order to use the traffic information service.

Then, when the 'traffic information' menu is selected by the user on the menu screen displayed on the home media device 100, the screen is switched to the next detailed screen and requests input of section information on which section traffic information is to be searched for. (S10, S11).

Menu selection here is possible through the touch and voice input method as described above.

Then, when the section information to be searched from the user is input by voice, for example, "riverside north road," the home media device 100 transmits a voice signal to the voice recognition server 420 of the home media server 400 to voice A read request for a signal is requested (S12).

In this case, the home media server 400 may include a digital hub between the voice recognition servers 420 to receive all signals received through the home media device 100 from the digital hub and then transfer them to the corresponding server. In this case, all data described below, that is, data transmitted / received from the home media device 100 to the voice recognition server 420 or the information providing server 520 will be transmitted through the digital hub.

The home media device 100 receives the voice information recognized by the voice recognition server 420, that is, the voice information in the form of text (S13), and transmits the traffic to the information providing server 520 using the received text information. Request information (S14).

When the home media device 100 receives the traffic information of the corresponding section from the information providing server 520, the home media device 100 displays the current media device or the home media device through its own screen (S15 and S16).

In addition, the home media device 100 provides a detailed traffic information service for monitoring traffic conditions through CCTV or searching for traffic information of another section using detailed information of a corresponding section on the displayed traffic information screen (S17). In addition, the searched traffic information can be sent to the phone number desired by the user.

As such, the traffic information service may not only be provided with traffic information in / outside the home, but may also inform the traffic information to a wired / wireless terminal or another personal terminal in conjunction with a text service. In addition, it is possible to monitor the traffic situation through CCTV of a specific section to obtain real-time traffic information.

5 is a process illustrating an example of providing a music service using a home media device.

Generally, the music service may be provided through a multimedia device connected to a home media device in the home, but may be provided by itself through a multimedia service module included in the home media device.

In the former case, music playback may be performed based on music files stored in the multimedia device. If the music file does not exist in the multimedia device, the music server may request and provide the multimedia server.

FIG. 5 illustrates the former case as an example. First, when the music service menu is selected by the user, the home media device 100 drives the corresponding multimedia device (play player) (S20 and S21).

Then, the home media device 100 displays the playlist or playable music folder stored in the multimedia device, and requests the voice recognition server 420 when the playlist or music folder to be played by voice is requested from the displayed detailed screen. Through the process of receiving the voice information in the form of text through (S22 to S24). Here, the playlist or the playable music folder may be divided into popular songs, Top100 songs, popular songs in April, pop songs, classic songs, and music to be depressed.

The home media device 100 lists up a playlist or a music folder mapped to the received text information voice information (S25), and music playback is basically performed based on a multimedia device.

If the listed music files are not stored in the multimedia device, the multimedia server 580 requests the corresponding music files (S26). In response to the request, the corresponding music is received from the multimedia server 570 and played through the multimedia device (S27, S28).

Thereafter, when the playback operation is changed according to a user's request, the home media device 100 may request and receive music corresponding to the playback operation control from the multimedia server 570 (S29).

In addition, the home media device 100 may request and use an additional service for setting music provided from the multimedia server 570 to coloring of a wired / wireless terminal or a home telephone (S30).

As such, the music service according to an embodiment of the present invention may provide a service for listening to a desired music through a web site providing music content, and may provide an additional service such as curling / ringtone / music download.

6 is a process illustrating an example of providing a broadcast service using a home media device.

As shown, the broadcast service is connected to the TV in the home and the broadcast server 560 in the outside to provide a service for watching a video, TV broadcast, and Video On Demand (VOD).

That is, when the broadcast menu is selected by a touch or voice input from the user, the home media device 100 drives the multimedia device TV in the home (S40).

Subsequently, when a request for a broadcast channel is input by voice such as "real-time TV" and "SBS" from the user, the home media device 100 transmits the input voice signal to the voice recognition server 420 of the home media server 400. Request to recognize the voice signal by transmitting to the voice signal, and receives the voice information recognized in the form of text from the voice recognition server 420 (S42, S43).

The home media device 100 transmits the received text and voice information to the broadcast server 560 to request tuning of the corresponding broadcast channel, and receives the information on the requested broadcast channel from the broadcast server 560 in streaming (streaming). S44, S45). In operation S46, a desired broadcast service may be provided by reproducing the received broadcast information through a TV.

7 is a process illustrating an example of providing a memo-based notification service using a home media device.

The memo service can provide a notification service for notifying a memo by sending a memo to be easily memorized by inputting a content to be memorized without using a key input and then transmitting it to the wired / wireless terminal 50 when necessary.

Like the location-based service and the traffic information service, the memo service may be additionally used while using other multimedia functions, or may be used independently of the multimedia device in the home.

In addition, the memo service may convert memo information recorded by voice to text using STT (Speech To Text) technology, or transmit an MMS message in the form of an attached file.

In detail, the home media device 100 requests the user to input contents to memo when the memo service menu is selected by the user's touch or voice input (S50 and S51).

At the same time as the request, the home media device 100 records a user's voice by operating a recorder.

When the voice recording is completed, the home media device 100 requests recognition of the voice signal recorded by the voice recognition server 420 of the home media server 400, and in response thereto, the voice signal from the voice recognition server 420. And information corresponding to the data is received in the form of text (S53, S54).

The home media device 100 may display a memo content based on the received voice information (S55), and request a text service according to a user's request (S56).

That is, when the phone number of the wired / wireless terminal 50 to be transmitted is input, the memo content may be transmitted to the corresponding phone number through the mobile communication network. In the case of simple recording information, it can be attached as a memo file and sent to MMS. If STT technology is applied, the memo contents can be sent by SMS.

In addition, various services that can be provided using a home media device according to an exemplary embodiment of the present invention are various.

In other words, information service that provides information of daily life such as weather of today, headline news, stock information, light, schedule service that manages user's schedule, card reader in home media device or by separate USB connection. Financial services for payments, remittances and payments, recipe services that search for the dish you want and provide recipes for it, search for and click on the dish you want to eat, and a shopping list of ingredients is automatically sent to the mart and food ingredients are delivered. Smart shopping service, photo frame display service to display pictures in home media device, video message service to send video message through camera of home media device and check received video mesh, advertisement leaflet of nearby mart or restaurant, event Notice or a building such as a community center or ward office In the kitchen, the public office announcement / promotion service that provides complaint guidance information for each household in the apartment, the apartment management office, etc., the home phone or the pre-registered personal mobile phone rings, the phone rings the same on the home media device. It can provide a call sync service to receive a ringing call in the living room or the home.

As a specific example, housewife A goes home and goes home, and plays music directly using a remote control provided by a home media device. After listening to sweet music and getting down, you can press the Messages button on your remote to hear the voice messages you left today.

As another example, when looking at the home media device, it is confirmed that a message to pay the car tax arrives at the city hall, and the user can click on the message and pay the giro directly through the payment site.

As another example, when the refrigerator is opened, the refrigerator is empty and the user can select the necessary necessities and pay by pressing the shopping mall widget of the home media device to pay with a card.

As another example, when I turn on the TV with the remote control of the home media device, there is nothing interesting, so I can directly access the movie affiliate site through the home media device, download the funny movie, go to the PC and watch it using DLNA.

As another example, running a securities widget on a home media device may cause the melody to sound that the price of the stock I bought is rising.

In another example, an SMS is received on a home media device that it arrives from a child who is about to return from the school.

As another example, while thinking about what to eat for dinner, I clicked on a local ad on my home media device and told me that pizza is on sale today. If you think you should eat pizza and click on the ad, you'll be connected.

As another example, housewife A can go home and go home, and prepare for dinner while listening to music by accessing a 70-80 music room with a telephone remote control provided in a home media device.

As another example, you can use your home media device to pay with your credit card at Jiro by using your home media device.

As another example, a local brother may be urgently lent a loan, and while receiving a call through the home media device, the user may execute a touch memo function, write down the brother's account number, and execute the home ATM application to directly transfer the money.

As another example, I'm in 70-80 music, so I don't have time to go to a nearby mart, so I'm in a hurry to use my home media device to access my neighborhood home plus, select the side dish you need from the "evening street" menu, and add it to your cart. You can use coupons stored in your phone to get discounts and to request delivery.

In another example, I'm eating dinner and taking a break from my second child on a school trip. 'Tap the picture to select the Send Message feature on your home media device, Take good care of yourself and send a picture taken tomorrow. '

Another example was a call from my husband saying that the Olympic Boulevard was too blocked during work. You can retrieve traffic information through your home media device and tell your husband's cell phone an alternative route to get home.

As another example, an important call came in and the TV volume was too noisy, 'Where did the remote control go?' Speaking out and yelling "TV off" can turn the TV off.

In another example, kids seem to be coming later than time, and they're washing dishes, so they're bothered to use their cell phone or phone. Select the voice recognition menu on their home media device and say "first location" or "second location." Shown with

In another example, a message from a resident center about donating blood at the front door of an apartment tomorrow afternoon may arrive at a home media device to participate.

The foregoing description is merely illustrative of the present invention, and various modifications may be made by those skilled in the art without departing from the spirit of the present invention. Accordingly, the embodiments disclosed in the specification of the present invention are not intended to limit the present invention. The scope of the present invention should be construed according to the following claims, and all the techniques within the scope of equivalents should be construed as being included in the scope of the present invention.

Conventional home network services can be manipulated due to multiple button operations when playing or requesting multimedia content, and can be controlled only for a single device of a home network system. However, the present invention provides a plurality of multimedia devices connected to a home network. Control the home media device based on voice recognition, provide UI convenience without user button operation, and change the working environment by realizing the home network through the recent Wi-Fi communication. It is possible to immediately apply the service according to the present embodiment to all subscribers using the Internet without using the home networking system without burdening the line cost of using the Internet.

10: Audio 20: PC
30: TV 40: PMP
50: wired and wireless terminal 100: home media device
200: wireless access device 300: wired and wireless Internet network
400: home media server 410: digital hub
420: speech recognition server 500: external server
510: location-based server 520: information providing server
530: financial server 540: shopping server
550: public institution server 560: broadcast server
570: multimedia server 110: communication interface unit
120: voice signal receiving unit 130: control unit
140: multimedia device control / management module
150:

Claims (14)

A home network system that communicates with a plurality of multimedia devices through a wired or wireless network in a home.
A wireless access device for connecting to a device for controlling a plurality of multimedia devices in the home by short-range communication;
A voice recognition server that recognizes a voice signal received from the device in the home and converts the voice signal into a text form;
A plurality of external servers each providing various multimedia or life information and related services;
When a voice signal is input from the device in the home through the wireless access device, the voice signal is transmitted to the voice recognition server, and when the text information is received from the voice recognition server, the voice signal is transferred to the wireless access device to the device in the home. And a digital hub (HUB) for linking the in-home device to a corresponding external server when a request is made for predetermined information stored in the plurality of external servers from the in-home device.
Home network system comprising a.
The method according to claim 1,
The plurality of external servers,
A location based server that provides location based services;
An information providing server that provides information of life such as traffic, weather, news, security, and travel;
A bank server for providing bank ATMs and card payment services;
A shopping server that provides shopping-related services for goods;
Public institution server that manages and provides notices from resident centers, ward offices, and apartment management offices;
A broadcast server providing terrestrial broadcasting, cable broadcasting, satellite broadcasting, and IPTV broadcasting service;
A home network system comprising at least one of a multimedia server that provides radio, movie, music video, music, and game related services.
A device in a home that provides various multimedia services in connection with an external server while communicating with a plurality of multimedia devices through a wired / wireless network in a home,
A communication interface unit configured to communicate with a plurality of multimedia devices in the home and to connect to the external server through a wired / wireless internet network or short-range communication;
A voice signal receiver for receiving a voice command of the user in the home and performing preprocessing;
A device control / management module for generating / transmitting a plurality of multimedia devices in the home, generating and transmitting a control signal for controlling the operation thereof, and interpreting a control signal received from the multimedia device in the home;
A memory unit for storing information about a plurality of multimedia devices registered in the home, contents stored in the plurality of multimedia devices, and various kinds of information;
When the voice signal is input from the voice signal receiver, the voice signal is transmitted to the home media server through the communication interface. When the voice information in text form is received, the information stored in the memory unit is checked and the text information is received. Control unit for controlling the operation of the multimedia device by extracting the corresponding detailed information, and transfers the extracted detailed information to the multimedia device control / management module
A home media device comprising a.
The method of claim 3, wherein
And communicating with a plurality of multimedia devices in the home using an interface including a digital living network alliance (DLNA) and a converged personal network service (CPNS).
The method of claim 3, wherein
The plurality of multimedia devices,
Location-based service modules that provide location-based services;
An informational service module that provides information of life such as traffic, weather, news, securities, and travel;
A banking service module that provides bank ATMs and card payment services;
A shopping service module that provides shopping-related services for goods;
Public institution service module that manages and provides notices from resident centers, local government offices and apartment management offices,
A broadcasting service module for providing terrestrial broadcasting, cable broadcasting, satellite broadcasting, and IPTV broadcasting service;
A home media device comprising at least one multimedia service module for providing radio, movie, music video, music, and game related services.
The method according to claim 3 or 5,
And a device including at least one of the plurality of multimedia devices may be integrally mounted to the device.
The method of claim 3, wherein
And a voice recognition module for receiving a voice command of the user in the home and converting the voice command into text.
As a method of providing a home networking service that provides various multimedia services in connection with an external server while communicating with a plurality of multimedia devices through a wired / wireless network in a home,
(a) When a request for a service to be provided from a user is input by voice in a device for controlling and controlling a plurality of multimedia devices in the home, the voice is transmitted to the voice recognition server by wirelessly connecting to the voice recognition server through a wired / wireless internet network or a local area communication. Transmitting an input signal;
(b) upon receiving text voice information corresponding to the voice input signal from the voice recognition server, the device operating the multimedia device corresponding to the service to execute a service corresponding to the received text voice information;
(c) receiving and playing from the multimedia apparatus or an external server where the information is located when a request for desired information is received from a user while the corresponding service is being executed by the operation;
(d) providing additional services relating to the information
Home network service providing method comprising a.
As a method of providing a home networking service that provides various multimedia services in connection with an external server while communicating with a plurality of multimedia devices through a wired / wireless network in a home,
(a) operating a multimedia device corresponding to the service to execute the service when a request for a service desired to be provided by a user is input in a device for controlling and controlling a plurality of multimedia devices in the home;
(b) receiving and playing from the multimedia apparatus or an external server where the information is located when a request for desired information is received from a user while a corresponding service is being executed by the operation;
(c) providing an additional service related to the information;
Home network service providing method comprising a.
The method of claim 9,
The request for the service to be provided from the user in the step (a) is a home network service providing method characterized in that performed by touch input or voice input.
11. The method of claim 10,
When the voice input is received
The device wirelessly connects to a voice recognition server through a wired or wireless Internet network or a local area communication to transmit a voice input signal according to the voice input;
If the device receives text voice information corresponding to the voice input signal from the voice recognition server, controlling the multimedia device corresponding to the service to execute a service corresponding to the received text voice information. Home network service providing method, characterized in that.
10. The method according to claim 8 or 9,
The request for the desired information from the user in step (b) may be performed by a touch input or a voice input, and the voice input may further include a step of recognizing the voice and converting the text into text. Way.
10. The method according to claim 8 or 9,
When the information requested by the user is provided from an external server,
Connecting the device to an external server where the information is located;
Requesting, by the device, the information from the external server and receiving the information in response to the request;
And reproducing the information received by the device based on the service.
14. The method of claim 13,
The step of connecting the device to the external server where the information is located,
And the device is accessible through the digital hub by accessing the digital hub through a wired / wireless internet network or a local area communication.

Images