KR101969222B1 - Method for providing interactive shopping data broadcasting based on voice recognition - Google Patents

Abstract

There is provided a method of providing an interactive shopping data broadcasting based on speech recognition capable of recognizing a voice of a viewer and minimizing a remote control operation while providing a new user experience. The interactive shopping data broadcasting providing method converts a voice signal of a viewer to recognize it as a voice command, and superimposes the response interface defined differently according to the type of the voice command on the shopping broadcast interface. Accordingly, the viewer can continuously view the shopping broadcast and display desired search or other image information on the digital TV screen with the audio signal without operating a separate remote controller.

Description

TECHNICAL FIELD [0001] The present invention relates to a method for providing interactive shopping data broadcasting based on voice recognition,

The present invention relates to a method for providing shopping data broadcasting, and more particularly, to a method for providing interactive shopping data broadcasting based on voice recognition.

Traditionally, home shopping broadcasting has been provided through television broadcasting. Television broadcasting uses the entire screen of the receiver. The broadcast program contents produced by the broadcasting company are broadcast through the entire screen of the receiver, and the viewer likewise views the home shopping broadcast on the entire television screen.

Such home shopping broadcasting is also provided through data broadcasting. Data broadcasting is defined differently from existing television broadcasting. Television broadcasting is defined as broadcasting which transmits a broadcasting program composed of voice and video, but data broadcasting refers to broadcasting in which information is transmitted in the form of codes or data, not audio / video broadcasting. In other words, data broadcasting is characterized in that, when a digital signal is transmitted to a broadcast radio wave, the receiving device automatically decodes and processes the code or data and receives the result directly from the receiver or controls other devices It is broadcasting of new field as new media.

Television and data broadcasting also differ in the way they order goods. In the case of the conventional television broadcasting, a telephone order by which a consumer calls a home shopping company by looking at a telephone number displayed on the screen is the only method. In the case of data broadcasting, besides a telephone order, information may be inputted and ordered by using a TV remote control.

On the other hand, although the remote control order is a little more convenient than the telephone ordering, the user who is familiar with the computer keyboard may still feel uncomfortable in ordering the remote control. Most remote controllers have numeric keys and direction keys, but they do not have the same character keys as keyboards. Accordingly, there is a demand for an ordering method that can minimize a remote control operation of a viewer in a home shopping data broadcasting and can provide a new user experience at the same time.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method for providing an interactive shopping data broadcasting based on speech recognition that can recognize a voice of a viewer and minimize a remote control operation while providing a new user experience.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other matters not mentioned can be clearly understood by those skilled in the art from the following description.

According to another aspect of the present invention, there is provided a method for providing interactive shopping data broadcasting based on speech recognition, the method comprising: receiving a shopping data broadcast from a service server; ; Recognizing a voice command of a viewer; Displaying a request item interface on the digital TV when the voice command is a commodity request command and generating a selection event for a selected commodity when a selection event for selecting at least one of the commodities displayed in the requested commodity interface from the viewer is generated, ; And if the voice command is an order command, the set-top box proceeds with an ordering process for the goods to be played on the shopping broadcast interface.

The set-top box may request the service server to search for a predetermined commodity included in the commodity request command, receive the result, and display the requested commodity in the request commodity interface. have.

The commodity request command is a command for requesting a commodity recommendation. The settop box may request a commodity recommendation for the viewer to the service server, receive the result, and display the result in the request commodity interface.

The selection event may be performed through a remote controller for controlling the set-top box or a voice of the viewer.

The ordering process may include making a telephone call to the shopping broadcast customer center through the call module embedded in the set top box or through the viewer's mobile device stored with the mobile application associated with the set-top box.

The ordering process may include sending the order URL to the mobile device of the predetermined viewer, and the mobile device calling the ordering web page using the order URL.

If the voice command is a video request command, the set-top box may request the next broadcast product information to the service server, receive the result, and display the result on the request video interface.

The shopping broadcast interface displays shopping broadcast VOD contents provided in real time from the service server, and the set-top box displays a response interface defined differently according to the type of the voice command to be superimposed on the shopping broadcast interface have.

The details of other embodiments are included in the detailed description and drawings.

As described above, according to the method of providing an interactive shopping data broadcast according to the present invention, the set-top box recognizes and processes the voice command of the viewer, thereby minimizing the operation of the remote controller of the viewer. For example, if a viewer orders an order with a voice signal for a product that is currently being broadcasted, the user can immediately make a phone call or call an order web page on the mobile device. If a viewer requests a search for a particular product with a voice signal or requests a recommended product, the set top box may provide a new user experience by superimposing a new response interface on the existing screen to display the request result. Further, when a user requests a next broadcast product with a voice signal, the set-top box can provide a new user experience by superimposing a new response interface on the existing screen and displaying the next broadcast product information.

As described above, when the order process is performed in the shopping data broadcast, the user's convenience can be improved by minimizing the operation of the remote controller by using the voice command of the viewer instead of the remote controller. Also, by displaying the response result of the voice command using the new response interface, it is possible to provide a new user experience that has not been found in the shopping data broadcasting until now.

FIG. 1 schematically shows a configuration of a network system according to an embodiment of the present invention.
2 is a flowchart sequentially illustrating a method of providing an interactive shopping data broadcast according to an embodiment of the present invention.
3 schematically shows a user interface of a digital TV.
4 schematically shows a user interface when a product request command is recognized.
Figure 5 is a schematic representation of the user interface during the ordering process through a telephone connection.
Figure 6 is a schematic representation of the user interface during the ordering process through an order URL.
7 schematically illustrates a user interface responsive to a video request command.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

In the specification of the present invention, " T-commerce " means a data broadcasting service capable of conducting a series of commercial transactions including search, purchase and settlement of goods information through digital TV. In the present invention, unless otherwise specified, "home shopping broadcast" or "shopping broadcast" is specified as a shopping broadcast provided by T-commerce data broadcast.

The " response interface " used in the specification of the present invention refers to a result of a call to a digital TV screen in response to a voice command of a viewer and can be understood as a concept including a requested goods interface, an order process interface, have.

FIG. 1 schematically shows a configuration of a network system according to an embodiment of the present invention. The network system according to an embodiment of the present invention includes a service server 30, a voice recognition server 40, a set-top box 20, and a digital TV 10. The network system is limited to conceptually describing how a T-commerce data broadcasting service is systematically provided, and does not represent all networks related to TV broadcasting.

The set top box 20 is connected to the digital TV 10 and the service server 30 to mediate data transmission and reception between the digital TV 10 and the service server 30. [ The set top box 20 is given a unique set top box ID (SAID) and when the digital TV 10 connects to the service server 30 via the set top box 20, Top box ID of the set top box ID, and obtains the user information corresponding to the set top box ID by inquiring the external or internal subscriber information management system. The set-top box 20 is usually connected to the digital TV 10 through a cable. The set-top box 20 is connected to the service server 30 via a network medium and receives TV broadcast, data broadcast, and related data from the service server 30 and displays the received data on the digital TV 10 . The network medium includes a wired and / or wireless network. Preferably, a cable connected to the service server 30 may be connected to the set-top box 20 for data transmission / reception. The remote controller executes a control command for operating the digital TV 10 and / or the set-top box 20. [

The set-top box 20 may include a voice recognition module therein. The set-top box 20 may collect voice signals of a viewer through a sound sensor and convert the voice signals into words, sentences, etc. to recognize voice commands. In another example, the set-top box 20 collects the voice signal of the viewer through the sound sensor and transmits the voice signal to the voice recognition server 40. The voice recognition server 40 converts the voice signal into a word or a sentence, Top box 20, as shown in FIG. In the specification of the present invention, "the set-top box recognizes a voice command" means that the set-top box 20 converts a voice signal into a word, a sentence or the like through an internal voice recognition module or an external voice recognition server 40, It should be understood as including the case of recognizing commands.

The set-top box 20 may include a call module capable of exchanging voice signals through the existing telephone network or the Internet network. In addition, the set-top box 20 may include a mobile application installed in the viewer's mobile device or a communication module capable of communicating with the mobile web page, and the mobile application associated with the set- A telephone connection can be made to the set telephone number.

The service server 30 transmits the contents of the shopping data broadcast to the set-top box 20. The service server 30 may have various databases in managing data broadcast contents and resources. For example, the database may include a VOD content database, a product information database, a user information database, a product recommendation information database, and the like. Further, the database may include a recommended content database, a screen content database, a log recording database, or an order information database. These databases may be located in a system managed by the service server 30 or may be located in a repository managed by an external server.

In addition, the service server 30 may include storage means such as a database, means for managing, processing and transmitting / receiving data, means for processing communication with an external device or external system, means for authentication and security , Which may include various hardware devices, server devices, and software. A process for authenticating the subscriber's information that matches the set-top box ID, a process for transmitting the URL to the user mobile device, a telephone call to the registered telephone number, A process of performing settlement processing in connection with an external financial institution or the like can be executed through communication with an external server and devices if the data resource resides outside or needs to be transmitted to the outside.

Hereinafter, a method of providing interactive shopping data broadcasting according to an embodiment of the present invention will be described in detail with reference to FIG. 2 to FIG. 2 is a flowchart sequentially illustrating a method of providing an interactive shopping data broadcast according to an embodiment of the present invention. FIGS. 3 to 7 are views schematically showing a user interface of the digital TV in each step of FIG.

First, when the set-top box 20 receives the shopping data broadcast from the service server 30, the set-top box 20 displays the shopping broadcasting interface 100 on the digital TV 10 (S10). 3 schematically shows a user interface of a digital TV. Specifically, the shopping broadcast interface 100 includes a content area for providing content to a viewer and a screen area 110 surrounding the content area. The content area includes a VOD area 120 in which shopping broadcast contents are displayed, a TV application area 130, 132, 134, 136 having a plurality of independent functions and independent areas, and a notification area 140 for notifying an event. The screen area 110 refers to an area that is not a content area in the shopping broadcast interface 100 and becomes a background skin of the content area.

Also, the content area may include a general mark (not shown) that provides information only as text and / or images. The general cover may include an address of a website, an order phone number, a consultation telephone number, price information, product information, remote trigger trigger information, weather information, a data broadcasting shopping channel, and other guidance text or images.

In the VOD area 120, the shopping broadcast VOD contents provided by the service server 30 in real time are reproduced according to the broadcast schedule table. When the set-top box 20 is connected to the service server 30, the shopping broadcast interface 100 is displayed on the screen of the digital TV 10 as described above, and then the user commands a full screen view using a remote controller or the like In the case of a full-screen view can be switched.

The TV application areas 130, 132, 134, and 136 may display a real-time ranking list of shopping broadcasts, display recommended content for the content area, or display merchandise planning content predetermined by the service server 30 . Also, the TV application areas 130, 132, 134, and 136 may invoke order events for the shopping broadcast VOD content currently being broadcast through the VOD area 120. [

Then, when a viewer generates a voice signal, the set-top box 20 receives the voice signal and converts the voice signal into a word, a sentence or the like through an internal voice recognition module or an external voice recognition server 40 to recognize a voice command S20). The set-top box 20 can continuously receive a voice signal when the digital TV 10 is on, and can recognize a voice command when a specific word is included in the voice signal. For example, when the viewer speaks "Jinnyah", the set-top box 20 converts the voice signal generated thereafter to recognize it as a voice command.

In the present embodiment, the case where the voice command is one of a product request command, an order command, and a video request command will be described as an example.

(1) The case where the voice command is a commodity request command will be described first. Here, the commodity request command may be a command for requesting a commodity search or a command for requesting commodity recommendation. 4 schematically shows a user interface when a product request command is recognized.

2 and 4, when a viewer generates a predetermined voice signal, for example, " Find a cleaner product, " " Show a cleaner product, " The set-top box 20 recognizes such a voice signal as a product search command (S30), and requests the service server 30 to search for a predetermined product, for example, " A cleaner " The service server 30 searches the database for the requested goods and transmits the result to the set top box 20. The set top box 20 transmits the requested goods interface 200 composed of the searched products to the digital TV 10 (S32). The requested goods interface 200 comprises a goods area 210, 212, 214 for displaying an image of retrieved goods. Subsequently, when the viewer generates a selection event for selecting at least one of the goods displayed in the request goods interface 200, the set-top box 20 proceeds with the order process for the selected goods.

The same is true even when the commodity request command is a command for requesting commodity recommendation. For example, when a viewer generates a predetermined voice signal such as " recommended product ", " product recommendation ", " give product recommendation ", " show livable merchandise ", " show best merchandise " 20 recognizes the voice signal as a commodity recommendation command (S30), and requests the service server 30 for commodity recommendation based on the commodity recommendation command. The service server 30 obtains product recommendation information from the database and transmits the product recommendation information to the set top box 20 and the set top box 20 displays the requested product interface 200 composed of the recommended products on the digital TV 10 S32). The requested goods interface 200 is composed of merchandise areas 210, 212, and 214 that display images of recommended merchandise. Subsequently, when the viewer generates a selection event for selecting at least one of the goods displayed in the request goods interface 200, the set-top box 20 proceeds with the order process for the selected goods.

On the other hand, the selection event for the goods displayed on the requested goods interface 200 may be generated by a remote controller for controlling the set-top box 20, or may be generated by recognizing a voice signal of a viewer. The viewer's selection event can be understood as an order command for the corresponding product.

The above-mentioned order processor may be implemented in at least one of the following examples.

Figure 5 is a schematic representation of the user interface during the ordering process through a telephone connection. Here, the order process can be performed by making a telephone connection with the shopping broadcast customer center through the call module built in the set-top box 20 (S60). In another example, the ordering process may be performed by making a phone connection with the shopping broadcast customer center through the mobile device of the viewer stored in the mobile application associated with the set-top box 20 (S60). When there is a viewer's selection event or order command, the set-top box 20 displays the order process interface 300 responding thereto to be superimposed on the shopping broadcast interface 100 so that the viewer is notified that the speech recognition is well- Of the respondents. For example, character information such as " Connect K shopping counseling phone " is displayed on the order process interface 300 so that the viewer can easily know the current progress.

Figure 6 is a schematic representation of the user interface during the ordering process through an order URL. Here, the order process may be performed by the set-top box 20 transmitting the order URL to the mobile device of the predetermined viewer, and the mobile device calling the order web page using the order URL (S62). In this case, the set-top box 20 displays the order process interface 300 in response to the viewer's selection event or order command to be superimposed on the shopping broadcast interface 100. For example, on the order process interface 300, character information such as " send the order URL of the selected product to the mobile phone " is displayed so that the viewer can easily know the current progress.

(2) If the voice command is an order command, the set-top box 20 is provided in real time from the service server 30 and proceeds with the order process for the goods currently being reproduced on the shopping broadcast interface 100 (S40). For example, when a viewer generates a predetermined voice signal, for example, a "consultation telephone", "order telephone", "order telephone", "order by telephone", etc., (S60), and transmits the call connection request message to the shopping broadcast customer center through the mobile device stored in the built-in communication module or the set-top box 20 (S60). If the viewer generates a settled voice signal, e.g., "order", "immediate order", "order immediately", "order goods", "order broadcast" The voice signal is recognized as an order request, and the order URL is transmitted to the mobile device of the preset viewer. The viewer calls the order web page through the order URL using the mobile device and proceeds with the order (S62).

(3) If the voice command is a video request command, the set-top box 20 requests the next broadcast product information from the service server 30, and the service server 30 searches for the next broadcast product information based on the broadcast schedule table And transmits the result to the set-top box 20. The set-top box 20 receives the result and displays it on the request video interface 400 (S52). 7 schematically illustrates a user interface responsive to a video request command. Image information for the next broadcast product may be displayed in the merchandise window 410 of the requesting video interface 400. [

As described above, according to the present invention, while the shopping broadcast VOD contents provided in real time from the service server 30 are being displayed on the shopping broadcast interface 100, when there is a voice signal of the viewer, the voice signal is converted and recognized as a voice command And displays the processing result as a response interface. Accordingly, the viewer can continuously view the shopping broadcast and display desired search or other image information on the digital TV screen with the audio signal without operating a separate remote controller.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

10: Digital TV
20: Set-top box
30; Service server
40: voice recognition server
100: Shopping Broadcast Interface
110: Screen area
120: VOD area
130, 132, 134, 136: TV application area
140: notification area
200: Request product interface
210, 212, 214: Product area
300: Order Process Interface
400: Request video interface

Claims (7)

A set-top box receiving a shopping data broadcast from a service server providing T-commerce data broadcasting (the service server is not a web server and the set-top box is connected to the service server using a network for data broadcasting transmission and reception without a web browser)
Displaying a shopping broadcast interface on a digital TV (VOD content of a shopping data broadcast provided by the service server in real time is reproduced on the shopping broadcast interface);
Recognizing a voice command of a viewer (the set top box continuously receiving a voice signal when the digital TV is on, and recognizing the voice signal as the voice command when a specific word is included in the voice signal);
Displaying a request item interface on the digital TV when the voice command is a commodity request command and generating a selection event for a selected commodity when a selection event for selecting at least one of the commodities displayed in the requested commodity interface from the viewer is generated, ; And
And if the voice command is an order command, the set-top box proceeds with an ordering process for a product to be played on the shopping broadcast interface. The method according to claim 1,
The settop box requests the service server to search for a predetermined commodity included in the commodity request command, receives the result of the request, and displays the result on the request commodity interface A method for providing interactive shopping data broadcasting based on speech recognition. The method according to claim 1,
Wherein the product request command is a command for requesting a product recommendation, the set-top box requests a product recommendation for the viewer to the service server, and receives the result and displays the product recommendation on the requested product interface. A method for providing an interactive shopping data broadcast. The method according to claim 1,
Wherein the selection event is performed through a remote controller for controlling the set-top box or a voice of the viewer. The method according to claim 1,
Wherein the ordering process comprises: communicating with a shopping broadcast customer center via a call module built in the set-top box or via a mobile device of the viewer stored in a mobile application associated with the set-top box; A method for providing data broadcasting. The method according to claim 1,
Wherein the ordering process comprises the steps of: transmitting the order URL to the set-top box's mobile device, and the mobile device calling the ordering web page using the order URL; Delivery method. The method according to claim 1,
Wherein when the voice command is a video request command, the set-top box requests the next broadcast product information to the service server, and receives the result and displays the result on the request video interface. Delivery method.

Images